qwen3-4b

This page lists all pretrained SAEs available for qwen3-4b.

mwhanna-qwen3-4b-transcoders

Huggingface Repo: mwhanna/qwen3-4b-transcoders

id	neuronpedia	hook_name	d_sae	normalize_activations
layer_0 Load this SAE	qwen3-4b/0-transcoder-hp	blocks.0.mlp.hook_in	163840	none
layer_1 Load this SAE	qwen3-4b/1-transcoder-hp	blocks.1.mlp.hook_in	163840	none
layer_2 Load this SAE	qwen3-4b/2-transcoder-hp	blocks.2.mlp.hook_in	163840	none
layer_3 Load this SAE	qwen3-4b/3-transcoder-hp	blocks.3.mlp.hook_in	163840	none
layer_4 Load this SAE	qwen3-4b/4-transcoder-hp	blocks.4.mlp.hook_in	163840	none
layer_5 Load this SAE	qwen3-4b/5-transcoder-hp	blocks.5.mlp.hook_in	163840	none
layer_6 Load this SAE	qwen3-4b/6-transcoder-hp	blocks.6.mlp.hook_in	163840	none
layer_7 Load this SAE	qwen3-4b/7-transcoder-hp	blocks.7.mlp.hook_in	163840	none
layer_8 Load this SAE	qwen3-4b/8-transcoder-hp	blocks.8.mlp.hook_in	163840	none
layer_9 Load this SAE	qwen3-4b/9-transcoder-hp	blocks.9.mlp.hook_in	163840	none
layer_10 Load this SAE	qwen3-4b/10-transcoder-hp	blocks.10.mlp.hook_in	163840	none
layer_11 Load this SAE	qwen3-4b/11-transcoder-hp	blocks.11.mlp.hook_in	163840	none
layer_12 Load this SAE	qwen3-4b/12-transcoder-hp	blocks.12.mlp.hook_in	163840	none
layer_13 Load this SAE	qwen3-4b/13-transcoder-hp	blocks.13.mlp.hook_in	163840	none
layer_14 Load this SAE	qwen3-4b/14-transcoder-hp	blocks.14.mlp.hook_in	163840	none
layer_15 Load this SAE	qwen3-4b/15-transcoder-hp	blocks.15.mlp.hook_in	163840	none
layer_16 Load this SAE	qwen3-4b/16-transcoder-hp	blocks.16.mlp.hook_in	163840	none
layer_17 Load this SAE	qwen3-4b/17-transcoder-hp	blocks.17.mlp.hook_in	163840	none
layer_18 Load this SAE	qwen3-4b/18-transcoder-hp	blocks.18.mlp.hook_in	163840	none
layer_19 Load this SAE	qwen3-4b/19-transcoder-hp	blocks.19.mlp.hook_in	163840	none
layer_20 Load this SAE	qwen3-4b/20-transcoder-hp	blocks.20.mlp.hook_in	163840	none
layer_21 Load this SAE	qwen3-4b/21-transcoder-hp	blocks.21.mlp.hook_in	163840	none
layer_22 Load this SAE	qwen3-4b/22-transcoder-hp	blocks.22.mlp.hook_in	163840	none
layer_23 Load this SAE	qwen3-4b/23-transcoder-hp	blocks.23.mlp.hook_in	163840	none
layer_24 Load this SAE	qwen3-4b/24-transcoder-hp	blocks.24.mlp.hook_in	163840	none
layer_25 Load this SAE	qwen3-4b/25-transcoder-hp	blocks.25.mlp.hook_in	163840	none
layer_26 Load this SAE	qwen3-4b/26-transcoder-hp	blocks.26.mlp.hook_in	163840	none
layer_27 Load this SAE	qwen3-4b/27-transcoder-hp	blocks.27.mlp.hook_in	163840	none
layer_28 Load this SAE	qwen3-4b/28-transcoder-hp	blocks.28.mlp.hook_in	163840	none
layer_29 Load this SAE	qwen3-4b/29-transcoder-hp	blocks.29.mlp.hook_in	163840	none
layer_30 Load this SAE	qwen3-4b/30-transcoder-hp	blocks.30.mlp.hook_in	163840	none
layer_31 Load this SAE	qwen3-4b/31-transcoder-hp	blocks.31.mlp.hook_in	163840	none
layer_32 Load this SAE	qwen3-4b/32-transcoder-hp	blocks.32.mlp.hook_in	163840	none
layer_33 Load this SAE	qwen3-4b/33-transcoder-hp	blocks.33.mlp.hook_in	163840	none
layer_34 Load this SAE	qwen3-4b/34-transcoder-hp	blocks.34.mlp.hook_in	163840	none
layer_35 Load this SAE	qwen3-4b/35-transcoder-hp	blocks.35.mlp.hook_in	163840	none