qwen3-30b-a3b-base

This page lists all pretrained SAEs available for qwen3-30b-a3b-base.

qwen-scope-3-30b-a3b-base-w128k-l100

• Huggingface Repo: Qwen/SAE-Res-Qwen3-30B-A3B-Base-W128K-L0_100

id	hook_name	d_sae
layer0 Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0 hf	131072
layer1 Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1 hf	131072
layer2 Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2 hf	131072
layer3 Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3 hf	131072
layer4 Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4 hf	131072
layer5 Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5 hf	131072
layer6 Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6 hf	131072
layer7 Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7 hf	131072
layer8 Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8 hf	131072
layer9 Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9 hf	131072
layer10 Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10 hf	131072
layer11 Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11 hf	131072
layer12 Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12 hf	131072
layer13 Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13 hf	131072
layer14 Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14 hf	131072
layer15 Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15 hf	131072
layer16 Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16 hf	131072
layer17 Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17 hf	131072
layer18 Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18 hf	131072
layer19 Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19 hf	131072
layer20 Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20 hf	131072
layer21 Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21 hf	131072
layer22 Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22 hf	131072
layer23 Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23 hf	131072
layer24 Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24 hf	131072
layer25 Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25 hf	131072
layer26 Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26 hf	131072
layer27 Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27 hf	131072
layer28 Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28 hf	131072
layer29 Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29 hf	131072
layer30 Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30 hf	131072
layer31 Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31 hf	131072
layer32 Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32 hf	131072
layer33 Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33 hf	131072
layer34 Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34 hf	131072
layer35 Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35 hf	131072
layer36 Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36 hf	131072
layer37 Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37 hf	131072
layer38 Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38 hf	131072
layer39 Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39 hf	131072
layer40 Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40 hf	131072
layer41 Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41 hf	131072
layer42 Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42 hf	131072
layer43 Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43 hf	131072
layer44 Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44 hf	131072
layer45 Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45 hf	131072
layer46 Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46 hf	131072
layer47 Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47 hf	131072

qwen-scope-3-30b-a3b-base-w32k-l50

• Huggingface Repo: Qwen/SAE-Res-Qwen3-30B-A3B-Base-W32K-L0_50

id	hook_name	d_sae
layer0 Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0 hf	32768
layer1 Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1 hf	32768
layer2 Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2 hf	32768
layer3 Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3 hf	32768
layer4 Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4 hf	32768
layer5 Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5 hf	32768
layer6 Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6 hf	32768
layer7 Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7 hf	32768
layer8 Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8 hf	32768
layer9 Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9 hf	32768
layer10 Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10 hf	32768
layer11 Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11 hf	32768
layer12 Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12 hf	32768
layer13 Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13 hf	32768
layer14 Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14 hf	32768
layer15 Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15 hf	32768
layer16 Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16 hf	32768
layer17 Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17 hf	32768
layer18 Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18 hf	32768
layer19 Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19 hf	32768
layer20 Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20 hf	32768
layer21 Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21 hf	32768
layer22 Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22 hf	32768
layer23 Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23 hf	32768
layer24 Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24 hf	32768
layer25 Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25 hf	32768
layer26 Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26 hf	32768
layer27 Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27 hf	32768
layer28 Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28 hf	32768
layer29 Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29 hf	32768
layer30 Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30 hf	32768
layer31 Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31 hf	32768
layer32 Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32 hf	32768
layer33 Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33 hf	32768
layer34 Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34 hf	32768
layer35 Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35 hf	32768
layer36 Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36 hf	32768
layer37 Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37 hf	32768
layer38 Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38 hf	32768
layer39 Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39 hf	32768
layer40 Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40 hf	32768
layer41 Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41 hf	32768
layer42 Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42 hf	32768
layer43 Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43 hf	32768
layer44 Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44 hf	32768
layer45 Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45 hf	32768
layer46 Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46 hf	32768
layer47 Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47 hf	32768

×

Copy Code