qwen3-8b-base

This page lists all pretrained SAEs available for qwen3-8b-base.

qwen-scope-3-8b-base-w64k-l100

• Huggingface Repo: Qwen/SAE-Res-Qwen3-8B-Base-W64K-L0_100

id	hook_name	d_sae
layer0 Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0 hf	65536
layer1 Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1 hf	65536
layer2 Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2 hf	65536
layer3 Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3 hf	65536
layer4 Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4 hf	65536
layer5 Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5 hf	65536
layer6 Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6 hf	65536
layer7 Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7 hf	65536
layer8 Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8 hf	65536
layer9 Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9 hf	65536
layer10 Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10 hf	65536
layer11 Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11 hf	65536
layer12 Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12 hf	65536
layer13 Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13 hf	65536
layer14 Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14 hf	65536
layer15 Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15 hf	65536
layer16 Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16 hf	65536
layer17 Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17 hf	65536
layer18 Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18 hf	65536
layer19 Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19 hf	65536
layer20 Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20 hf	65536
layer21 Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21 hf	65536
layer22 Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22 hf	65536
layer23 Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23 hf	65536
layer24 Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24 hf	65536
layer25 Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25 hf	65536
layer26 Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26 hf	65536
layer27 Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27 hf	65536
layer28 Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28 hf	65536
layer29 Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29 hf	65536
layer30 Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30 hf	65536
layer31 Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31 hf	65536
layer32 Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32 hf	65536
layer33 Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33 hf	65536
layer34 Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34 hf	65536
layer35 Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35 hf	65536

qwen-scope-3-8b-base-w64k-l50

• Huggingface Repo: Qwen/SAE-Res-Qwen3-8B-Base-W64K-L0_50

id	hook_name	d_sae
layer0 Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0 hf	65536
layer1 Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1 hf	65536
layer2 Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2 hf	65536
layer3 Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3 hf	65536
layer4 Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4 hf	65536
layer5 Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5 hf	65536
layer6 Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6 hf	65536
layer7 Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7 hf	65536
layer8 Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8 hf	65536
layer9 Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9 hf	65536
layer10 Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10 hf	65536
layer11 Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11 hf	65536
layer12 Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12 hf	65536
layer13 Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13 hf	65536
layer14 Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14 hf	65536
layer15 Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15 hf	65536
layer16 Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16 hf	65536
layer17 Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17 hf	65536
layer18 Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18 hf	65536
layer19 Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19 hf	65536
layer20 Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20 hf	65536
layer21 Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21 hf	65536
layer22 Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22 hf	65536
layer23 Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23 hf	65536
layer24 Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24 hf	65536
layer25 Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25 hf	65536
layer26 Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26 hf	65536
layer27 Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27 hf	65536
layer28 Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28 hf	65536
layer29 Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29 hf	65536
layer30 Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30 hf	65536
layer31 Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31 hf	65536
layer32 Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32 hf	65536
layer33 Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33 hf	65536
layer34 Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34 hf	65536
layer35 Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35 hf	65536

×

Copy Code