gemma-3-1b-pt

This page lists all pretrained SAEs available for gemma-3-1b-pt.

gemma-3-1b-res-matryoshka-dc

• Huggingface Repo: chanind/gemma-3-1b-batch-topk-matryoshka-saes-w-32k-l0-40
• Additional Links:
  • Model

id	hook_name	d_sae
blocks.0.hook_resid_post Load this SAE	blocks.0.hook_resid_post tl	32768
blocks.1.hook_resid_post Load this SAE	blocks.1.hook_resid_post tl	32768
blocks.2.hook_resid_post Load this SAE	blocks.2.hook_resid_post tl	32768
blocks.3.hook_resid_post Load this SAE	blocks.3.hook_resid_post tl	32768
blocks.4.hook_resid_post Load this SAE	blocks.4.hook_resid_post tl	32768
blocks.5.hook_resid_post Load this SAE	blocks.5.hook_resid_post tl	32768
blocks.6.hook_resid_post Load this SAE	blocks.6.hook_resid_post tl	32768
blocks.7.hook_resid_post Load this SAE	blocks.7.hook_resid_post tl	32768
blocks.8.hook_resid_post Load this SAE	blocks.8.hook_resid_post tl	32768
blocks.9.hook_resid_post Load this SAE	blocks.9.hook_resid_post tl	32768
blocks.10.hook_resid_post Load this SAE	blocks.10.hook_resid_post tl	32768
blocks.11.hook_resid_post Load this SAE	blocks.11.hook_resid_post tl	32768
blocks.12.hook_resid_post Load this SAE	blocks.12.hook_resid_post tl	32768
blocks.13.hook_resid_post Load this SAE	blocks.13.hook_resid_post tl	32768
blocks.14.hook_resid_post Load this SAE	blocks.14.hook_resid_post tl	32768
blocks.15.hook_resid_post Load this SAE	blocks.15.hook_resid_post tl	32768
blocks.16.hook_resid_post Load this SAE	blocks.16.hook_resid_post tl	32768
blocks.17.hook_resid_post Load this SAE	blocks.17.hook_resid_post tl	32768
blocks.18.hook_resid_post Load this SAE	blocks.18.hook_resid_post tl	32768
blocks.19.hook_resid_post Load this SAE	blocks.19.hook_resid_post tl	32768
blocks.20.hook_resid_post Load this SAE	blocks.20.hook_resid_post tl	32768
blocks.21.hook_resid_post Load this SAE	blocks.21.hook_resid_post tl	32768
blocks.22.hook_resid_post Load this SAE	blocks.22.hook_resid_post tl	32768
blocks.23.hook_resid_post Load this SAE	blocks.23.hook_resid_post tl	32768
blocks.24.hook_resid_post Load this SAE	blocks.24.hook_resid_post tl	32768

gemma-scope-2-1b-pt-att

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
layer_13_width_16k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_16k_l0_medium Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_13_width_262k_l0_medium Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_13_width_65k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	65536
layer_13_width_65k_l0_medium Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	65536
layer_13_width_65k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	65536
layer_17_width_16k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_16k_l0_medium Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_17_width_262k_l0_medium Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_17_width_65k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	65536
layer_17_width_65k_l0_medium Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	65536
layer_17_width_65k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	65536
layer_22_width_16k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_16k_l0_medium Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_22_width_262k_l0_medium Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_22_width_65k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	65536
layer_22_width_65k_l0_medium Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	65536
layer_22_width_65k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	65536
layer_7_width_16k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_16k_l0_medium Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_7_width_262k_l0_medium Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_7_width_65k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	65536
layer_7_width_65k_l0_medium Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	65536
layer_7_width_65k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	65536

gemma-scope-2-1b-pt-att-all

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	262144

gemma-scope-2-1b-pt-mlp

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_medium Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_1m_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	1048576
layer_13_width_1m_l0_medium Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	1048576
layer_13_width_1m_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	1048576
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_medium Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_13_width_65k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	65536
layer_13_width_65k_l0_medium Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	65536
layer_13_width_65k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	65536
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_medium Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_1m_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	1048576
layer_17_width_1m_l0_medium Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	1048576
layer_17_width_1m_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	1048576
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_medium Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_17_width_65k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	65536
layer_17_width_65k_l0_medium Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	65536
layer_17_width_65k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	65536
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_medium Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_1m_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	1048576
layer_22_width_1m_l0_medium Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	1048576
layer_22_width_1m_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	1048576
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_medium Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_22_width_65k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	65536
layer_22_width_65k_l0_medium Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	65536
layer_22_width_65k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	65536
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_medium Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_1m_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	1048576
layer_7_width_1m_l0_medium Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	1048576
layer_7_width_1m_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	1048576
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_medium Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_7_width_65k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	65536
layer_7_width_65k_l0_medium Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	65536
layer_7_width_65k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	65536

gemma-scope-2-1b-pt-mlp-all

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	262144

gemma-scope-2-1b-pt-res

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	neuronpedia	hook_name	d_sae
layer_13_width_16k_l0_big Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_16k_l0_medium Load this SAE	gemma-3-1b/13-gemmascope-2-res-16k	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_16k_l0_small Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_1m_l0_big Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	1048576
layer_13_width_1m_l0_medium Load this SAE	gemma-3-1b/13-gemmascope-2-res-1m	blocks.13.hook_resid_post tlmodel.layers.13.output hf	1048576
layer_13_width_1m_l0_small Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	1048576
layer_13_width_262k_l0_big Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_262k_l0_medium Load this SAE	gemma-3-1b/13-gemmascope-2-res-262k	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_262k_l0_medium_seed_1 Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_262k_l0_small Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_65k_l0_big Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	65536
layer_13_width_65k_l0_medium Load this SAE	gemma-3-1b/13-gemmascope-2-res-65k	blocks.13.hook_resid_post tlmodel.layers.13.output hf	65536
layer_13_width_65k_l0_small Load this SAE	nan	blocks.13.hook_resid_post tlmodel.layers.13.output hf	65536
layer_17_width_16k_l0_big Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_16k_l0_medium Load this SAE	gemma-3-1b/17-gemmascope-2-res-16k	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_16k_l0_small Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_1m_l0_big Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	1048576
layer_17_width_1m_l0_medium Load this SAE	gemma-3-1b/17-gemmascope-2-res-1m	blocks.17.hook_resid_post tlmodel.layers.17.output hf	1048576
layer_17_width_1m_l0_small Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	1048576
layer_17_width_262k_l0_big Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_262k_l0_medium Load this SAE	gemma-3-1b/17-gemmascope-2-res-262k	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_262k_l0_medium_seed_1 Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_262k_l0_small Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_65k_l0_big Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	65536
layer_17_width_65k_l0_medium Load this SAE	gemma-3-1b/17-gemmascope-2-res-65k	blocks.17.hook_resid_post tlmodel.layers.17.output hf	65536
layer_17_width_65k_l0_small Load this SAE	nan	blocks.17.hook_resid_post tlmodel.layers.17.output hf	65536
layer_22_width_16k_l0_big Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_16k_l0_medium Load this SAE	gemma-3-1b/22-gemmascope-2-res-16k	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_16k_l0_small Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_1m_l0_big Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	1048576
layer_22_width_1m_l0_medium Load this SAE	gemma-3-1b/22-gemmascope-2-res-1m	blocks.22.hook_resid_post tlmodel.layers.22.output hf	1048576
layer_22_width_1m_l0_small Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	1048576
layer_22_width_262k_l0_big Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_262k_l0_medium Load this SAE	gemma-3-1b/22-gemmascope-2-res-262k	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_262k_l0_medium_seed_1 Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_262k_l0_small Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_65k_l0_big Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	65536
layer_22_width_65k_l0_medium Load this SAE	gemma-3-1b/22-gemmascope-2-res-65k	blocks.22.hook_resid_post tlmodel.layers.22.output hf	65536
layer_22_width_65k_l0_small Load this SAE	nan	blocks.22.hook_resid_post tlmodel.layers.22.output hf	65536
layer_7_width_16k_l0_big Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_16k_l0_medium Load this SAE	gemma-3-1b/7-gemmascope-2-res-16k	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_16k_l0_small Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_1m_l0_big Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	1048576
layer_7_width_1m_l0_medium Load this SAE	gemma-3-1b/7-gemmascope-2-res-1m	blocks.7.hook_resid_post tlmodel.layers.7.output hf	1048576
layer_7_width_1m_l0_small Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	1048576
layer_7_width_262k_l0_big Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_262k_l0_medium Load this SAE	gemma-3-1b/7-gemmascope-2-res-262k	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_262k_l0_medium_seed_1 Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_262k_l0_small Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_65k_l0_big Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	65536
layer_7_width_65k_l0_medium Load this SAE	gemma-3-1b/7-gemmascope-2-res-65k	blocks.7.hook_resid_post tlmodel.layers.7.output hf	65536
layer_7_width_65k_l0_small Load this SAE	nan	blocks.7.hook_resid_post tlmodel.layers.7.output hf	65536

gemma-scope-2-1b-pt-res-all

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	262144

gemma-scope-2-1b-pt-transcoders

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
transcoder/layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
transcoder/layer_13_width_16k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
transcoder/layer_13_width_16k_l0_medium Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
transcoder/layer_13_width_16k_l0_medium_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
transcoder/layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
transcoder/layer_13_width_16k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
transcoder/layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
transcoder/layer_13_width_262k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
transcoder/layer_13_width_262k_l0_medium Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
transcoder/layer_13_width_262k_l0_medium_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
transcoder/layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
transcoder/layer_13_width_262k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
transcoder/layer_13_width_65k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	65536
transcoder/layer_13_width_65k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	65536
transcoder/layer_13_width_65k_l0_medium Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	65536
transcoder/layer_13_width_65k_l0_medium_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	65536
transcoder/layer_13_width_65k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	65536
transcoder/layer_13_width_65k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	65536
transcoder/layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
transcoder/layer_17_width_16k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
transcoder/layer_17_width_16k_l0_medium Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
transcoder/layer_17_width_16k_l0_medium_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
transcoder/layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
transcoder/layer_17_width_16k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
transcoder/layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
transcoder/layer_17_width_262k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
transcoder/layer_17_width_262k_l0_medium Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
transcoder/layer_17_width_262k_l0_medium_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
transcoder/layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
transcoder/layer_17_width_262k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
transcoder/layer_17_width_65k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	65536
transcoder/layer_17_width_65k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	65536
transcoder/layer_17_width_65k_l0_medium Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	65536
transcoder/layer_17_width_65k_l0_medium_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	65536
transcoder/layer_17_width_65k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	65536
transcoder/layer_17_width_65k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	65536
transcoder/layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
transcoder/layer_22_width_16k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
transcoder/layer_22_width_16k_l0_medium Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
transcoder/layer_22_width_16k_l0_medium_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
transcoder/layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
transcoder/layer_22_width_16k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
transcoder/layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
transcoder/layer_22_width_262k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
transcoder/layer_22_width_262k_l0_medium Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
transcoder/layer_22_width_262k_l0_medium_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
transcoder/layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
transcoder/layer_22_width_262k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
transcoder/layer_22_width_65k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	65536
transcoder/layer_22_width_65k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	65536
transcoder/layer_22_width_65k_l0_medium Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	65536
transcoder/layer_22_width_65k_l0_medium_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	65536
transcoder/layer_22_width_65k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	65536
transcoder/layer_22_width_65k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	65536
transcoder/layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
transcoder/layer_7_width_16k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
transcoder/layer_7_width_16k_l0_medium Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
transcoder/layer_7_width_16k_l0_medium_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
transcoder/layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
transcoder/layer_7_width_16k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
transcoder/layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
transcoder/layer_7_width_262k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
transcoder/layer_7_width_262k_l0_medium Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
transcoder/layer_7_width_262k_l0_medium_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
transcoder/layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
transcoder/layer_7_width_262k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
transcoder/layer_7_width_65k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	65536
transcoder/layer_7_width_65k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	65536
transcoder/layer_7_width_65k_l0_medium Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	65536
transcoder/layer_7_width_65k_l0_medium_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	65536
transcoder/layer_7_width_65k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	65536
transcoder/layer_7_width_65k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	65536

gemma-scope-2-1b-pt-transcoders-all

• Huggingface Repo: google/gemma-scope-2-1b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_big_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_big_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_big_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_big_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_big_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_big_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_big_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_big_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_big_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_big_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_big_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_big_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_big_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_big_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_big_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_big_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_big_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_big_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_big_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_big_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_big_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_big_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_big_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_big_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_big_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_big_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_big_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_big_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_big_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_big_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_big_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_big_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_big_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_big_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_big_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_big_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_big_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_big_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_big_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_big_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144

×

Copy Code