gemma-3-12b-pt

This page lists all pretrained SAEs available for gemma-3-12b-pt.

gemma-scope-2-12b-pt-att

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_12_width_16k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_16k_l0_medium Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_12_width_262k_l0_medium Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_12_width_65k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	65536
layer_12_width_65k_l0_medium Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	65536
layer_12_width_65k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	65536
layer_24_width_16k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_16k_l0_medium Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_24_width_262k_l0_medium Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_24_width_65k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	65536
layer_24_width_65k_l0_medium Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	65536
layer_24_width_65k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	65536
layer_31_width_16k_l0_big Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	16384
layer_31_width_16k_l0_medium Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	262144
layer_31_width_262k_l0_medium Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	262144
layer_31_width_65k_l0_big Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	65536
layer_31_width_65k_l0_medium Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	65536
layer_31_width_65k_l0_small Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	65536
layer_41_width_16k_l0_big Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	16384
layer_41_width_16k_l0_medium Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	262144
layer_41_width_262k_l0_medium Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	262144
layer_41_width_65k_l0_big Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	65536
layer_41_width_65k_l0_medium Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	65536
layer_41_width_65k_l0_small Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	65536

gemma-scope-2-12b-pt-att-all

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.attn.hook_z tlmodel.layers.18.self_attn.o_proj.input hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.attn.hook_z tlmodel.layers.19.self_attn.o_proj.input hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.attn.hook_z tlmodel.layers.20.self_attn.o_proj.input hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.attn.hook_z tlmodel.layers.21.self_attn.o_proj.input hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.attn.hook_z tlmodel.layers.22.self_attn.o_proj.input hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.attn.hook_z tlmodel.layers.23.self_attn.o_proj.input hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.attn.hook_z tlmodel.layers.24.self_attn.o_proj.input hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.attn.hook_z tlmodel.layers.25.self_attn.o_proj.input hf	262144
layer_26_width_16k_l0_big Load this SAE	blocks.26.attn.hook_z tlmodel.layers.26.self_attn.o_proj.input hf	16384
layer_26_width_16k_l0_small Load this SAE	blocks.26.attn.hook_z tlmodel.layers.26.self_attn.o_proj.input hf	16384
layer_26_width_262k_l0_big Load this SAE	blocks.26.attn.hook_z tlmodel.layers.26.self_attn.o_proj.input hf	262144
layer_26_width_262k_l0_small Load this SAE	blocks.26.attn.hook_z tlmodel.layers.26.self_attn.o_proj.input hf	262144
layer_27_width_16k_l0_big Load this SAE	blocks.27.attn.hook_z tlmodel.layers.27.self_attn.o_proj.input hf	16384
layer_27_width_16k_l0_small Load this SAE	blocks.27.attn.hook_z tlmodel.layers.27.self_attn.o_proj.input hf	16384
layer_27_width_262k_l0_big Load this SAE	blocks.27.attn.hook_z tlmodel.layers.27.self_attn.o_proj.input hf	262144
layer_27_width_262k_l0_small Load this SAE	blocks.27.attn.hook_z tlmodel.layers.27.self_attn.o_proj.input hf	262144
layer_28_width_16k_l0_big Load this SAE	blocks.28.attn.hook_z tlmodel.layers.28.self_attn.o_proj.input hf	16384
layer_28_width_16k_l0_small Load this SAE	blocks.28.attn.hook_z tlmodel.layers.28.self_attn.o_proj.input hf	16384
layer_28_width_262k_l0_big Load this SAE	blocks.28.attn.hook_z tlmodel.layers.28.self_attn.o_proj.input hf	262144
layer_28_width_262k_l0_small Load this SAE	blocks.28.attn.hook_z tlmodel.layers.28.self_attn.o_proj.input hf	262144
layer_29_width_16k_l0_big Load this SAE	blocks.29.attn.hook_z tlmodel.layers.29.self_attn.o_proj.input hf	16384
layer_29_width_16k_l0_small Load this SAE	blocks.29.attn.hook_z tlmodel.layers.29.self_attn.o_proj.input hf	16384
layer_29_width_262k_l0_big Load this SAE	blocks.29.attn.hook_z tlmodel.layers.29.self_attn.o_proj.input hf	262144
layer_29_width_262k_l0_small Load this SAE	blocks.29.attn.hook_z tlmodel.layers.29.self_attn.o_proj.input hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf	262144
layer_30_width_16k_l0_big Load this SAE	blocks.30.attn.hook_z tlmodel.layers.30.self_attn.o_proj.input hf	16384
layer_30_width_16k_l0_small Load this SAE	blocks.30.attn.hook_z tlmodel.layers.30.self_attn.o_proj.input hf	16384
layer_30_width_262k_l0_big Load this SAE	blocks.30.attn.hook_z tlmodel.layers.30.self_attn.o_proj.input hf	262144
layer_30_width_262k_l0_small Load this SAE	blocks.30.attn.hook_z tlmodel.layers.30.self_attn.o_proj.input hf	262144
layer_31_width_16k_l0_big Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.attn.hook_z tlmodel.layers.31.self_attn.o_proj.input hf	262144
layer_32_width_16k_l0_big Load this SAE	blocks.32.attn.hook_z tlmodel.layers.32.self_attn.o_proj.input hf	16384
layer_32_width_16k_l0_small Load this SAE	blocks.32.attn.hook_z tlmodel.layers.32.self_attn.o_proj.input hf	16384
layer_32_width_262k_l0_big Load this SAE	blocks.32.attn.hook_z tlmodel.layers.32.self_attn.o_proj.input hf	262144
layer_32_width_262k_l0_small Load this SAE	blocks.32.attn.hook_z tlmodel.layers.32.self_attn.o_proj.input hf	262144
layer_33_width_16k_l0_big Load this SAE	blocks.33.attn.hook_z tlmodel.layers.33.self_attn.o_proj.input hf	16384
layer_33_width_16k_l0_small Load this SAE	blocks.33.attn.hook_z tlmodel.layers.33.self_attn.o_proj.input hf	16384
layer_33_width_262k_l0_big Load this SAE	blocks.33.attn.hook_z tlmodel.layers.33.self_attn.o_proj.input hf	262144
layer_33_width_262k_l0_small Load this SAE	blocks.33.attn.hook_z tlmodel.layers.33.self_attn.o_proj.input hf	262144
layer_34_width_16k_l0_big Load this SAE	blocks.34.attn.hook_z tlmodel.layers.34.self_attn.o_proj.input hf	16384
layer_34_width_16k_l0_small Load this SAE	blocks.34.attn.hook_z tlmodel.layers.34.self_attn.o_proj.input hf	16384
layer_34_width_262k_l0_big Load this SAE	blocks.34.attn.hook_z tlmodel.layers.34.self_attn.o_proj.input hf	262144
layer_34_width_262k_l0_small Load this SAE	blocks.34.attn.hook_z tlmodel.layers.34.self_attn.o_proj.input hf	262144
layer_35_width_16k_l0_big Load this SAE	blocks.35.attn.hook_z tlmodel.layers.35.self_attn.o_proj.input hf	16384
layer_35_width_16k_l0_small Load this SAE	blocks.35.attn.hook_z tlmodel.layers.35.self_attn.o_proj.input hf	16384
layer_35_width_262k_l0_big Load this SAE	blocks.35.attn.hook_z tlmodel.layers.35.self_attn.o_proj.input hf	262144
layer_35_width_262k_l0_small Load this SAE	blocks.35.attn.hook_z tlmodel.layers.35.self_attn.o_proj.input hf	262144
layer_36_width_16k_l0_big Load this SAE	blocks.36.attn.hook_z tlmodel.layers.36.self_attn.o_proj.input hf	16384
layer_36_width_16k_l0_small Load this SAE	blocks.36.attn.hook_z tlmodel.layers.36.self_attn.o_proj.input hf	16384
layer_36_width_262k_l0_big Load this SAE	blocks.36.attn.hook_z tlmodel.layers.36.self_attn.o_proj.input hf	262144
layer_36_width_262k_l0_small Load this SAE	blocks.36.attn.hook_z tlmodel.layers.36.self_attn.o_proj.input hf	262144
layer_37_width_16k_l0_big Load this SAE	blocks.37.attn.hook_z tlmodel.layers.37.self_attn.o_proj.input hf	16384
layer_37_width_16k_l0_small Load this SAE	blocks.37.attn.hook_z tlmodel.layers.37.self_attn.o_proj.input hf	16384
layer_37_width_262k_l0_big Load this SAE	blocks.37.attn.hook_z tlmodel.layers.37.self_attn.o_proj.input hf	262144
layer_37_width_262k_l0_small Load this SAE	blocks.37.attn.hook_z tlmodel.layers.37.self_attn.o_proj.input hf	262144
layer_38_width_16k_l0_big Load this SAE	blocks.38.attn.hook_z tlmodel.layers.38.self_attn.o_proj.input hf	16384
layer_38_width_16k_l0_small Load this SAE	blocks.38.attn.hook_z tlmodel.layers.38.self_attn.o_proj.input hf	16384
layer_38_width_262k_l0_big Load this SAE	blocks.38.attn.hook_z tlmodel.layers.38.self_attn.o_proj.input hf	262144
layer_38_width_262k_l0_small Load this SAE	blocks.38.attn.hook_z tlmodel.layers.38.self_attn.o_proj.input hf	262144
layer_39_width_16k_l0_big Load this SAE	blocks.39.attn.hook_z tlmodel.layers.39.self_attn.o_proj.input hf	16384
layer_39_width_16k_l0_small Load this SAE	blocks.39.attn.hook_z tlmodel.layers.39.self_attn.o_proj.input hf	16384
layer_39_width_262k_l0_big Load this SAE	blocks.39.attn.hook_z tlmodel.layers.39.self_attn.o_proj.input hf	262144
layer_39_width_262k_l0_small Load this SAE	blocks.39.attn.hook_z tlmodel.layers.39.self_attn.o_proj.input hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf	262144
layer_40_width_16k_l0_big Load this SAE	blocks.40.attn.hook_z tlmodel.layers.40.self_attn.o_proj.input hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.attn.hook_z tlmodel.layers.40.self_attn.o_proj.input hf	16384
layer_40_width_262k_l0_big Load this SAE	blocks.40.attn.hook_z tlmodel.layers.40.self_attn.o_proj.input hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.attn.hook_z tlmodel.layers.40.self_attn.o_proj.input hf	262144
layer_41_width_16k_l0_big Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.attn.hook_z tlmodel.layers.41.self_attn.o_proj.input hf	262144
layer_42_width_16k_l0_big Load this SAE	blocks.42.attn.hook_z tlmodel.layers.42.self_attn.o_proj.input hf	16384
layer_42_width_16k_l0_small Load this SAE	blocks.42.attn.hook_z tlmodel.layers.42.self_attn.o_proj.input hf	16384
layer_42_width_262k_l0_big Load this SAE	blocks.42.attn.hook_z tlmodel.layers.42.self_attn.o_proj.input hf	262144
layer_42_width_262k_l0_small Load this SAE	blocks.42.attn.hook_z tlmodel.layers.42.self_attn.o_proj.input hf	262144
layer_43_width_16k_l0_big Load this SAE	blocks.43.attn.hook_z tlmodel.layers.43.self_attn.o_proj.input hf	16384
layer_43_width_16k_l0_small Load this SAE	blocks.43.attn.hook_z tlmodel.layers.43.self_attn.o_proj.input hf	16384
layer_43_width_262k_l0_big Load this SAE	blocks.43.attn.hook_z tlmodel.layers.43.self_attn.o_proj.input hf	262144
layer_43_width_262k_l0_small Load this SAE	blocks.43.attn.hook_z tlmodel.layers.43.self_attn.o_proj.input hf	262144
layer_44_width_16k_l0_big Load this SAE	blocks.44.attn.hook_z tlmodel.layers.44.self_attn.o_proj.input hf	16384
layer_44_width_16k_l0_small Load this SAE	blocks.44.attn.hook_z tlmodel.layers.44.self_attn.o_proj.input hf	16384
layer_44_width_262k_l0_big Load this SAE	blocks.44.attn.hook_z tlmodel.layers.44.self_attn.o_proj.input hf	262144
layer_44_width_262k_l0_small Load this SAE	blocks.44.attn.hook_z tlmodel.layers.44.self_attn.o_proj.input hf	262144
layer_45_width_16k_l0_big Load this SAE	blocks.45.attn.hook_z tlmodel.layers.45.self_attn.o_proj.input hf	16384
layer_45_width_16k_l0_small Load this SAE	blocks.45.attn.hook_z tlmodel.layers.45.self_attn.o_proj.input hf	16384
layer_45_width_262k_l0_big Load this SAE	blocks.45.attn.hook_z tlmodel.layers.45.self_attn.o_proj.input hf	262144
layer_45_width_262k_l0_small Load this SAE	blocks.45.attn.hook_z tlmodel.layers.45.self_attn.o_proj.input hf	262144
layer_46_width_16k_l0_big Load this SAE	blocks.46.attn.hook_z tlmodel.layers.46.self_attn.o_proj.input hf	16384
layer_46_width_16k_l0_small Load this SAE	blocks.46.attn.hook_z tlmodel.layers.46.self_attn.o_proj.input hf	16384
layer_46_width_262k_l0_big Load this SAE	blocks.46.attn.hook_z tlmodel.layers.46.self_attn.o_proj.input hf	262144
layer_46_width_262k_l0_small Load this SAE	blocks.46.attn.hook_z tlmodel.layers.46.self_attn.o_proj.input hf	262144
layer_47_width_16k_l0_big Load this SAE	blocks.47.attn.hook_z tlmodel.layers.47.self_attn.o_proj.input hf	16384
layer_47_width_16k_l0_small Load this SAE	blocks.47.attn.hook_z tlmodel.layers.47.self_attn.o_proj.input hf	16384
layer_47_width_262k_l0_big Load this SAE	blocks.47.attn.hook_z tlmodel.layers.47.self_attn.o_proj.input hf	262144
layer_47_width_262k_l0_small Load this SAE	blocks.47.attn.hook_z tlmodel.layers.47.self_attn.o_proj.input hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf	262144

gemma-scope-2-12b-pt-mlp

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_medium Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_medium Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_12_width_65k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	65536
layer_12_width_65k_l0_medium Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	65536
layer_12_width_65k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	65536
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_medium Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_medium Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_24_width_65k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	65536
layer_24_width_65k_l0_medium Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	65536
layer_24_width_65k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	65536
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_medium Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_medium Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	262144
layer_31_width_65k_l0_big Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	65536
layer_31_width_65k_l0_medium Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	65536
layer_31_width_65k_l0_small Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	65536
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_medium Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_medium Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	262144
layer_41_width_65k_l0_big Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	65536
layer_41_width_65k_l0_medium Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	65536
layer_41_width_65k_l0_small Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	65536

gemma-scope-2-12b-pt-mlp-all

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_mlp_out tlmodel.layers.18.post_feedforward_layernorm.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_mlp_out tlmodel.layers.19.post_feedforward_layernorm.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_mlp_out tlmodel.layers.20.post_feedforward_layernorm.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_mlp_out tlmodel.layers.21.post_feedforward_layernorm.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_out tlmodel.layers.22.post_feedforward_layernorm.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_mlp_out tlmodel.layers.23.post_feedforward_layernorm.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_out tlmodel.layers.24.post_feedforward_layernorm.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_mlp_out tlmodel.layers.25.post_feedforward_layernorm.output hf	262144
layer_26_width_16k_l0_big Load this SAE	blocks.26.hook_mlp_out tlmodel.layers.26.post_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_small Load this SAE	blocks.26.hook_mlp_out tlmodel.layers.26.post_feedforward_layernorm.output hf	16384
layer_26_width_262k_l0_big Load this SAE	blocks.26.hook_mlp_out tlmodel.layers.26.post_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_small Load this SAE	blocks.26.hook_mlp_out tlmodel.layers.26.post_feedforward_layernorm.output hf	262144
layer_27_width_16k_l0_big Load this SAE	blocks.27.hook_mlp_out tlmodel.layers.27.post_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_small Load this SAE	blocks.27.hook_mlp_out tlmodel.layers.27.post_feedforward_layernorm.output hf	16384
layer_27_width_262k_l0_big Load this SAE	blocks.27.hook_mlp_out tlmodel.layers.27.post_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_small Load this SAE	blocks.27.hook_mlp_out tlmodel.layers.27.post_feedforward_layernorm.output hf	262144
layer_28_width_16k_l0_big Load this SAE	blocks.28.hook_mlp_out tlmodel.layers.28.post_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_small Load this SAE	blocks.28.hook_mlp_out tlmodel.layers.28.post_feedforward_layernorm.output hf	16384
layer_28_width_262k_l0_big Load this SAE	blocks.28.hook_mlp_out tlmodel.layers.28.post_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_small Load this SAE	blocks.28.hook_mlp_out tlmodel.layers.28.post_feedforward_layernorm.output hf	262144
layer_29_width_16k_l0_big Load this SAE	blocks.29.hook_mlp_out tlmodel.layers.29.post_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_small Load this SAE	blocks.29.hook_mlp_out tlmodel.layers.29.post_feedforward_layernorm.output hf	16384
layer_29_width_262k_l0_big Load this SAE	blocks.29.hook_mlp_out tlmodel.layers.29.post_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_small Load this SAE	blocks.29.hook_mlp_out tlmodel.layers.29.post_feedforward_layernorm.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf	262144
layer_30_width_16k_l0_big Load this SAE	blocks.30.hook_mlp_out tlmodel.layers.30.post_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_small Load this SAE	blocks.30.hook_mlp_out tlmodel.layers.30.post_feedforward_layernorm.output hf	16384
layer_30_width_262k_l0_big Load this SAE	blocks.30.hook_mlp_out tlmodel.layers.30.post_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_small Load this SAE	blocks.30.hook_mlp_out tlmodel.layers.30.post_feedforward_layernorm.output hf	262144
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_mlp_out tlmodel.layers.31.post_feedforward_layernorm.output hf	262144
layer_32_width_16k_l0_big Load this SAE	blocks.32.hook_mlp_out tlmodel.layers.32.post_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_small Load this SAE	blocks.32.hook_mlp_out tlmodel.layers.32.post_feedforward_layernorm.output hf	16384
layer_32_width_262k_l0_big Load this SAE	blocks.32.hook_mlp_out tlmodel.layers.32.post_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_small Load this SAE	blocks.32.hook_mlp_out tlmodel.layers.32.post_feedforward_layernorm.output hf	262144
layer_33_width_16k_l0_big Load this SAE	blocks.33.hook_mlp_out tlmodel.layers.33.post_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_small Load this SAE	blocks.33.hook_mlp_out tlmodel.layers.33.post_feedforward_layernorm.output hf	16384
layer_33_width_262k_l0_big Load this SAE	blocks.33.hook_mlp_out tlmodel.layers.33.post_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_small Load this SAE	blocks.33.hook_mlp_out tlmodel.layers.33.post_feedforward_layernorm.output hf	262144
layer_34_width_16k_l0_big Load this SAE	blocks.34.hook_mlp_out tlmodel.layers.34.post_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_small Load this SAE	blocks.34.hook_mlp_out tlmodel.layers.34.post_feedforward_layernorm.output hf	16384
layer_34_width_262k_l0_big Load this SAE	blocks.34.hook_mlp_out tlmodel.layers.34.post_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_small Load this SAE	blocks.34.hook_mlp_out tlmodel.layers.34.post_feedforward_layernorm.output hf	262144
layer_35_width_16k_l0_big Load this SAE	blocks.35.hook_mlp_out tlmodel.layers.35.post_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_small Load this SAE	blocks.35.hook_mlp_out tlmodel.layers.35.post_feedforward_layernorm.output hf	16384
layer_35_width_262k_l0_big Load this SAE	blocks.35.hook_mlp_out tlmodel.layers.35.post_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_small Load this SAE	blocks.35.hook_mlp_out tlmodel.layers.35.post_feedforward_layernorm.output hf	262144
layer_36_width_16k_l0_big Load this SAE	blocks.36.hook_mlp_out tlmodel.layers.36.post_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_small Load this SAE	blocks.36.hook_mlp_out tlmodel.layers.36.post_feedforward_layernorm.output hf	16384
layer_36_width_262k_l0_big Load this SAE	blocks.36.hook_mlp_out tlmodel.layers.36.post_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_small Load this SAE	blocks.36.hook_mlp_out tlmodel.layers.36.post_feedforward_layernorm.output hf	262144
layer_37_width_16k_l0_big Load this SAE	blocks.37.hook_mlp_out tlmodel.layers.37.post_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_small Load this SAE	blocks.37.hook_mlp_out tlmodel.layers.37.post_feedforward_layernorm.output hf	16384
layer_37_width_262k_l0_big Load this SAE	blocks.37.hook_mlp_out tlmodel.layers.37.post_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_small Load this SAE	blocks.37.hook_mlp_out tlmodel.layers.37.post_feedforward_layernorm.output hf	262144
layer_38_width_16k_l0_big Load this SAE	blocks.38.hook_mlp_out tlmodel.layers.38.post_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_small Load this SAE	blocks.38.hook_mlp_out tlmodel.layers.38.post_feedforward_layernorm.output hf	16384
layer_38_width_262k_l0_big Load this SAE	blocks.38.hook_mlp_out tlmodel.layers.38.post_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_small Load this SAE	blocks.38.hook_mlp_out tlmodel.layers.38.post_feedforward_layernorm.output hf	262144
layer_39_width_16k_l0_big Load this SAE	blocks.39.hook_mlp_out tlmodel.layers.39.post_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_small Load this SAE	blocks.39.hook_mlp_out tlmodel.layers.39.post_feedforward_layernorm.output hf	16384
layer_39_width_262k_l0_big Load this SAE	blocks.39.hook_mlp_out tlmodel.layers.39.post_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_small Load this SAE	blocks.39.hook_mlp_out tlmodel.layers.39.post_feedforward_layernorm.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf	262144
layer_40_width_16k_l0_big Load this SAE	blocks.40.hook_mlp_out tlmodel.layers.40.post_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.hook_mlp_out tlmodel.layers.40.post_feedforward_layernorm.output hf	16384
layer_40_width_262k_l0_big Load this SAE	blocks.40.hook_mlp_out tlmodel.layers.40.post_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.hook_mlp_out tlmodel.layers.40.post_feedforward_layernorm.output hf	262144
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_mlp_out tlmodel.layers.41.post_feedforward_layernorm.output hf	262144
layer_42_width_16k_l0_big Load this SAE	blocks.42.hook_mlp_out tlmodel.layers.42.post_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_small Load this SAE	blocks.42.hook_mlp_out tlmodel.layers.42.post_feedforward_layernorm.output hf	16384
layer_42_width_262k_l0_big Load this SAE	blocks.42.hook_mlp_out tlmodel.layers.42.post_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_small Load this SAE	blocks.42.hook_mlp_out tlmodel.layers.42.post_feedforward_layernorm.output hf	262144
layer_43_width_16k_l0_big Load this SAE	blocks.43.hook_mlp_out tlmodel.layers.43.post_feedforward_layernorm.output hf	16384
layer_43_width_16k_l0_small Load this SAE	blocks.43.hook_mlp_out tlmodel.layers.43.post_feedforward_layernorm.output hf	16384
layer_43_width_262k_l0_big Load this SAE	blocks.43.hook_mlp_out tlmodel.layers.43.post_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_small Load this SAE	blocks.43.hook_mlp_out tlmodel.layers.43.post_feedforward_layernorm.output hf	262144
layer_44_width_16k_l0_big Load this SAE	blocks.44.hook_mlp_out tlmodel.layers.44.post_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_small Load this SAE	blocks.44.hook_mlp_out tlmodel.layers.44.post_feedforward_layernorm.output hf	16384
layer_44_width_262k_l0_big Load this SAE	blocks.44.hook_mlp_out tlmodel.layers.44.post_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_small Load this SAE	blocks.44.hook_mlp_out tlmodel.layers.44.post_feedforward_layernorm.output hf	262144
layer_45_width_16k_l0_big Load this SAE	blocks.45.hook_mlp_out tlmodel.layers.45.post_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_small Load this SAE	blocks.45.hook_mlp_out tlmodel.layers.45.post_feedforward_layernorm.output hf	16384
layer_45_width_262k_l0_big Load this SAE	blocks.45.hook_mlp_out tlmodel.layers.45.post_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_small Load this SAE	blocks.45.hook_mlp_out tlmodel.layers.45.post_feedforward_layernorm.output hf	262144
layer_46_width_16k_l0_big Load this SAE	blocks.46.hook_mlp_out tlmodel.layers.46.post_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_small Load this SAE	blocks.46.hook_mlp_out tlmodel.layers.46.post_feedforward_layernorm.output hf	16384
layer_46_width_262k_l0_big Load this SAE	blocks.46.hook_mlp_out tlmodel.layers.46.post_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_small Load this SAE	blocks.46.hook_mlp_out tlmodel.layers.46.post_feedforward_layernorm.output hf	262144
layer_47_width_16k_l0_big Load this SAE	blocks.47.hook_mlp_out tlmodel.layers.47.post_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_small Load this SAE	blocks.47.hook_mlp_out tlmodel.layers.47.post_feedforward_layernorm.output hf	16384
layer_47_width_262k_l0_big Load this SAE	blocks.47.hook_mlp_out tlmodel.layers.47.post_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_small Load this SAE	blocks.47.hook_mlp_out tlmodel.layers.47.post_feedforward_layernorm.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf	262144

gemma-scope-2-12b-pt-res

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_16k_l0_medium Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_1m_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	1048576
layer_12_width_1m_l0_medium Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	1048576
layer_12_width_1m_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	1048576
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_262k_l0_medium Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_262k_l0_medium_seed_1 Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_65k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	65536
layer_12_width_65k_l0_medium Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	65536
layer_12_width_65k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	65536
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_16k_l0_medium Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_1m_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	1048576
layer_24_width_1m_l0_medium Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	1048576
layer_24_width_1m_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	1048576
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_262k_l0_medium Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_262k_l0_medium_seed_1 Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_65k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	65536
layer_24_width_65k_l0_medium Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	65536
layer_24_width_65k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	65536
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_16k_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_1m_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	1048576
layer_31_width_1m_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	1048576
layer_31_width_1m_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	1048576
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_medium_seed_1 Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_65k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	65536
layer_31_width_65k_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	65536
layer_31_width_65k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	65536
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_16k_l0_medium Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_1m_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	1048576
layer_41_width_1m_l0_medium Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	1048576
layer_41_width_1m_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	1048576
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_41_width_262k_l0_medium Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_41_width_262k_l0_medium_seed_1 Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_41_width_65k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	65536
layer_41_width_65k_l0_medium Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	65536
layer_41_width_65k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	65536

gemma-scope-2-12b-pt-res-all

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	262144
layer_26_width_16k_l0_big Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	16384
layer_26_width_16k_l0_small Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	16384
layer_26_width_262k_l0_big Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	262144
layer_26_width_262k_l0_small Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	262144
layer_27_width_16k_l0_big Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	16384
layer_27_width_16k_l0_small Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	16384
layer_27_width_262k_l0_big Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	262144
layer_27_width_262k_l0_small Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	262144
layer_28_width_16k_l0_big Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	16384
layer_28_width_16k_l0_small Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	16384
layer_28_width_262k_l0_big Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	262144
layer_28_width_262k_l0_small Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	262144
layer_29_width_16k_l0_big Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	16384
layer_29_width_16k_l0_small Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	16384
layer_29_width_262k_l0_big Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	262144
layer_29_width_262k_l0_small Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	262144
layer_30_width_16k_l0_big Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	16384
layer_30_width_16k_l0_small Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	16384
layer_30_width_262k_l0_big Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	262144
layer_30_width_262k_l0_small Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	262144
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_32_width_16k_l0_big Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	16384
layer_32_width_16k_l0_small Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	16384
layer_32_width_262k_l0_big Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	262144
layer_32_width_262k_l0_small Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	262144
layer_33_width_16k_l0_big Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	16384
layer_33_width_16k_l0_small Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	16384
layer_33_width_262k_l0_big Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	262144
layer_33_width_262k_l0_small Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	262144
layer_34_width_16k_l0_big Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	16384
layer_34_width_16k_l0_small Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	16384
layer_34_width_262k_l0_big Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	262144
layer_34_width_262k_l0_small Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	262144
layer_35_width_16k_l0_big Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	16384
layer_35_width_16k_l0_small Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	16384
layer_35_width_262k_l0_big Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	262144
layer_35_width_262k_l0_small Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	262144
layer_36_width_16k_l0_big Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	16384
layer_36_width_16k_l0_small Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	16384
layer_36_width_262k_l0_big Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	262144
layer_36_width_262k_l0_small Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	262144
layer_37_width_16k_l0_big Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	16384
layer_37_width_16k_l0_small Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	16384
layer_37_width_262k_l0_big Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	262144
layer_37_width_262k_l0_small Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	262144
layer_38_width_16k_l0_big Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	16384
layer_38_width_16k_l0_small Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	16384
layer_38_width_262k_l0_big Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	262144
layer_38_width_262k_l0_small Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	262144
layer_39_width_16k_l0_big Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	16384
layer_39_width_16k_l0_small Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	16384
layer_39_width_262k_l0_big Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	262144
layer_39_width_262k_l0_small Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	262144
layer_40_width_16k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_262k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_42_width_16k_l0_big Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	16384
layer_42_width_16k_l0_small Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	16384
layer_42_width_262k_l0_big Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	262144
layer_42_width_262k_l0_small Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	262144
layer_43_width_16k_l0_big Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	16384
layer_43_width_16k_l0_small Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	16384
layer_43_width_262k_l0_big Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	262144
layer_43_width_262k_l0_small Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	262144
layer_44_width_16k_l0_big Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	16384
layer_44_width_16k_l0_small Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	16384
layer_44_width_262k_l0_big Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	262144
layer_44_width_262k_l0_small Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	262144
layer_45_width_16k_l0_big Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	16384
layer_45_width_16k_l0_small Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	16384
layer_45_width_262k_l0_big Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	262144
layer_45_width_262k_l0_small Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	262144
layer_46_width_16k_l0_big Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	16384
layer_46_width_16k_l0_small Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	16384
layer_46_width_262k_l0_big Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	262144
layer_46_width_262k_l0_small Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	262144
layer_47_width_16k_l0_big Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	16384
layer_47_width_16k_l0_small Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	16384
layer_47_width_262k_l0_big Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	262144
layer_47_width_262k_l0_small Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	262144

gemma-scope-2-12b-pt-transcoders

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
transcoder/layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
transcoder/layer_12_width_16k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
transcoder/layer_12_width_16k_l0_medium Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
transcoder/layer_12_width_16k_l0_medium_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
transcoder/layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
transcoder/layer_12_width_16k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
transcoder/layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
transcoder/layer_12_width_262k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
transcoder/layer_12_width_262k_l0_medium Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
transcoder/layer_12_width_262k_l0_medium_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
transcoder/layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
transcoder/layer_12_width_262k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
transcoder/layer_12_width_65k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	65536
transcoder/layer_12_width_65k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	65536
transcoder/layer_12_width_65k_l0_medium Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	65536
transcoder/layer_12_width_65k_l0_medium_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	65536
transcoder/layer_12_width_65k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	65536
transcoder/layer_12_width_65k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	65536
transcoder/layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
transcoder/layer_24_width_16k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
transcoder/layer_24_width_16k_l0_medium Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
transcoder/layer_24_width_16k_l0_medium_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
transcoder/layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
transcoder/layer_24_width_16k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
transcoder/layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
transcoder/layer_24_width_262k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
transcoder/layer_24_width_262k_l0_medium Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
transcoder/layer_24_width_262k_l0_medium_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
transcoder/layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
transcoder/layer_24_width_262k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
transcoder/layer_24_width_65k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	65536
transcoder/layer_24_width_65k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	65536
transcoder/layer_24_width_65k_l0_medium Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	65536
transcoder/layer_24_width_65k_l0_medium_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	65536
transcoder/layer_24_width_65k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	65536
transcoder/layer_24_width_65k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	65536
transcoder/layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
transcoder/layer_31_width_16k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
transcoder/layer_31_width_16k_l0_medium Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
transcoder/layer_31_width_16k_l0_medium_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
transcoder/layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
transcoder/layer_31_width_16k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
transcoder/layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
transcoder/layer_31_width_262k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
transcoder/layer_31_width_262k_l0_medium Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
transcoder/layer_31_width_262k_l0_medium_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
transcoder/layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
transcoder/layer_31_width_262k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
transcoder/layer_31_width_65k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	65536
transcoder/layer_31_width_65k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	65536
transcoder/layer_31_width_65k_l0_medium Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	65536
transcoder/layer_31_width_65k_l0_medium_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	65536
transcoder/layer_31_width_65k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	65536
transcoder/layer_31_width_65k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	65536
transcoder/layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
transcoder/layer_41_width_16k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
transcoder/layer_41_width_16k_l0_medium Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
transcoder/layer_41_width_16k_l0_medium_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
transcoder/layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
transcoder/layer_41_width_16k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
transcoder/layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
transcoder/layer_41_width_262k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
transcoder/layer_41_width_262k_l0_medium Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
transcoder/layer_41_width_262k_l0_medium_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
transcoder/layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
transcoder/layer_41_width_262k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
transcoder/layer_41_width_65k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	65536
transcoder/layer_41_width_65k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	65536
transcoder/layer_41_width_65k_l0_medium Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	65536
transcoder/layer_41_width_65k_l0_medium_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	65536
transcoder/layer_41_width_65k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	65536
transcoder/layer_41_width_65k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	65536

gemma-scope-2-12b-pt-transcoders-all

• Huggingface Repo: google/gemma-scope-2-12b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_big_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_big_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_big_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_big_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_big_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_big_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_big_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_big_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_big_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_big_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_big_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_big_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_big_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_big_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_big_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_big_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_big_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_big_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_big_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_big_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_big_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_big_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_big_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_big_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_big_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_big_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_26_width_16k_l0_big Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_big_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_small Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_small_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_262k_l0_big Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_big_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_small Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_small_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_27_width_16k_l0_big Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_big_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_small Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_small_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_262k_l0_big Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_big_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_small Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_small_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_28_width_16k_l0_big Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_big_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_small Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_small_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_262k_l0_big Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_big_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_small Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_small_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_29_width_16k_l0_big Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_big_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_small Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_small_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_262k_l0_big Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_big_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_small Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_small_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_big_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_big_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_30_width_16k_l0_big Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_big_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_small Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_small_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_262k_l0_big Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_big_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_small Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_small_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_32_width_16k_l0_big Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_big_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_small Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_small_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_262k_l0_big Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_big_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_small Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_small_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_33_width_16k_l0_big Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_big_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_small Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_small_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_262k_l0_big Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_big_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_small Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_small_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_34_width_16k_l0_big Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_big_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_small Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_small_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_262k_l0_big Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_big_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_small Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_small_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_35_width_16k_l0_big Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_big_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_small Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_small_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_262k_l0_big Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_big_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_small Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_small_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_36_width_16k_l0_big Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_big_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_small Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_small_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_262k_l0_big Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_big_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_small Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_small_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_37_width_16k_l0_big Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_big_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_small Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_small_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_262k_l0_big Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_big_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_small Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_small_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_38_width_16k_l0_big Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_big_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_small Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_small_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_262k_l0_big Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_big_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_small Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_small_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_39_width_16k_l0_big Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_big_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_small Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_small_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_262k_l0_big Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_big_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_small Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_small_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_big_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_big_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_40_width_16k_l0_big Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_big_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_small_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_262k_l0_big Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_big_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_small_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_42_width_16k_l0_big Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_big_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_small Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_small_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_262k_l0_big Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_big_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_small Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_small_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_43_width_16k_l0_big Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	16384
layer_43_width_16k_l0_big_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	16384
layer_43_width_16k_l0_small Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	16384
layer_43_width_16k_l0_small_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	16384
layer_43_width_262k_l0_big Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_big_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_small Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_small_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_44_width_16k_l0_big Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_big_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_small Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_small_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_262k_l0_big Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_big_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_small Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_small_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_45_width_16k_l0_big Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_big_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_small Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_small_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_262k_l0_big Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_big_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_small Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_small_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_46_width_16k_l0_big Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_big_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_small Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_small_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_262k_l0_big Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_big_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_small Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_small_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_47_width_16k_l0_big Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_big_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_small Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_small_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_262k_l0_big Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_big_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_small Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_small_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_big_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_big_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_big_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_big_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_big_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_big_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_big_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_big_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_big_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_big_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144

×

Copy Code