gemma-3-27b-pt

This page lists all pretrained SAEs available for gemma-3-27b-pt.

gemma-scope-2-27b-pt-res

• Huggingface Repo: google/gemma-scope-2-27b-pt

id	hook_name	d_sae
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_16k_l0_medium Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_1m_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	1048576
layer_16_width_1m_l0_medium Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	1048576
layer_16_width_1m_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	1048576
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_262k_l0_medium Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_262k_l0_medium_seed_1 Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_65k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	65536
layer_16_width_65k_l0_medium Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	65536
layer_16_width_65k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	65536
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_16k_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_1m_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	1048576
layer_31_width_1m_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	1048576
layer_31_width_1m_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	1048576
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_medium_seed_1 Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_65k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	65536
layer_31_width_65k_l0_medium Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	65536
layer_31_width_65k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	65536
layer_40_width_16k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_16k_l0_medium Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_1m_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	1048576
layer_40_width_1m_l0_medium Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	1048576
layer_40_width_1m_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	1048576
layer_40_width_262k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_40_width_262k_l0_medium Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_40_width_262k_l0_medium_seed_1 Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_40_width_65k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	65536
layer_40_width_65k_l0_medium Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	65536
layer_40_width_65k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	65536
layer_53_width_16k_l0_big Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	16384
layer_53_width_16k_l0_medium Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	16384
layer_53_width_16k_l0_small Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	16384
layer_53_width_1m_l0_big Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	1048576
layer_53_width_1m_l0_medium Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	1048576
layer_53_width_1m_l0_small Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	1048576
layer_53_width_262k_l0_big Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	262144
layer_53_width_262k_l0_medium Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	262144
layer_53_width_262k_l0_medium_seed_1 Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	262144
layer_53_width_262k_l0_small Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	262144
layer_53_width_65k_l0_big Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	65536
layer_53_width_65k_l0_medium Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	65536
layer_53_width_65k_l0_small Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	65536

gemma-scope-2-27b-pt-res-all

• Huggingface Repo: google/gemma-scope-2-27b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_resid_post tlmodel.layers.0.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_resid_post tlmodel.layers.10.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_resid_post tlmodel.layers.11.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_resid_post tlmodel.layers.12.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_resid_post tlmodel.layers.13.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_resid_post tlmodel.layers.14.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_resid_post tlmodel.layers.15.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_resid_post tlmodel.layers.16.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_resid_post tlmodel.layers.17.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_resid_post tlmodel.layers.18.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_resid_post tlmodel.layers.19.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_resid_post tlmodel.layers.1.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_resid_post tlmodel.layers.20.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_resid_post tlmodel.layers.21.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_resid_post tlmodel.layers.22.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_resid_post tlmodel.layers.23.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_resid_post tlmodel.layers.24.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_resid_post tlmodel.layers.25.output hf	262144
layer_26_width_16k_l0_big Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	16384
layer_26_width_16k_l0_small Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	16384
layer_26_width_262k_l0_big Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	262144
layer_26_width_262k_l0_small Load this SAE	blocks.26.hook_resid_post tlmodel.layers.26.output hf	262144
layer_27_width_16k_l0_big Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	16384
layer_27_width_16k_l0_small Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	16384
layer_27_width_262k_l0_big Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	262144
layer_27_width_262k_l0_small Load this SAE	blocks.27.hook_resid_post tlmodel.layers.27.output hf	262144
layer_28_width_16k_l0_big Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	16384
layer_28_width_16k_l0_small Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	16384
layer_28_width_262k_l0_big Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	262144
layer_28_width_262k_l0_small Load this SAE	blocks.28.hook_resid_post tlmodel.layers.28.output hf	262144
layer_29_width_16k_l0_big Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	16384
layer_29_width_16k_l0_small Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	16384
layer_29_width_262k_l0_big Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	262144
layer_29_width_262k_l0_small Load this SAE	blocks.29.hook_resid_post tlmodel.layers.29.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_resid_post tlmodel.layers.2.output hf	262144
layer_30_width_16k_l0_big Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	16384
layer_30_width_16k_l0_small Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	16384
layer_30_width_262k_l0_big Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	262144
layer_30_width_262k_l0_small Load this SAE	blocks.30.hook_resid_post tlmodel.layers.30.output hf	262144
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_resid_post tlmodel.layers.31.output hf	262144
layer_32_width_16k_l0_big Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	16384
layer_32_width_16k_l0_small Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	16384
layer_32_width_262k_l0_big Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	262144
layer_32_width_262k_l0_small Load this SAE	blocks.32.hook_resid_post tlmodel.layers.32.output hf	262144
layer_33_width_16k_l0_big Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	16384
layer_33_width_16k_l0_small Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	16384
layer_33_width_262k_l0_big Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	262144
layer_33_width_262k_l0_small Load this SAE	blocks.33.hook_resid_post tlmodel.layers.33.output hf	262144
layer_34_width_16k_l0_big Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	16384
layer_34_width_16k_l0_small Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	16384
layer_34_width_262k_l0_big Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	262144
layer_34_width_262k_l0_small Load this SAE	blocks.34.hook_resid_post tlmodel.layers.34.output hf	262144
layer_35_width_16k_l0_big Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	16384
layer_35_width_16k_l0_small Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	16384
layer_35_width_262k_l0_big Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	262144
layer_35_width_262k_l0_small Load this SAE	blocks.35.hook_resid_post tlmodel.layers.35.output hf	262144
layer_36_width_16k_l0_big Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	16384
layer_36_width_16k_l0_small Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	16384
layer_36_width_262k_l0_big Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	262144
layer_36_width_262k_l0_small Load this SAE	blocks.36.hook_resid_post tlmodel.layers.36.output hf	262144
layer_37_width_16k_l0_big Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	16384
layer_37_width_16k_l0_small Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	16384
layer_37_width_262k_l0_big Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	262144
layer_37_width_262k_l0_small Load this SAE	blocks.37.hook_resid_post tlmodel.layers.37.output hf	262144
layer_38_width_16k_l0_big Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	16384
layer_38_width_16k_l0_small Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	16384
layer_38_width_262k_l0_big Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	262144
layer_38_width_262k_l0_small Load this SAE	blocks.38.hook_resid_post tlmodel.layers.38.output hf	262144
layer_39_width_16k_l0_big Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	16384
layer_39_width_16k_l0_small Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	16384
layer_39_width_262k_l0_big Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	262144
layer_39_width_262k_l0_small Load this SAE	blocks.39.hook_resid_post tlmodel.layers.39.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_resid_post tlmodel.layers.3.output hf	262144
layer_40_width_16k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	16384
layer_40_width_262k_l0_big Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.hook_resid_post tlmodel.layers.40.output hf	262144
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_resid_post tlmodel.layers.41.output hf	262144
layer_42_width_16k_l0_big Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	16384
layer_42_width_16k_l0_small Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	16384
layer_42_width_262k_l0_big Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	262144
layer_42_width_262k_l0_small Load this SAE	blocks.42.hook_resid_post tlmodel.layers.42.output hf	262144
layer_43_width_16k_l0_big Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	16384
layer_43_width_16k_l0_small Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	16384
layer_43_width_262k_l0_big Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	262144
layer_43_width_262k_l0_small Load this SAE	blocks.43.hook_resid_post tlmodel.layers.43.output hf	262144
layer_44_width_16k_l0_big Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	16384
layer_44_width_16k_l0_small Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	16384
layer_44_width_262k_l0_big Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	262144
layer_44_width_262k_l0_small Load this SAE	blocks.44.hook_resid_post tlmodel.layers.44.output hf	262144
layer_45_width_16k_l0_big Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	16384
layer_45_width_16k_l0_small Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	16384
layer_45_width_262k_l0_big Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	262144
layer_45_width_262k_l0_small Load this SAE	blocks.45.hook_resid_post tlmodel.layers.45.output hf	262144
layer_46_width_16k_l0_big Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	16384
layer_46_width_16k_l0_small Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	16384
layer_46_width_262k_l0_big Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	262144
layer_46_width_262k_l0_small Load this SAE	blocks.46.hook_resid_post tlmodel.layers.46.output hf	262144
layer_47_width_16k_l0_big Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	16384
layer_47_width_16k_l0_small Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	16384
layer_47_width_262k_l0_big Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	262144
layer_47_width_262k_l0_small Load this SAE	blocks.47.hook_resid_post tlmodel.layers.47.output hf	262144
layer_48_width_16k_l0_big Load this SAE	blocks.48.hook_resid_post tlmodel.layers.48.output hf	16384
layer_48_width_16k_l0_small Load this SAE	blocks.48.hook_resid_post tlmodel.layers.48.output hf	16384
layer_48_width_262k_l0_big Load this SAE	blocks.48.hook_resid_post tlmodel.layers.48.output hf	262144
layer_48_width_262k_l0_small Load this SAE	blocks.48.hook_resid_post tlmodel.layers.48.output hf	262144
layer_49_width_16k_l0_big Load this SAE	blocks.49.hook_resid_post tlmodel.layers.49.output hf	16384
layer_49_width_16k_l0_small Load this SAE	blocks.49.hook_resid_post tlmodel.layers.49.output hf	16384
layer_49_width_262k_l0_big Load this SAE	blocks.49.hook_resid_post tlmodel.layers.49.output hf	262144
layer_49_width_262k_l0_small Load this SAE	blocks.49.hook_resid_post tlmodel.layers.49.output hf	262144
layer_4_width_16k_l0_big Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	16384
layer_4_width_16k_l0_small Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_resid_post tlmodel.layers.4.output hf	262144
layer_50_width_16k_l0_big Load this SAE	blocks.50.hook_resid_post tlmodel.layers.50.output hf	16384
layer_50_width_16k_l0_small Load this SAE	blocks.50.hook_resid_post tlmodel.layers.50.output hf	16384
layer_50_width_262k_l0_big Load this SAE	blocks.50.hook_resid_post tlmodel.layers.50.output hf	262144
layer_50_width_262k_l0_small Load this SAE	blocks.50.hook_resid_post tlmodel.layers.50.output hf	262144
layer_51_width_16k_l0_big Load this SAE	blocks.51.hook_resid_post tlmodel.layers.51.output hf	16384
layer_51_width_16k_l0_small Load this SAE	blocks.51.hook_resid_post tlmodel.layers.51.output hf	16384
layer_51_width_262k_l0_big Load this SAE	blocks.51.hook_resid_post tlmodel.layers.51.output hf	262144
layer_51_width_262k_l0_small Load this SAE	blocks.51.hook_resid_post tlmodel.layers.51.output hf	262144
layer_52_width_16k_l0_big Load this SAE	blocks.52.hook_resid_post tlmodel.layers.52.output hf	16384
layer_52_width_16k_l0_small Load this SAE	blocks.52.hook_resid_post tlmodel.layers.52.output hf	16384
layer_52_width_262k_l0_big Load this SAE	blocks.52.hook_resid_post tlmodel.layers.52.output hf	262144
layer_52_width_262k_l0_small Load this SAE	blocks.52.hook_resid_post tlmodel.layers.52.output hf	262144
layer_53_width_16k_l0_big Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	16384
layer_53_width_16k_l0_small Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	16384
layer_53_width_262k_l0_big Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	262144
layer_53_width_262k_l0_small Load this SAE	blocks.53.hook_resid_post tlmodel.layers.53.output hf	262144
layer_54_width_16k_l0_big Load this SAE	blocks.54.hook_resid_post tlmodel.layers.54.output hf	16384
layer_54_width_16k_l0_small Load this SAE	blocks.54.hook_resid_post tlmodel.layers.54.output hf	16384
layer_54_width_262k_l0_big Load this SAE	blocks.54.hook_resid_post tlmodel.layers.54.output hf	262144
layer_54_width_262k_l0_small Load this SAE	blocks.54.hook_resid_post tlmodel.layers.54.output hf	262144
layer_55_width_16k_l0_big Load this SAE	blocks.55.hook_resid_post tlmodel.layers.55.output hf	16384
layer_55_width_16k_l0_small Load this SAE	blocks.55.hook_resid_post tlmodel.layers.55.output hf	16384
layer_55_width_262k_l0_big Load this SAE	blocks.55.hook_resid_post tlmodel.layers.55.output hf	262144
layer_55_width_262k_l0_small Load this SAE	blocks.55.hook_resid_post tlmodel.layers.55.output hf	262144
layer_56_width_16k_l0_big Load this SAE	blocks.56.hook_resid_post tlmodel.layers.56.output hf	16384
layer_56_width_16k_l0_small Load this SAE	blocks.56.hook_resid_post tlmodel.layers.56.output hf	16384
layer_56_width_262k_l0_big Load this SAE	blocks.56.hook_resid_post tlmodel.layers.56.output hf	262144
layer_56_width_262k_l0_small Load this SAE	blocks.56.hook_resid_post tlmodel.layers.56.output hf	262144
layer_57_width_16k_l0_big Load this SAE	blocks.57.hook_resid_post tlmodel.layers.57.output hf	16384
layer_57_width_16k_l0_small Load this SAE	blocks.57.hook_resid_post tlmodel.layers.57.output hf	16384
layer_57_width_262k_l0_big Load this SAE	blocks.57.hook_resid_post tlmodel.layers.57.output hf	262144
layer_57_width_262k_l0_small Load this SAE	blocks.57.hook_resid_post tlmodel.layers.57.output hf	262144
layer_58_width_16k_l0_big Load this SAE	blocks.58.hook_resid_post tlmodel.layers.58.output hf	16384
layer_58_width_16k_l0_small Load this SAE	blocks.58.hook_resid_post tlmodel.layers.58.output hf	16384
layer_58_width_262k_l0_big Load this SAE	blocks.58.hook_resid_post tlmodel.layers.58.output hf	262144
layer_58_width_262k_l0_small Load this SAE	blocks.58.hook_resid_post tlmodel.layers.58.output hf	262144
layer_59_width_16k_l0_big Load this SAE	blocks.59.hook_resid_post tlmodel.layers.59.output hf	16384
layer_59_width_16k_l0_small Load this SAE	blocks.59.hook_resid_post tlmodel.layers.59.output hf	16384
layer_59_width_262k_l0_big Load this SAE	blocks.59.hook_resid_post tlmodel.layers.59.output hf	262144
layer_59_width_262k_l0_small Load this SAE	blocks.59.hook_resid_post tlmodel.layers.59.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	16384
layer_5_width_16k_l0_small Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_resid_post tlmodel.layers.5.output hf	262144
layer_60_width_16k_l0_big Load this SAE	blocks.60.hook_resid_post tlmodel.layers.60.output hf	16384
layer_60_width_16k_l0_small Load this SAE	blocks.60.hook_resid_post tlmodel.layers.60.output hf	16384
layer_60_width_262k_l0_big Load this SAE	blocks.60.hook_resid_post tlmodel.layers.60.output hf	262144
layer_60_width_262k_l0_small Load this SAE	blocks.60.hook_resid_post tlmodel.layers.60.output hf	262144
layer_61_width_16k_l0_big Load this SAE	blocks.61.hook_resid_post tlmodel.layers.61.output hf	16384
layer_61_width_16k_l0_small Load this SAE	blocks.61.hook_resid_post tlmodel.layers.61.output hf	16384
layer_61_width_262k_l0_big Load this SAE	blocks.61.hook_resid_post tlmodel.layers.61.output hf	262144
layer_61_width_262k_l0_small Load this SAE	blocks.61.hook_resid_post tlmodel.layers.61.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_resid_post tlmodel.layers.6.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_resid_post tlmodel.layers.7.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_resid_post tlmodel.layers.8.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_resid_post tlmodel.layers.9.output hf	262144

gemma-scope-2-27b-pt-transcoders-all

• Huggingface Repo: google/gemma-scope-2-27b-pt

id	hook_name	d_sae
layer_0_width_16k_l0_big Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_big_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_16k_l0_small_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	16384
layer_0_width_262k_l0_big Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_big_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_0_width_262k_l0_small_affine Load this SAE	blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf	262144
layer_10_width_16k_l0_big Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_big_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_16k_l0_small_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	16384
layer_10_width_262k_l0_big Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_big_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_10_width_262k_l0_small_affine Load this SAE	blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf	262144
layer_11_width_16k_l0_big Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_big_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_16k_l0_small_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	16384
layer_11_width_262k_l0_big Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_big_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_11_width_262k_l0_small_affine Load this SAE	blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf	262144
layer_12_width_16k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_16k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	16384
layer_12_width_262k_l0_big Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_big_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_12_width_262k_l0_small_affine Load this SAE	blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf	262144
layer_13_width_16k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_16k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	16384
layer_13_width_262k_l0_big Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_big_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_13_width_262k_l0_small_affine Load this SAE	blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf	262144
layer_14_width_16k_l0_big Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_big_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_16k_l0_small_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	16384
layer_14_width_262k_l0_big Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_big_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_14_width_262k_l0_small_affine Load this SAE	blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf	262144
layer_15_width_16k_l0_big Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_big_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_16k_l0_small_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	16384
layer_15_width_262k_l0_big Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_big_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_15_width_262k_l0_small_affine Load this SAE	blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf	262144
layer_16_width_16k_l0_big Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_big_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_16k_l0_small_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	16384
layer_16_width_262k_l0_big Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_big_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_16_width_262k_l0_small_affine Load this SAE	blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf	262144
layer_17_width_16k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_16k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	16384
layer_17_width_262k_l0_big Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_big_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_17_width_262k_l0_small_affine Load this SAE	blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf	262144
layer_18_width_16k_l0_big Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_big_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_16k_l0_small_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	16384
layer_18_width_262k_l0_big Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_big_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_18_width_262k_l0_small_affine Load this SAE	blocks.18.hook_mlp_in tlmodel.layers.18.pre_feedforward_layernorm.output hf	262144
layer_19_width_16k_l0_big Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_big_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_16k_l0_small_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	16384
layer_19_width_262k_l0_big Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_big_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_19_width_262k_l0_small_affine Load this SAE	blocks.19.hook_mlp_in tlmodel.layers.19.pre_feedforward_layernorm.output hf	262144
layer_1_width_16k_l0_big Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_big_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_16k_l0_small_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	16384
layer_1_width_262k_l0_big Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_big_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_1_width_262k_l0_small_affine Load this SAE	blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf	262144
layer_20_width_16k_l0_big Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_big_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_16k_l0_small_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	16384
layer_20_width_262k_l0_big Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_big_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_20_width_262k_l0_small_affine Load this SAE	blocks.20.hook_mlp_in tlmodel.layers.20.pre_feedforward_layernorm.output hf	262144
layer_21_width_16k_l0_big Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_big_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_16k_l0_small_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	16384
layer_21_width_262k_l0_big Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_big_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_21_width_262k_l0_small_affine Load this SAE	blocks.21.hook_mlp_in tlmodel.layers.21.pre_feedforward_layernorm.output hf	262144
layer_22_width_16k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_16k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	16384
layer_22_width_262k_l0_big Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_big_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_22_width_262k_l0_small_affine Load this SAE	blocks.22.hook_mlp_in tlmodel.layers.22.pre_feedforward_layernorm.output hf	262144
layer_23_width_16k_l0_big Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_big_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_16k_l0_small_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	16384
layer_23_width_262k_l0_big Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_big_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_23_width_262k_l0_small_affine Load this SAE	blocks.23.hook_mlp_in tlmodel.layers.23.pre_feedforward_layernorm.output hf	262144
layer_24_width_16k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_16k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	16384
layer_24_width_262k_l0_big Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_big_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_24_width_262k_l0_small_affine Load this SAE	blocks.24.hook_mlp_in tlmodel.layers.24.pre_feedforward_layernorm.output hf	262144
layer_25_width_16k_l0_big Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_big_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_16k_l0_small_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	16384
layer_25_width_262k_l0_big Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_big_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_25_width_262k_l0_small_affine Load this SAE	blocks.25.hook_mlp_in tlmodel.layers.25.pre_feedforward_layernorm.output hf	262144
layer_26_width_16k_l0_big Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_big_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_small Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_16k_l0_small_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	16384
layer_26_width_262k_l0_big Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_big_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_small Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_26_width_262k_l0_small_affine Load this SAE	blocks.26.hook_mlp_in tlmodel.layers.26.pre_feedforward_layernorm.output hf	262144
layer_27_width_16k_l0_big Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_big_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_small Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_16k_l0_small_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	16384
layer_27_width_262k_l0_big Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_big_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_small Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_27_width_262k_l0_small_affine Load this SAE	blocks.27.hook_mlp_in tlmodel.layers.27.pre_feedforward_layernorm.output hf	262144
layer_28_width_16k_l0_big Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_big_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_small Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_16k_l0_small_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	16384
layer_28_width_262k_l0_big Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_big_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_small Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_28_width_262k_l0_small_affine Load this SAE	blocks.28.hook_mlp_in tlmodel.layers.28.pre_feedforward_layernorm.output hf	262144
layer_29_width_16k_l0_big Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_big_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_small Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_16k_l0_small_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	16384
layer_29_width_262k_l0_big Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_big_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_small Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_29_width_262k_l0_small_affine Load this SAE	blocks.29.hook_mlp_in tlmodel.layers.29.pre_feedforward_layernorm.output hf	262144
layer_2_width_16k_l0_big Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_big_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_16k_l0_small_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	16384
layer_2_width_262k_l0_big Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_big_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_2_width_262k_l0_small_affine Load this SAE	blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf	262144
layer_30_width_16k_l0_big Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_big_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_small Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_16k_l0_small_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	16384
layer_30_width_262k_l0_big Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_big_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_small Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_30_width_262k_l0_small_affine Load this SAE	blocks.30.hook_mlp_in tlmodel.layers.30.pre_feedforward_layernorm.output hf	262144
layer_31_width_16k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_16k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	16384
layer_31_width_262k_l0_big Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_big_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_small Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_31_width_262k_l0_small_affine Load this SAE	blocks.31.hook_mlp_in tlmodel.layers.31.pre_feedforward_layernorm.output hf	262144
layer_32_width_16k_l0_big Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_big_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_small Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_16k_l0_small_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	16384
layer_32_width_262k_l0_big Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_big_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_small Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_32_width_262k_l0_small_affine Load this SAE	blocks.32.hook_mlp_in tlmodel.layers.32.pre_feedforward_layernorm.output hf	262144
layer_33_width_16k_l0_big Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_big_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_small Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_16k_l0_small_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	16384
layer_33_width_262k_l0_big Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_big_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_small Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_33_width_262k_l0_small_affine Load this SAE	blocks.33.hook_mlp_in tlmodel.layers.33.pre_feedforward_layernorm.output hf	262144
layer_34_width_16k_l0_big Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_big_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_small Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_16k_l0_small_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	16384
layer_34_width_262k_l0_big Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_big_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_small Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_34_width_262k_l0_small_affine Load this SAE	blocks.34.hook_mlp_in tlmodel.layers.34.pre_feedforward_layernorm.output hf	262144
layer_35_width_16k_l0_big Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_big_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_small Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_16k_l0_small_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	16384
layer_35_width_262k_l0_big Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_big_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_small Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_35_width_262k_l0_small_affine Load this SAE	blocks.35.hook_mlp_in tlmodel.layers.35.pre_feedforward_layernorm.output hf	262144
layer_36_width_16k_l0_big Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_big_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_small Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_16k_l0_small_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	16384
layer_36_width_262k_l0_big Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_big_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_small Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_36_width_262k_l0_small_affine Load this SAE	blocks.36.hook_mlp_in tlmodel.layers.36.pre_feedforward_layernorm.output hf	262144
layer_37_width_16k_l0_big Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_big_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_small Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_16k_l0_small_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	16384
layer_37_width_262k_l0_big Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_big_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_small Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_37_width_262k_l0_small_affine Load this SAE	blocks.37.hook_mlp_in tlmodel.layers.37.pre_feedforward_layernorm.output hf	262144
layer_38_width_16k_l0_big Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_big_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_small Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_16k_l0_small_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	16384
layer_38_width_262k_l0_big Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_big_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_small Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_38_width_262k_l0_small_affine Load this SAE	blocks.38.hook_mlp_in tlmodel.layers.38.pre_feedforward_layernorm.output hf	262144
layer_39_width_16k_l0_big Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_big_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_small Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_16k_l0_small_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	16384
layer_39_width_262k_l0_big Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_big_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_small Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_39_width_262k_l0_small_affine Load this SAE	blocks.39.hook_mlp_in tlmodel.layers.39.pre_feedforward_layernorm.output hf	262144
layer_3_width_16k_l0_big Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_big_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_16k_l0_small_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	16384
layer_3_width_262k_l0_big Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_big_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_3_width_262k_l0_small_affine Load this SAE	blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf	262144
layer_40_width_16k_l0_big Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_big_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_small Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_16k_l0_small_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	16384
layer_40_width_262k_l0_big Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_big_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_small Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_40_width_262k_l0_small_affine Load this SAE	blocks.40.hook_mlp_in tlmodel.layers.40.pre_feedforward_layernorm.output hf	262144
layer_41_width_16k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_16k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	16384
layer_41_width_262k_l0_big Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_big_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_small Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_41_width_262k_l0_small_affine Load this SAE	blocks.41.hook_mlp_in tlmodel.layers.41.pre_feedforward_layernorm.output hf	262144
layer_42_width_16k_l0_big Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_big_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_small Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_16k_l0_small_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	16384
layer_42_width_262k_l0_big Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_big_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_small Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_42_width_262k_l0_small_affine Load this SAE	blocks.42.hook_mlp_in tlmodel.layers.42.pre_feedforward_layernorm.output hf	262144
layer_43_width_16k_l0_big_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	16384
layer_43_width_16k_l0_small_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	16384
layer_43_width_262k_l0_big Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_big_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_small Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_43_width_262k_l0_small_affine Load this SAE	blocks.43.hook_mlp_in tlmodel.layers.43.pre_feedforward_layernorm.output hf	262144
layer_44_width_16k_l0_big Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_big_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_small Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_16k_l0_small_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	16384
layer_44_width_262k_l0_big Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_big_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_small Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_44_width_262k_l0_small_affine Load this SAE	blocks.44.hook_mlp_in tlmodel.layers.44.pre_feedforward_layernorm.output hf	262144
layer_45_width_16k_l0_big Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_big_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_small Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_16k_l0_small_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	16384
layer_45_width_262k_l0_big Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_big_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_small Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_45_width_262k_l0_small_affine Load this SAE	blocks.45.hook_mlp_in tlmodel.layers.45.pre_feedforward_layernorm.output hf	262144
layer_46_width_16k_l0_big Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_big_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_small Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_16k_l0_small_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	16384
layer_46_width_262k_l0_big Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_big_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_small Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_46_width_262k_l0_small_affine Load this SAE	blocks.46.hook_mlp_in tlmodel.layers.46.pre_feedforward_layernorm.output hf	262144
layer_47_width_16k_l0_big Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_big_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_small Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_16k_l0_small_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	16384
layer_47_width_262k_l0_big Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_big_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_small Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_47_width_262k_l0_small_affine Load this SAE	blocks.47.hook_mlp_in tlmodel.layers.47.pre_feedforward_layernorm.output hf	262144
layer_48_width_16k_l0_big Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	16384
layer_48_width_16k_l0_big_affine Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	16384
layer_48_width_16k_l0_small Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	16384
layer_48_width_16k_l0_small_affine Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	16384
layer_48_width_262k_l0_big Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	262144
layer_48_width_262k_l0_big_affine Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	262144
layer_48_width_262k_l0_small Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	262144
layer_48_width_262k_l0_small_affine Load this SAE	blocks.48.hook_mlp_in tlmodel.layers.48.pre_feedforward_layernorm.output hf	262144
layer_49_width_16k_l0_big Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	16384
layer_49_width_16k_l0_big_affine Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	16384
layer_49_width_16k_l0_small Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	16384
layer_49_width_16k_l0_small_affine Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	16384
layer_49_width_262k_l0_big Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	262144
layer_49_width_262k_l0_big_affine Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	262144
layer_49_width_262k_l0_small Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	262144
layer_49_width_262k_l0_small_affine Load this SAE	blocks.49.hook_mlp_in tlmodel.layers.49.pre_feedforward_layernorm.output hf	262144
layer_4_width_16k_l0_big_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_16k_l0_small_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	16384
layer_4_width_262k_l0_big Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_big_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_4_width_262k_l0_small_affine Load this SAE	blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf	262144
layer_50_width_16k_l0_big Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	16384
layer_50_width_16k_l0_big_affine Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	16384
layer_50_width_16k_l0_small Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	16384
layer_50_width_16k_l0_small_affine Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	16384
layer_50_width_262k_l0_big Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	262144
layer_50_width_262k_l0_big_affine Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	262144
layer_50_width_262k_l0_small Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	262144
layer_50_width_262k_l0_small_affine Load this SAE	blocks.50.hook_mlp_in tlmodel.layers.50.pre_feedforward_layernorm.output hf	262144
layer_51_width_16k_l0_big Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	16384
layer_51_width_16k_l0_big_affine Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	16384
layer_51_width_16k_l0_small Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	16384
layer_51_width_16k_l0_small_affine Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	16384
layer_51_width_262k_l0_big Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	262144
layer_51_width_262k_l0_big_affine Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	262144
layer_51_width_262k_l0_small Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	262144
layer_51_width_262k_l0_small_affine Load this SAE	blocks.51.hook_mlp_in tlmodel.layers.51.pre_feedforward_layernorm.output hf	262144
layer_52_width_16k_l0_big Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	16384
layer_52_width_16k_l0_big_affine Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	16384
layer_52_width_16k_l0_small Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	16384
layer_52_width_16k_l0_small_affine Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	16384
layer_52_width_262k_l0_big Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	262144
layer_52_width_262k_l0_big_affine Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	262144
layer_52_width_262k_l0_small Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	262144
layer_52_width_262k_l0_small_affine Load this SAE	blocks.52.hook_mlp_in tlmodel.layers.52.pre_feedforward_layernorm.output hf	262144
layer_53_width_16k_l0_big Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	16384
layer_53_width_16k_l0_big_affine Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	16384
layer_53_width_16k_l0_small Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	16384
layer_53_width_16k_l0_small_affine Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	16384
layer_53_width_262k_l0_big Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	262144
layer_53_width_262k_l0_big_affine Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	262144
layer_53_width_262k_l0_small Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	262144
layer_53_width_262k_l0_small_affine Load this SAE	blocks.53.hook_mlp_in tlmodel.layers.53.pre_feedforward_layernorm.output hf	262144
layer_54_width_16k_l0_big Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	16384
layer_54_width_16k_l0_big_affine Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	16384
layer_54_width_16k_l0_small Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	16384
layer_54_width_16k_l0_small_affine Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	16384
layer_54_width_262k_l0_big Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	262144
layer_54_width_262k_l0_big_affine Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	262144
layer_54_width_262k_l0_small Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	262144
layer_54_width_262k_l0_small_affine Load this SAE	blocks.54.hook_mlp_in tlmodel.layers.54.pre_feedforward_layernorm.output hf	262144
layer_55_width_16k_l0_big Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	16384
layer_55_width_16k_l0_big_affine Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	16384
layer_55_width_16k_l0_small Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	16384
layer_55_width_16k_l0_small_affine Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	16384
layer_55_width_262k_l0_big Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	262144
layer_55_width_262k_l0_big_affine Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	262144
layer_55_width_262k_l0_small Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	262144
layer_55_width_262k_l0_small_affine Load this SAE	blocks.55.hook_mlp_in tlmodel.layers.55.pre_feedforward_layernorm.output hf	262144
layer_56_width_16k_l0_big Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	16384
layer_56_width_16k_l0_big_affine Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	16384
layer_56_width_16k_l0_small Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	16384
layer_56_width_16k_l0_small_affine Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	16384
layer_56_width_262k_l0_big Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	262144
layer_56_width_262k_l0_big_affine Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	262144
layer_56_width_262k_l0_small Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	262144
layer_56_width_262k_l0_small_affine Load this SAE	blocks.56.hook_mlp_in tlmodel.layers.56.pre_feedforward_layernorm.output hf	262144
layer_57_width_16k_l0_big Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	16384
layer_57_width_16k_l0_big_affine Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	16384
layer_57_width_16k_l0_small Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	16384
layer_57_width_16k_l0_small_affine Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	16384
layer_57_width_262k_l0_big Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	262144
layer_57_width_262k_l0_big_affine Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	262144
layer_57_width_262k_l0_small Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	262144
layer_57_width_262k_l0_small_affine Load this SAE	blocks.57.hook_mlp_in tlmodel.layers.57.pre_feedforward_layernorm.output hf	262144
layer_58_width_16k_l0_big Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	16384
layer_58_width_16k_l0_big_affine Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	16384
layer_58_width_16k_l0_small Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	16384
layer_58_width_16k_l0_small_affine Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	16384
layer_58_width_262k_l0_big Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	262144
layer_58_width_262k_l0_big_affine Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	262144
layer_58_width_262k_l0_small Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	262144
layer_58_width_262k_l0_small_affine Load this SAE	blocks.58.hook_mlp_in tlmodel.layers.58.pre_feedforward_layernorm.output hf	262144
layer_59_width_16k_l0_big Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	16384
layer_59_width_16k_l0_big_affine Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	16384
layer_59_width_16k_l0_small Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	16384
layer_59_width_16k_l0_small_affine Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	16384
layer_59_width_262k_l0_big Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	262144
layer_59_width_262k_l0_big_affine Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	262144
layer_59_width_262k_l0_small Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	262144
layer_59_width_262k_l0_small_affine Load this SAE	blocks.59.hook_mlp_in tlmodel.layers.59.pre_feedforward_layernorm.output hf	262144
layer_5_width_16k_l0_big Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_big_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_16k_l0_small_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	16384
layer_5_width_262k_l0_big Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_big_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_5_width_262k_l0_small_affine Load this SAE	blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf	262144
layer_60_width_16k_l0_big Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	16384
layer_60_width_16k_l0_big_affine Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	16384
layer_60_width_16k_l0_small Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	16384
layer_60_width_16k_l0_small_affine Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	16384
layer_60_width_262k_l0_big Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	262144
layer_60_width_262k_l0_big_affine Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	262144
layer_60_width_262k_l0_small Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	262144
layer_60_width_262k_l0_small_affine Load this SAE	blocks.60.hook_mlp_in tlmodel.layers.60.pre_feedforward_layernorm.output hf	262144
layer_61_width_16k_l0_big Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	16384
layer_61_width_16k_l0_big_affine Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	16384
layer_61_width_16k_l0_small Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	16384
layer_61_width_16k_l0_small_affine Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	16384
layer_61_width_262k_l0_big Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	262144
layer_61_width_262k_l0_big_affine Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	262144
layer_61_width_262k_l0_small Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	262144
layer_61_width_262k_l0_small_affine Load this SAE	blocks.61.hook_mlp_in tlmodel.layers.61.pre_feedforward_layernorm.output hf	262144
layer_6_width_16k_l0_big Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_big_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_16k_l0_small_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	16384
layer_6_width_262k_l0_big Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_big_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_6_width_262k_l0_small_affine Load this SAE	blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf	262144
layer_7_width_16k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_16k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	16384
layer_7_width_262k_l0_big Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_big_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_7_width_262k_l0_small_affine Load this SAE	blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf	262144
layer_8_width_16k_l0_big Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_big_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_16k_l0_small_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	16384
layer_8_width_262k_l0_big Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_big_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_8_width_262k_l0_small_affine Load this SAE	blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf	262144
layer_9_width_16k_l0_big Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_big_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_16k_l0_small_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	16384
layer_9_width_262k_l0_big Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_big_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144
layer_9_width_262k_l0_small_affine Load this SAE	blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf	262144

×

Copy Code