gemma-3-270m
This page lists all pretrained SAEs available for gemma-3-270m.
gemma-scope-2-270m-pt-att
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
layer_12_width_16k_l0_big Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 16384 |
layer_12_width_16k_l0_medium Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 16384 |
layer_12_width_262k_l0_big Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 262144 |
layer_12_width_262k_l0_medium Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 262144 |
layer_12_width_65k_l0_big Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 65536 |
layer_12_width_65k_l0_medium Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 65536 |
layer_12_width_65k_l0_small Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 65536 |
layer_15_width_16k_l0_big Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 16384 |
layer_15_width_16k_l0_medium Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 16384 |
layer_15_width_262k_l0_big Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 262144 |
layer_15_width_262k_l0_medium Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 262144 |
layer_15_width_65k_l0_big Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 65536 |
layer_15_width_65k_l0_medium Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 65536 |
layer_15_width_65k_l0_small Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 65536 |
layer_5_width_16k_l0_big Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 16384 |
layer_5_width_16k_l0_medium Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 16384 |
layer_5_width_262k_l0_big Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 262144 |
layer_5_width_262k_l0_medium Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 262144 |
layer_5_width_65k_l0_big Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 65536 |
layer_5_width_65k_l0_medium Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 65536 |
layer_5_width_65k_l0_small Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 65536 |
layer_9_width_16k_l0_big Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 16384 |
layer_9_width_16k_l0_medium Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 16384 |
layer_9_width_262k_l0_big Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 262144 |
layer_9_width_262k_l0_medium Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 262144 |
layer_9_width_65k_l0_big Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 65536 |
layer_9_width_65k_l0_medium Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 65536 |
layer_9_width_65k_l0_small Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 65536 |
gemma-scope-2-270m-pt-att-all
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
layer_0_width_16k_l0_big Load this SAE |
blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf | 16384 |
layer_0_width_16k_l0_small Load this SAE |
blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf | 16384 |
layer_0_width_262k_l0_big Load this SAE |
blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf | 262144 |
layer_0_width_262k_l0_small Load this SAE |
blocks.0.attn.hook_z tlmodel.layers.0.self_attn.o_proj.input hf | 262144 |
layer_10_width_16k_l0_big Load this SAE |
blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf | 16384 |
layer_10_width_16k_l0_small Load this SAE |
blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf | 16384 |
layer_10_width_262k_l0_big Load this SAE |
blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf | 262144 |
layer_10_width_262k_l0_small Load this SAE |
blocks.10.attn.hook_z tlmodel.layers.10.self_attn.o_proj.input hf | 262144 |
layer_11_width_16k_l0_big Load this SAE |
blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf | 16384 |
layer_11_width_16k_l0_small Load this SAE |
blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf | 16384 |
layer_11_width_262k_l0_big Load this SAE |
blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf | 262144 |
layer_11_width_262k_l0_small Load this SAE |
blocks.11.attn.hook_z tlmodel.layers.11.self_attn.o_proj.input hf | 262144 |
layer_12_width_16k_l0_big Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 16384 |
layer_12_width_262k_l0_big Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
blocks.12.attn.hook_z tlmodel.layers.12.self_attn.o_proj.input hf | 262144 |
layer_13_width_16k_l0_big Load this SAE |
blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf | 16384 |
layer_13_width_16k_l0_small Load this SAE |
blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf | 16384 |
layer_13_width_262k_l0_big Load this SAE |
blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf | 262144 |
layer_13_width_262k_l0_small Load this SAE |
blocks.13.attn.hook_z tlmodel.layers.13.self_attn.o_proj.input hf | 262144 |
layer_14_width_16k_l0_big Load this SAE |
blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf | 16384 |
layer_14_width_16k_l0_small Load this SAE |
blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf | 16384 |
layer_14_width_262k_l0_big Load this SAE |
blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf | 262144 |
layer_14_width_262k_l0_small Load this SAE |
blocks.14.attn.hook_z tlmodel.layers.14.self_attn.o_proj.input hf | 262144 |
layer_15_width_16k_l0_big Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 16384 |
layer_15_width_262k_l0_big Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
blocks.15.attn.hook_z tlmodel.layers.15.self_attn.o_proj.input hf | 262144 |
layer_16_width_16k_l0_big Load this SAE |
blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf | 16384 |
layer_16_width_16k_l0_small Load this SAE |
blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf | 16384 |
layer_16_width_262k_l0_big Load this SAE |
blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf | 262144 |
layer_16_width_262k_l0_small Load this SAE |
blocks.16.attn.hook_z tlmodel.layers.16.self_attn.o_proj.input hf | 262144 |
layer_17_width_16k_l0_big Load this SAE |
blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf | 16384 |
layer_17_width_16k_l0_small Load this SAE |
blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf | 16384 |
layer_17_width_262k_l0_big Load this SAE |
blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf | 262144 |
layer_17_width_262k_l0_small Load this SAE |
blocks.17.attn.hook_z tlmodel.layers.17.self_attn.o_proj.input hf | 262144 |
layer_1_width_16k_l0_big Load this SAE |
blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf | 16384 |
layer_1_width_16k_l0_small Load this SAE |
blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf | 16384 |
layer_1_width_262k_l0_big Load this SAE |
blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf | 262144 |
layer_1_width_262k_l0_small Load this SAE |
blocks.1.attn.hook_z tlmodel.layers.1.self_attn.o_proj.input hf | 262144 |
layer_2_width_16k_l0_big Load this SAE |
blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf | 16384 |
layer_2_width_16k_l0_small Load this SAE |
blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf | 16384 |
layer_2_width_262k_l0_big Load this SAE |
blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf | 262144 |
layer_2_width_262k_l0_small Load this SAE |
blocks.2.attn.hook_z tlmodel.layers.2.self_attn.o_proj.input hf | 262144 |
layer_3_width_16k_l0_big Load this SAE |
blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf | 16384 |
layer_3_width_16k_l0_small Load this SAE |
blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf | 16384 |
layer_3_width_262k_l0_big Load this SAE |
blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf | 262144 |
layer_3_width_262k_l0_small Load this SAE |
blocks.3.attn.hook_z tlmodel.layers.3.self_attn.o_proj.input hf | 262144 |
layer_4_width_16k_l0_big Load this SAE |
blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf | 16384 |
layer_4_width_16k_l0_small Load this SAE |
blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf | 16384 |
layer_4_width_262k_l0_big Load this SAE |
blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf | 262144 |
layer_4_width_262k_l0_small Load this SAE |
blocks.4.attn.hook_z tlmodel.layers.4.self_attn.o_proj.input hf | 262144 |
layer_5_width_16k_l0_big Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 16384 |
layer_5_width_262k_l0_big Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
blocks.5.attn.hook_z tlmodel.layers.5.self_attn.o_proj.input hf | 262144 |
layer_6_width_16k_l0_big Load this SAE |
blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf | 16384 |
layer_6_width_16k_l0_small Load this SAE |
blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf | 16384 |
layer_6_width_262k_l0_big Load this SAE |
blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf | 262144 |
layer_6_width_262k_l0_small Load this SAE |
blocks.6.attn.hook_z tlmodel.layers.6.self_attn.o_proj.input hf | 262144 |
layer_7_width_16k_l0_big Load this SAE |
blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf | 16384 |
layer_7_width_16k_l0_small Load this SAE |
blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf | 16384 |
layer_7_width_262k_l0_big Load this SAE |
blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf | 262144 |
layer_7_width_262k_l0_small Load this SAE |
blocks.7.attn.hook_z tlmodel.layers.7.self_attn.o_proj.input hf | 262144 |
layer_8_width_16k_l0_big Load this SAE |
blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf | 16384 |
layer_8_width_16k_l0_small Load this SAE |
blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf | 16384 |
layer_8_width_262k_l0_big Load this SAE |
blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf | 262144 |
layer_8_width_262k_l0_small Load this SAE |
blocks.8.attn.hook_z tlmodel.layers.8.self_attn.o_proj.input hf | 262144 |
layer_9_width_16k_l0_big Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 16384 |
layer_9_width_262k_l0_big Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
blocks.9.attn.hook_z tlmodel.layers.9.self_attn.o_proj.input hf | 262144 |
gemma-scope-2-270m-pt-mlp
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
layer_12_width_16k_l0_big Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 16384 |
layer_12_width_16k_l0_medium Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 16384 |
layer_12_width_262k_l0_big Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 262144 |
layer_12_width_262k_l0_medium Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 262144 |
layer_12_width_65k_l0_big Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 65536 |
layer_12_width_65k_l0_medium Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 65536 |
layer_12_width_65k_l0_small Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 65536 |
layer_15_width_16k_l0_big Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 16384 |
layer_15_width_16k_l0_medium Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 16384 |
layer_15_width_262k_l0_big Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 262144 |
layer_15_width_262k_l0_medium Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 262144 |
layer_15_width_65k_l0_big Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 65536 |
layer_15_width_65k_l0_medium Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 65536 |
layer_15_width_65k_l0_small Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 65536 |
layer_5_width_16k_l0_big Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 16384 |
layer_5_width_16k_l0_medium Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 16384 |
layer_5_width_262k_l0_big Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 262144 |
layer_5_width_262k_l0_medium Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 262144 |
layer_5_width_65k_l0_big Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 65536 |
layer_5_width_65k_l0_medium Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 65536 |
layer_5_width_65k_l0_small Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 65536 |
layer_9_width_16k_l0_big Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 16384 |
layer_9_width_16k_l0_medium Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 16384 |
layer_9_width_262k_l0_big Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 262144 |
layer_9_width_262k_l0_medium Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 262144 |
layer_9_width_65k_l0_big Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 65536 |
layer_9_width_65k_l0_medium Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 65536 |
layer_9_width_65k_l0_small Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 65536 |
gemma-scope-2-270m-pt-mlp-all
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
layer_0_width_16k_l0_big Load this SAE |
blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf | 16384 |
layer_0_width_16k_l0_small Load this SAE |
blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf | 16384 |
layer_0_width_262k_l0_big Load this SAE |
blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf | 262144 |
layer_0_width_262k_l0_small Load this SAE |
blocks.0.hook_mlp_out tlmodel.layers.0.post_feedforward_layernorm.output hf | 262144 |
layer_10_width_16k_l0_big Load this SAE |
blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf | 16384 |
layer_10_width_16k_l0_small Load this SAE |
blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf | 16384 |
layer_10_width_262k_l0_big Load this SAE |
blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf | 262144 |
layer_10_width_262k_l0_small Load this SAE |
blocks.10.hook_mlp_out tlmodel.layers.10.post_feedforward_layernorm.output hf | 262144 |
layer_11_width_16k_l0_big Load this SAE |
blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf | 16384 |
layer_11_width_16k_l0_small Load this SAE |
blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf | 16384 |
layer_11_width_262k_l0_big Load this SAE |
blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf | 262144 |
layer_11_width_262k_l0_small Load this SAE |
blocks.11.hook_mlp_out tlmodel.layers.11.post_feedforward_layernorm.output hf | 262144 |
layer_12_width_16k_l0_big Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 16384 |
layer_12_width_262k_l0_big Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
blocks.12.hook_mlp_out tlmodel.layers.12.post_feedforward_layernorm.output hf | 262144 |
layer_13_width_16k_l0_big Load this SAE |
blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf | 16384 |
layer_13_width_16k_l0_small Load this SAE |
blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf | 16384 |
layer_13_width_262k_l0_big Load this SAE |
blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf | 262144 |
layer_13_width_262k_l0_small Load this SAE |
blocks.13.hook_mlp_out tlmodel.layers.13.post_feedforward_layernorm.output hf | 262144 |
layer_14_width_16k_l0_big Load this SAE |
blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf | 16384 |
layer_14_width_16k_l0_small Load this SAE |
blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf | 16384 |
layer_14_width_262k_l0_big Load this SAE |
blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf | 262144 |
layer_14_width_262k_l0_small Load this SAE |
blocks.14.hook_mlp_out tlmodel.layers.14.post_feedforward_layernorm.output hf | 262144 |
layer_15_width_16k_l0_big Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 16384 |
layer_15_width_262k_l0_big Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
blocks.15.hook_mlp_out tlmodel.layers.15.post_feedforward_layernorm.output hf | 262144 |
layer_16_width_16k_l0_big Load this SAE |
blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf | 16384 |
layer_16_width_16k_l0_small Load this SAE |
blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf | 16384 |
layer_16_width_262k_l0_big Load this SAE |
blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf | 262144 |
layer_16_width_262k_l0_small Load this SAE |
blocks.16.hook_mlp_out tlmodel.layers.16.post_feedforward_layernorm.output hf | 262144 |
layer_17_width_16k_l0_big Load this SAE |
blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf | 16384 |
layer_17_width_16k_l0_small Load this SAE |
blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf | 16384 |
layer_17_width_262k_l0_big Load this SAE |
blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf | 262144 |
layer_17_width_262k_l0_small Load this SAE |
blocks.17.hook_mlp_out tlmodel.layers.17.post_feedforward_layernorm.output hf | 262144 |
layer_1_width_16k_l0_big Load this SAE |
blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf | 16384 |
layer_1_width_16k_l0_small Load this SAE |
blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf | 16384 |
layer_1_width_262k_l0_big Load this SAE |
blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf | 262144 |
layer_1_width_262k_l0_small Load this SAE |
blocks.1.hook_mlp_out tlmodel.layers.1.post_feedforward_layernorm.output hf | 262144 |
layer_2_width_16k_l0_big Load this SAE |
blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf | 16384 |
layer_2_width_16k_l0_small Load this SAE |
blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf | 16384 |
layer_2_width_262k_l0_big Load this SAE |
blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf | 262144 |
layer_2_width_262k_l0_small Load this SAE |
blocks.2.hook_mlp_out tlmodel.layers.2.post_feedforward_layernorm.output hf | 262144 |
layer_3_width_16k_l0_big Load this SAE |
blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf | 16384 |
layer_3_width_16k_l0_small Load this SAE |
blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf | 16384 |
layer_3_width_262k_l0_big Load this SAE |
blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf | 262144 |
layer_3_width_262k_l0_small Load this SAE |
blocks.3.hook_mlp_out tlmodel.layers.3.post_feedforward_layernorm.output hf | 262144 |
layer_4_width_16k_l0_big Load this SAE |
blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf | 16384 |
layer_4_width_16k_l0_small Load this SAE |
blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf | 16384 |
layer_4_width_262k_l0_big Load this SAE |
blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf | 262144 |
layer_4_width_262k_l0_small Load this SAE |
blocks.4.hook_mlp_out tlmodel.layers.4.post_feedforward_layernorm.output hf | 262144 |
layer_5_width_16k_l0_big Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 16384 |
layer_5_width_262k_l0_big Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
blocks.5.hook_mlp_out tlmodel.layers.5.post_feedforward_layernorm.output hf | 262144 |
layer_6_width_16k_l0_big Load this SAE |
blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf | 16384 |
layer_6_width_16k_l0_small Load this SAE |
blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf | 16384 |
layer_6_width_262k_l0_big Load this SAE |
blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf | 262144 |
layer_6_width_262k_l0_small Load this SAE |
blocks.6.hook_mlp_out tlmodel.layers.6.post_feedforward_layernorm.output hf | 262144 |
layer_7_width_16k_l0_big Load this SAE |
blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf | 16384 |
layer_7_width_16k_l0_small Load this SAE |
blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf | 16384 |
layer_7_width_262k_l0_big Load this SAE |
blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf | 262144 |
layer_7_width_262k_l0_small Load this SAE |
blocks.7.hook_mlp_out tlmodel.layers.7.post_feedforward_layernorm.output hf | 262144 |
layer_8_width_16k_l0_big Load this SAE |
blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf | 16384 |
layer_8_width_16k_l0_small Load this SAE |
blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf | 16384 |
layer_8_width_262k_l0_big Load this SAE |
blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf | 262144 |
layer_8_width_262k_l0_small Load this SAE |
blocks.8.hook_mlp_out tlmodel.layers.8.post_feedforward_layernorm.output hf | 262144 |
layer_9_width_16k_l0_big Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 16384 |
layer_9_width_262k_l0_big Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
blocks.9.hook_mlp_out tlmodel.layers.9.post_feedforward_layernorm.output hf | 262144 |
gemma-scope-2-270m-pt-res
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | neuronpedia | hook_name | d_sae |
|---|---|---|---|
layer_12_width_16k_l0_big Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 16384 |
layer_12_width_16k_l0_medium Load this SAE |
gemma-3-270m/12-gemmascope-2-res-16k | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 16384 |
layer_12_width_1m_l0_big Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 1048576 |
layer_12_width_1m_l0_medium Load this SAE |
gemma-3-270m/12-gemmascope-2-res-1m | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 1048576 |
layer_12_width_1m_l0_small Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 1048576 |
layer_12_width_262k_l0_big Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 262144 |
layer_12_width_262k_l0_medium Load this SAE |
gemma-3-270m/12-gemmascope-2-res-262k | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 262144 |
layer_12_width_262k_l0_medium_seed_1 Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 262144 |
layer_12_width_65k_l0_big Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 65536 |
layer_12_width_65k_l0_medium Load this SAE |
gemma-3-270m/12-gemmascope-2-res-65k | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 65536 |
layer_12_width_65k_l0_small Load this SAE |
nan | blocks.12.hook_resid_post tlmodel.layers.12.output hf | 65536 |
layer_15_width_16k_l0_big Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 16384 |
layer_15_width_16k_l0_medium Load this SAE |
gemma-3-270m/15-gemmascope-2-res-16k | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 16384 |
layer_15_width_1m_l0_big Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 1048576 |
layer_15_width_1m_l0_medium Load this SAE |
gemma-3-270m/15-gemmascope-2-res-1m | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 1048576 |
layer_15_width_1m_l0_small Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 1048576 |
layer_15_width_262k_l0_big Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 262144 |
layer_15_width_262k_l0_medium Load this SAE |
gemma-3-270m/15-gemmascope-2-res-262k | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 262144 |
layer_15_width_262k_l0_medium_seed_1 Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 262144 |
layer_15_width_65k_l0_big Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 65536 |
layer_15_width_65k_l0_medium Load this SAE |
gemma-3-270m/15-gemmascope-2-res-65k | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 65536 |
layer_15_width_65k_l0_small Load this SAE |
nan | blocks.15.hook_resid_post tlmodel.layers.15.output hf | 65536 |
layer_5_width_16k_l0_big Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 16384 |
layer_5_width_16k_l0_medium Load this SAE |
gemma-3-270m/5-gemmascope-2-res-16k | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 16384 |
layer_5_width_1m_l0_big Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 1048576 |
layer_5_width_1m_l0_medium Load this SAE |
gemma-3-270m/5-gemmascope-2-res-1m | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 1048576 |
layer_5_width_1m_l0_small Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 1048576 |
layer_5_width_262k_l0_big Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 262144 |
layer_5_width_262k_l0_medium Load this SAE |
gemma-3-270m/5-gemmascope-2-res-262k | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 262144 |
layer_5_width_262k_l0_medium_seed_1 Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 262144 |
layer_5_width_65k_l0_big Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 65536 |
layer_5_width_65k_l0_medium Load this SAE |
gemma-3-270m/5-gemmascope-2-res-65k | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 65536 |
layer_5_width_65k_l0_small Load this SAE |
nan | blocks.5.hook_resid_post tlmodel.layers.5.output hf | 65536 |
layer_9_width_16k_l0_big Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 16384 |
layer_9_width_16k_l0_medium Load this SAE |
gemma-3-270m/9-gemmascope-2-res-16k | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 16384 |
layer_9_width_1m_l0_big Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 1048576 |
layer_9_width_1m_l0_medium Load this SAE |
gemma-3-270m/9-gemmascope-2-res-1m | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 1048576 |
layer_9_width_1m_l0_small Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 1048576 |
layer_9_width_262k_l0_big Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 262144 |
layer_9_width_262k_l0_medium Load this SAE |
gemma-3-270m/9-gemmascope-2-res-262k | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 262144 |
layer_9_width_262k_l0_medium_seed_1 Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 262144 |
layer_9_width_65k_l0_big Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 65536 |
layer_9_width_65k_l0_medium Load this SAE |
gemma-3-270m/9-gemmascope-2-res-65k | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 65536 |
layer_9_width_65k_l0_small Load this SAE |
nan | blocks.9.hook_resid_post tlmodel.layers.9.output hf | 65536 |
gemma-scope-2-270m-pt-res-all
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
layer_0_width_16k_l0_big Load this SAE |
blocks.0.hook_resid_post tlmodel.layers.0.output hf | 16384 |
layer_0_width_16k_l0_small Load this SAE |
blocks.0.hook_resid_post tlmodel.layers.0.output hf | 16384 |
layer_0_width_262k_l0_big Load this SAE |
blocks.0.hook_resid_post tlmodel.layers.0.output hf | 262144 |
layer_0_width_262k_l0_small Load this SAE |
blocks.0.hook_resid_post tlmodel.layers.0.output hf | 262144 |
layer_10_width_16k_l0_big Load this SAE |
blocks.10.hook_resid_post tlmodel.layers.10.output hf | 16384 |
layer_10_width_16k_l0_small Load this SAE |
blocks.10.hook_resid_post tlmodel.layers.10.output hf | 16384 |
layer_10_width_262k_l0_big Load this SAE |
blocks.10.hook_resid_post tlmodel.layers.10.output hf | 262144 |
layer_10_width_262k_l0_small Load this SAE |
blocks.10.hook_resid_post tlmodel.layers.10.output hf | 262144 |
layer_11_width_16k_l0_big Load this SAE |
blocks.11.hook_resid_post tlmodel.layers.11.output hf | 16384 |
layer_11_width_16k_l0_small Load this SAE |
blocks.11.hook_resid_post tlmodel.layers.11.output hf | 16384 |
layer_11_width_262k_l0_big Load this SAE |
blocks.11.hook_resid_post tlmodel.layers.11.output hf | 262144 |
layer_11_width_262k_l0_small Load this SAE |
blocks.11.hook_resid_post tlmodel.layers.11.output hf | 262144 |
layer_12_width_16k_l0_big Load this SAE |
blocks.12.hook_resid_post tlmodel.layers.12.output hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
blocks.12.hook_resid_post tlmodel.layers.12.output hf | 16384 |
layer_12_width_262k_l0_big Load this SAE |
blocks.12.hook_resid_post tlmodel.layers.12.output hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
blocks.12.hook_resid_post tlmodel.layers.12.output hf | 262144 |
layer_13_width_16k_l0_big Load this SAE |
blocks.13.hook_resid_post tlmodel.layers.13.output hf | 16384 |
layer_13_width_16k_l0_small Load this SAE |
blocks.13.hook_resid_post tlmodel.layers.13.output hf | 16384 |
layer_13_width_262k_l0_big Load this SAE |
blocks.13.hook_resid_post tlmodel.layers.13.output hf | 262144 |
layer_13_width_262k_l0_small Load this SAE |
blocks.13.hook_resid_post tlmodel.layers.13.output hf | 262144 |
layer_14_width_16k_l0_big Load this SAE |
blocks.14.hook_resid_post tlmodel.layers.14.output hf | 16384 |
layer_14_width_16k_l0_small Load this SAE |
blocks.14.hook_resid_post tlmodel.layers.14.output hf | 16384 |
layer_14_width_262k_l0_big Load this SAE |
blocks.14.hook_resid_post tlmodel.layers.14.output hf | 262144 |
layer_14_width_262k_l0_small Load this SAE |
blocks.14.hook_resid_post tlmodel.layers.14.output hf | 262144 |
layer_15_width_16k_l0_big Load this SAE |
blocks.15.hook_resid_post tlmodel.layers.15.output hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
blocks.15.hook_resid_post tlmodel.layers.15.output hf | 16384 |
layer_15_width_262k_l0_big Load this SAE |
blocks.15.hook_resid_post tlmodel.layers.15.output hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
blocks.15.hook_resid_post tlmodel.layers.15.output hf | 262144 |
layer_16_width_16k_l0_big Load this SAE |
blocks.16.hook_resid_post tlmodel.layers.16.output hf | 16384 |
layer_16_width_16k_l0_small Load this SAE |
blocks.16.hook_resid_post tlmodel.layers.16.output hf | 16384 |
layer_16_width_262k_l0_big Load this SAE |
blocks.16.hook_resid_post tlmodel.layers.16.output hf | 262144 |
layer_16_width_262k_l0_small Load this SAE |
blocks.16.hook_resid_post tlmodel.layers.16.output hf | 262144 |
layer_17_width_16k_l0_big Load this SAE |
blocks.17.hook_resid_post tlmodel.layers.17.output hf | 16384 |
layer_17_width_16k_l0_small Load this SAE |
blocks.17.hook_resid_post tlmodel.layers.17.output hf | 16384 |
layer_17_width_262k_l0_big Load this SAE |
blocks.17.hook_resid_post tlmodel.layers.17.output hf | 262144 |
layer_17_width_262k_l0_small Load this SAE |
blocks.17.hook_resid_post tlmodel.layers.17.output hf | 262144 |
layer_1_width_16k_l0_big Load this SAE |
blocks.1.hook_resid_post tlmodel.layers.1.output hf | 16384 |
layer_1_width_16k_l0_small Load this SAE |
blocks.1.hook_resid_post tlmodel.layers.1.output hf | 16384 |
layer_1_width_262k_l0_big Load this SAE |
blocks.1.hook_resid_post tlmodel.layers.1.output hf | 262144 |
layer_1_width_262k_l0_small Load this SAE |
blocks.1.hook_resid_post tlmodel.layers.1.output hf | 262144 |
layer_2_width_16k_l0_big Load this SAE |
blocks.2.hook_resid_post tlmodel.layers.2.output hf | 16384 |
layer_2_width_16k_l0_small Load this SAE |
blocks.2.hook_resid_post tlmodel.layers.2.output hf | 16384 |
layer_2_width_262k_l0_big Load this SAE |
blocks.2.hook_resid_post tlmodel.layers.2.output hf | 262144 |
layer_2_width_262k_l0_small Load this SAE |
blocks.2.hook_resid_post tlmodel.layers.2.output hf | 262144 |
layer_3_width_16k_l0_big Load this SAE |
blocks.3.hook_resid_post tlmodel.layers.3.output hf | 16384 |
layer_3_width_16k_l0_small Load this SAE |
blocks.3.hook_resid_post tlmodel.layers.3.output hf | 16384 |
layer_3_width_262k_l0_big Load this SAE |
blocks.3.hook_resid_post tlmodel.layers.3.output hf | 262144 |
layer_3_width_262k_l0_small Load this SAE |
blocks.3.hook_resid_post tlmodel.layers.3.output hf | 262144 |
layer_4_width_16k_l0_big Load this SAE |
blocks.4.hook_resid_post tlmodel.layers.4.output hf | 16384 |
layer_4_width_16k_l0_small Load this SAE |
blocks.4.hook_resid_post tlmodel.layers.4.output hf | 16384 |
layer_4_width_262k_l0_big Load this SAE |
blocks.4.hook_resid_post tlmodel.layers.4.output hf | 262144 |
layer_4_width_262k_l0_small Load this SAE |
blocks.4.hook_resid_post tlmodel.layers.4.output hf | 262144 |
layer_5_width_16k_l0_big Load this SAE |
blocks.5.hook_resid_post tlmodel.layers.5.output hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
blocks.5.hook_resid_post tlmodel.layers.5.output hf | 16384 |
layer_5_width_262k_l0_big Load this SAE |
blocks.5.hook_resid_post tlmodel.layers.5.output hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
blocks.5.hook_resid_post tlmodel.layers.5.output hf | 262144 |
layer_6_width_16k_l0_big Load this SAE |
blocks.6.hook_resid_post tlmodel.layers.6.output hf | 16384 |
layer_6_width_16k_l0_small Load this SAE |
blocks.6.hook_resid_post tlmodel.layers.6.output hf | 16384 |
layer_6_width_262k_l0_big Load this SAE |
blocks.6.hook_resid_post tlmodel.layers.6.output hf | 262144 |
layer_6_width_262k_l0_small Load this SAE |
blocks.6.hook_resid_post tlmodel.layers.6.output hf | 262144 |
layer_7_width_16k_l0_big Load this SAE |
blocks.7.hook_resid_post tlmodel.layers.7.output hf | 16384 |
layer_7_width_16k_l0_small Load this SAE |
blocks.7.hook_resid_post tlmodel.layers.7.output hf | 16384 |
layer_7_width_262k_l0_big Load this SAE |
blocks.7.hook_resid_post tlmodel.layers.7.output hf | 262144 |
layer_7_width_262k_l0_small Load this SAE |
blocks.7.hook_resid_post tlmodel.layers.7.output hf | 262144 |
layer_8_width_16k_l0_big Load this SAE |
blocks.8.hook_resid_post tlmodel.layers.8.output hf | 16384 |
layer_8_width_16k_l0_small Load this SAE |
blocks.8.hook_resid_post tlmodel.layers.8.output hf | 16384 |
layer_8_width_262k_l0_big Load this SAE |
blocks.8.hook_resid_post tlmodel.layers.8.output hf | 262144 |
layer_8_width_262k_l0_small Load this SAE |
blocks.8.hook_resid_post tlmodel.layers.8.output hf | 262144 |
layer_9_width_16k_l0_big Load this SAE |
blocks.9.hook_resid_post tlmodel.layers.9.output hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
blocks.9.hook_resid_post tlmodel.layers.9.output hf | 16384 |
layer_9_width_262k_l0_big Load this SAE |
blocks.9.hook_resid_post tlmodel.layers.9.output hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
blocks.9.hook_resid_post tlmodel.layers.9.output hf | 262144 |
gemma-scope-2-270m-pt-transcoders
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
transcoder/layer_15_width_262k_l0_big_affine Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 262144 |
transcoder/layer_9_width_16k_l0_small_affine Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 16384 |
gemma-scope-2-270m-pt-transcoders-all
- Huggingface Repo: google/gemma-scope-2-270m-pt
| id | hook_name | d_sae |
|---|---|---|
layer_0_width_16k_l0_big Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 16384 |
layer_0_width_16k_l0_big_affine Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 16384 |
layer_0_width_16k_l0_small Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 16384 |
layer_0_width_16k_l0_small_affine Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 16384 |
layer_0_width_262k_l0_big Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 262144 |
layer_0_width_262k_l0_big_affine Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 262144 |
layer_0_width_262k_l0_small Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 262144 |
layer_0_width_262k_l0_small_affine Load this SAE |
blocks.0.hook_mlp_in tlmodel.layers.0.pre_feedforward_layernorm.output hf | 262144 |
layer_10_width_16k_l0_big Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 16384 |
layer_10_width_16k_l0_big_affine Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 16384 |
layer_10_width_16k_l0_small Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 16384 |
layer_10_width_16k_l0_small_affine Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 16384 |
layer_10_width_262k_l0_big Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 262144 |
layer_10_width_262k_l0_big_affine Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 262144 |
layer_10_width_262k_l0_small Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 262144 |
layer_10_width_262k_l0_small_affine Load this SAE |
blocks.10.hook_mlp_in tlmodel.layers.10.pre_feedforward_layernorm.output hf | 262144 |
layer_11_width_16k_l0_big Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 16384 |
layer_11_width_16k_l0_big_affine Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 16384 |
layer_11_width_16k_l0_small Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 16384 |
layer_11_width_16k_l0_small_affine Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 16384 |
layer_11_width_262k_l0_big Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 262144 |
layer_11_width_262k_l0_big_affine Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 262144 |
layer_11_width_262k_l0_small Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 262144 |
layer_11_width_262k_l0_small_affine Load this SAE |
blocks.11.hook_mlp_in tlmodel.layers.11.pre_feedforward_layernorm.output hf | 262144 |
layer_12_width_16k_l0_big Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 16384 |
layer_12_width_16k_l0_big_affine Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 16384 |
layer_12_width_16k_l0_small Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 16384 |
layer_12_width_16k_l0_small_affine Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 16384 |
layer_12_width_262k_l0_big Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 262144 |
layer_12_width_262k_l0_big_affine Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 262144 |
layer_12_width_262k_l0_small Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 262144 |
layer_12_width_262k_l0_small_affine Load this SAE |
blocks.12.hook_mlp_in tlmodel.layers.12.pre_feedforward_layernorm.output hf | 262144 |
layer_13_width_16k_l0_big Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 16384 |
layer_13_width_16k_l0_big_affine Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 16384 |
layer_13_width_16k_l0_small Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 16384 |
layer_13_width_16k_l0_small_affine Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 16384 |
layer_13_width_262k_l0_big Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 262144 |
layer_13_width_262k_l0_big_affine Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 262144 |
layer_13_width_262k_l0_small Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 262144 |
layer_13_width_262k_l0_small_affine Load this SAE |
blocks.13.hook_mlp_in tlmodel.layers.13.pre_feedforward_layernorm.output hf | 262144 |
layer_14_width_16k_l0_big Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 16384 |
layer_14_width_16k_l0_big_affine Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 16384 |
layer_14_width_16k_l0_small Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 16384 |
layer_14_width_16k_l0_small_affine Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 16384 |
layer_14_width_262k_l0_big Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 262144 |
layer_14_width_262k_l0_big_affine Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 262144 |
layer_14_width_262k_l0_small Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 262144 |
layer_14_width_262k_l0_small_affine Load this SAE |
blocks.14.hook_mlp_in tlmodel.layers.14.pre_feedforward_layernorm.output hf | 262144 |
layer_15_width_16k_l0_big Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 16384 |
layer_15_width_16k_l0_big_affine Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 16384 |
layer_15_width_16k_l0_small Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 16384 |
layer_15_width_16k_l0_small_affine Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 16384 |
layer_15_width_262k_l0_big Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 262144 |
layer_15_width_262k_l0_big_affine Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 262144 |
layer_15_width_262k_l0_small Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 262144 |
layer_15_width_262k_l0_small_affine Load this SAE |
blocks.15.hook_mlp_in tlmodel.layers.15.pre_feedforward_layernorm.output hf | 262144 |
layer_16_width_16k_l0_big Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 16384 |
layer_16_width_16k_l0_big_affine Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 16384 |
layer_16_width_16k_l0_small Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 16384 |
layer_16_width_16k_l0_small_affine Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 16384 |
layer_16_width_262k_l0_big Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 262144 |
layer_16_width_262k_l0_big_affine Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 262144 |
layer_16_width_262k_l0_small Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 262144 |
layer_16_width_262k_l0_small_affine Load this SAE |
blocks.16.hook_mlp_in tlmodel.layers.16.pre_feedforward_layernorm.output hf | 262144 |
layer_17_width_16k_l0_big Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 16384 |
layer_17_width_16k_l0_big_affine Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 16384 |
layer_17_width_16k_l0_small Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 16384 |
layer_17_width_16k_l0_small_affine Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 16384 |
layer_17_width_262k_l0_big Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 262144 |
layer_17_width_262k_l0_big_affine Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 262144 |
layer_17_width_262k_l0_small Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 262144 |
layer_17_width_262k_l0_small_affine Load this SAE |
blocks.17.hook_mlp_in tlmodel.layers.17.pre_feedforward_layernorm.output hf | 262144 |
layer_1_width_16k_l0_big Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 16384 |
layer_1_width_16k_l0_big_affine Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 16384 |
layer_1_width_16k_l0_small Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 16384 |
layer_1_width_16k_l0_small_affine Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 16384 |
layer_1_width_262k_l0_big Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 262144 |
layer_1_width_262k_l0_big_affine Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 262144 |
layer_1_width_262k_l0_small Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 262144 |
layer_1_width_262k_l0_small_affine Load this SAE |
blocks.1.hook_mlp_in tlmodel.layers.1.pre_feedforward_layernorm.output hf | 262144 |
layer_2_width_16k_l0_big Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 16384 |
layer_2_width_16k_l0_big_affine Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 16384 |
layer_2_width_16k_l0_small Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 16384 |
layer_2_width_16k_l0_small_affine Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 16384 |
layer_2_width_262k_l0_big Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 262144 |
layer_2_width_262k_l0_big_affine Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 262144 |
layer_2_width_262k_l0_small Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 262144 |
layer_2_width_262k_l0_small_affine Load this SAE |
blocks.2.hook_mlp_in tlmodel.layers.2.pre_feedforward_layernorm.output hf | 262144 |
layer_3_width_16k_l0_big Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 16384 |
layer_3_width_16k_l0_big_affine Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 16384 |
layer_3_width_16k_l0_small Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 16384 |
layer_3_width_16k_l0_small_affine Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 16384 |
layer_3_width_262k_l0_big Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 262144 |
layer_3_width_262k_l0_big_affine Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 262144 |
layer_3_width_262k_l0_small Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 262144 |
layer_3_width_262k_l0_small_affine Load this SAE |
blocks.3.hook_mlp_in tlmodel.layers.3.pre_feedforward_layernorm.output hf | 262144 |
layer_4_width_16k_l0_big Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 16384 |
layer_4_width_16k_l0_big_affine Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 16384 |
layer_4_width_16k_l0_small Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 16384 |
layer_4_width_16k_l0_small_affine Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 16384 |
layer_4_width_262k_l0_big Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 262144 |
layer_4_width_262k_l0_big_affine Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 262144 |
layer_4_width_262k_l0_small Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 262144 |
layer_4_width_262k_l0_small_affine Load this SAE |
blocks.4.hook_mlp_in tlmodel.layers.4.pre_feedforward_layernorm.output hf | 262144 |
layer_5_width_16k_l0_big Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 16384 |
layer_5_width_16k_l0_big_affine Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 16384 |
layer_5_width_16k_l0_small Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 16384 |
layer_5_width_16k_l0_small_affine Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 16384 |
layer_5_width_262k_l0_big Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 262144 |
layer_5_width_262k_l0_big_affine Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 262144 |
layer_5_width_262k_l0_small Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 262144 |
layer_5_width_262k_l0_small_affine Load this SAE |
blocks.5.hook_mlp_in tlmodel.layers.5.pre_feedforward_layernorm.output hf | 262144 |
layer_6_width_16k_l0_big Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 16384 |
layer_6_width_16k_l0_big_affine Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 16384 |
layer_6_width_16k_l0_small Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 16384 |
layer_6_width_16k_l0_small_affine Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 16384 |
layer_6_width_262k_l0_big Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 262144 |
layer_6_width_262k_l0_big_affine Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 262144 |
layer_6_width_262k_l0_small Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 262144 |
layer_6_width_262k_l0_small_affine Load this SAE |
blocks.6.hook_mlp_in tlmodel.layers.6.pre_feedforward_layernorm.output hf | 262144 |
layer_7_width_16k_l0_big Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 16384 |
layer_7_width_16k_l0_big_affine Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 16384 |
layer_7_width_16k_l0_small Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 16384 |
layer_7_width_16k_l0_small_affine Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 16384 |
layer_7_width_262k_l0_big Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 262144 |
layer_7_width_262k_l0_big_affine Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 262144 |
layer_7_width_262k_l0_small Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 262144 |
layer_7_width_262k_l0_small_affine Load this SAE |
blocks.7.hook_mlp_in tlmodel.layers.7.pre_feedforward_layernorm.output hf | 262144 |
layer_8_width_16k_l0_big Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 16384 |
layer_8_width_16k_l0_big_affine Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 16384 |
layer_8_width_16k_l0_small Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 16384 |
layer_8_width_16k_l0_small_affine Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 16384 |
layer_8_width_262k_l0_big Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 262144 |
layer_8_width_262k_l0_big_affine Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 262144 |
layer_8_width_262k_l0_small Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 262144 |
layer_8_width_262k_l0_small_affine Load this SAE |
blocks.8.hook_mlp_in tlmodel.layers.8.pre_feedforward_layernorm.output hf | 262144 |
layer_9_width_16k_l0_big Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 16384 |
layer_9_width_16k_l0_big_affine Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 16384 |
layer_9_width_16k_l0_small Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 16384 |
layer_9_width_16k_l0_small_affine Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 16384 |
layer_9_width_262k_l0_big Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 262144 |
layer_9_width_262k_l0_big_affine Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 262144 |
layer_9_width_262k_l0_small Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 262144 |
layer_9_width_262k_l0_small_affine Load this SAE |
blocks.9.hook_mlp_in tlmodel.layers.9.pre_feedforward_layernorm.output hf | 262144 |
×