Pretrained SAEs
This is a list of SAEs importable from the SAELens package. Click on each link for more details.
This file contains the contents of sae_lens/pretrained_saes.yaml in Markdown
temporal-sae-gemma-2-2b
- Huggingface Repo: canrager/temporalSAEs
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post Load this SAE |
temporal | gemma-2-2b/12-temporal-res | blocks.12.hook_resid_post | 9216 | constant_scalar_rescale |
temporal-sae-llama-3.1-8b
- Huggingface Repo: canrager/temporalSAEs
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.15.hook_resid_post Load this SAE |
temporal | llama3.1-8b/15-temporal-res | blocks.15.hook_resid_post | 16384 | constant_scalar_rescale |
blocks.26.hook_resid_post Load this SAE |
temporal | llama3.1-8b/26-temporal-res | blocks.26.hook_resid_post | 16384 | constant_scalar_rescale |
deepseek-r1-distill-llama-8b-qresearch
- Huggingface Repo: qresearch/DeepSeek-R1-Distill-Llama-8B-SAE-l19
- model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.19.hook_resid_post Load this SAE |
standard | deepseek-r1-distill-llama-8b/19-qresearch-res-65k | blocks.19.hook_resid_post | 65536 | none |
gemma-2b-it-res-jb
- Huggingface Repo: jbloom/Gemma-2b-IT-Residual-Stream-SAEs
- model: gemma-2b-it
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post Load this SAE |
standard | gemma-2b-it/12-res-jb | blocks.12.hook_resid_post | 16384 | none |
gemma-2b-res-jb
- Huggingface Repo: jbloom/Gemma-2b-Residual-Stream-SAEs
- model: gemma-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
standard | gemma-2b/0-res-jb | blocks.0.hook_resid_post | 16384 | none |
blocks.6.hook_resid_post Load this SAE |
standard | gemma-2b/6-res-jb | blocks.6.hook_resid_post | 16384 | none |
blocks.10.hook_resid_post Load this SAE |
standard | gemma-2b/10-res-jb | blocks.10.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post Load this SAE |
standard | gemma-2b/12-res-jb | blocks.12.hook_resid_post | 16384 | expected_average_only_in |
blocks.17.hook_resid_post Load this SAE |
standard | blocks.17.hook_resid_post | 16384 | none |
gemma-scope-27b-pt-res
- Huggingface Repo: google/gemma-scope-27b-pt-res
- model: gemma-2-27b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_10/width_131k/average_l0_106 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_200 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_24 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_37 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_64 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_150 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_290 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_48 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_82 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_155 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_333 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_72 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_785 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none |
gemma-scope-27b-pt-res-canonical
- Huggingface Repo: google/gemma-scope-27b-pt-res
- model: gemma-2-27b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_10/width_131k/canonical Load this SAE |
jumprelu | gemma-2-27b/10-gemmascope-res-131k | blocks.10.hook_resid_post | 131072 | none |
layer_22/width_131k/canonical Load this SAE |
jumprelu | gemma-2-27b/22-gemmascope-res-131k | blocks.22.hook_resid_post | 131072 | none |
layer_34/width_131k/canonical Load this SAE |
jumprelu | gemma-2-27b/34-gemmascope-res-131k | blocks.34.hook_resid_post | 131072 | none |
gemma-scope-2b-pt-att
- Huggingface Repo: google/gemma-scope-2b-pt-att
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/average_l0_104 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_57 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_146 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_251 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_79 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_174 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_297 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_43 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_93 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_117 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_219 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_386 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_55 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_116 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_249 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_454 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_53 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_135 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_268 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_449 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_59 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_143 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_292 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_479 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_184 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_331 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_46 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_537 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_99 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_129 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_282 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_32 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_482 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_64 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_127 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_270 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_34 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_499 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_64 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_148 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_307 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_541 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_70 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_170 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_350 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_593 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_80 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_184 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_328 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_514 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_85 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_203 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_372 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_43 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_570 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_92 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_161 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_298 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_37 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_468 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_195 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_342 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_44 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_535 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_98 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_144 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_293 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_37 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_527 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_176 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_316 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_509 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_79 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_144 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_292 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_34 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_491 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_72 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_122 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_249 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_423 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_56 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_141 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_274 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_446 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_62 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_142 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_301 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_32 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_505 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_106 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_215 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_373 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_47 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_161 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_300 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_474 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_212 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_372 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_39 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_558 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_96 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_177 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_313 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_35 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_492 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_0/width_65k/average_l0_10 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 65536 | none | |
layer_0/width_65k/average_l0_16 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 65536 | none | |
layer_0/width_65k/average_l0_24 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 65536 | none | |
layer_0/width_65k/average_l0_43 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 65536 | none | |
layer_0/width_65k/average_l0_75 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 65536 | none | |
layer_1/width_65k/average_l0_15 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 65536 | none | |
layer_1/width_65k/average_l0_181 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 65536 | none | |
layer_1/width_65k/average_l0_28 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 65536 | none | |
layer_1/width_65k/average_l0_55 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 65536 | none | |
layer_1/width_65k/average_l0_98 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 65536 | none | |
layer_2/width_65k/average_l0_125 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 65536 | none | |
layer_2/width_65k/average_l0_14 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 65536 | none | |
layer_2/width_65k/average_l0_228 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 65536 | none | |
layer_2/width_65k/average_l0_28 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 65536 | none | |
layer_2/width_65k/average_l0_59 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 65536 | none | |
layer_3/width_65k/average_l0_174 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 65536 | none | |
layer_3/width_65k/average_l0_19 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 65536 | none | |
layer_3/width_65k/average_l0_320 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 65536 | none | |
layer_3/width_65k/average_l0_39 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 65536 | none | |
layer_3/width_65k/average_l0_83 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 65536 | none | |
layer_4/width_65k/average_l0_188 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 65536 | none | |
layer_4/width_65k/average_l0_22 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 65536 | none | |
layer_4/width_65k/average_l0_382 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 65536 | none | |
layer_4/width_65k/average_l0_43 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 65536 | none | |
layer_4/width_65k/average_l0_87 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 65536 | none | |
layer_5/width_65k/average_l0_227 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 65536 | none | |
layer_5/width_65k/average_l0_28 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 65536 | none | |
layer_5/width_65k/average_l0_400 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 65536 | none | |
layer_5/width_65k/average_l0_51 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 65536 | none | |
layer_5/width_65k/average_l0_99 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 65536 | none | |
layer_6/width_65k/average_l0_112 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 65536 | none | |
layer_6/width_65k/average_l0_261 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 65536 | none | |
layer_6/width_65k/average_l0_30 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 65536 | none | |
layer_6/width_65k/average_l0_449 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 65536 | none | |
layer_6/width_65k/average_l0_55 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 65536 | none | |
layer_7/width_65k/average_l0_176 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 65536 | none | |
layer_7/width_65k/average_l0_311 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 65536 | none | |
layer_7/width_65k/average_l0_519 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 65536 | none | |
layer_7/width_65k/average_l0_52 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 65536 | none | |
layer_7/width_65k/average_l0_96 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 65536 | none | |
layer_8/width_65k/average_l0_112 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 65536 | none | |
layer_8/width_65k/average_l0_246 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 65536 | none | |
layer_8/width_65k/average_l0_35 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 65536 | none | |
layer_8/width_65k/average_l0_454 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 65536 | none | |
layer_8/width_65k/average_l0_56 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 65536 | none | |
layer_9/width_65k/average_l0_107 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 65536 | none | |
layer_9/width_65k/average_l0_231 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 65536 | none | |
layer_9/width_65k/average_l0_31 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 65536 | none | |
layer_9/width_65k/average_l0_454 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 65536 | none | |
layer_9/width_65k/average_l0_57 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 65536 | none | |
layer_10/width_65k/average_l0_134 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 65536 | none | |
layer_10/width_65k/average_l0_292 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 65536 | none | |
layer_10/width_65k/average_l0_35 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 65536 | none | |
layer_10/width_65k/average_l0_521 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 65536 | none | |
layer_10/width_65k/average_l0_67 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 65536 | none | |
layer_11/width_65k/average_l0_154 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 65536 | none | |
layer_11/width_65k/average_l0_330 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 65536 | none | |
layer_11/width_65k/average_l0_41 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 65536 | none | |
layer_11/width_65k/average_l0_576 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 65536 | none | |
layer_11/width_65k/average_l0_75 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 65536 | none | |
layer_12/width_65k/average_l0_172 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 65536 | none | |
layer_12/width_65k/average_l0_320 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 65536 | none | |
layer_12/width_65k/average_l0_39 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 65536 | none | |
layer_12/width_65k/average_l0_503 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 65536 | none | |
layer_12/width_65k/average_l0_79 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 65536 | none | |
layer_13/width_65k/average_l0_191 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 65536 | none | |
layer_13/width_65k/average_l0_363 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 65536 | none | |
layer_13/width_65k/average_l0_41 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 65536 | none | |
layer_13/width_65k/average_l0_556 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 65536 | none | |
layer_13/width_65k/average_l0_87 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 65536 | none | |
layer_14/width_65k/average_l0_138 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 65536 | none | |
layer_14/width_65k/average_l0_283 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 65536 | none | |
layer_14/width_65k/average_l0_37 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 65536 | none | |
layer_14/width_65k/average_l0_453 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 65536 | none | |
layer_14/width_65k/average_l0_66 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 65536 | none | |
layer_15/width_65k/average_l0_182 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 65536 | none | |
layer_15/width_65k/average_l0_327 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 65536 | none | |
layer_15/width_65k/average_l0_42 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 65536 | none | |
layer_15/width_65k/average_l0_517 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 65536 | none | |
layer_15/width_65k/average_l0_90 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 65536 | none | |
layer_16/width_65k/average_l0_129 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 65536 | none | |
layer_16/width_65k/average_l0_260 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 65536 | none | |
layer_16/width_65k/average_l0_35 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 65536 | none | |
layer_16/width_65k/average_l0_502 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 65536 | none | |
layer_16/width_65k/average_l0_64 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 65536 | none | |
layer_17/width_65k/average_l0_157 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 65536 | none | |
layer_17/width_65k/average_l0_293 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 65536 | none | |
layer_17/width_65k/average_l0_35 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 65536 | none | |
layer_17/width_65k/average_l0_489 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 65536 | none | |
layer_17/width_65k/average_l0_70 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 65536 | none | |
layer_18/width_65k/average_l0_123 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 65536 | none | |
layer_18/width_65k/average_l0_255 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 65536 | none | |
layer_18/width_65k/average_l0_29 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 65536 | none | |
layer_18/width_65k/average_l0_466 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 65536 | none | |
layer_18/width_65k/average_l0_58 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 65536 | none | |
layer_19/width_65k/average_l0_106 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 65536 | none | |
layer_19/width_65k/average_l0_220 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 65536 | none | |
layer_19/width_65k/average_l0_26 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 65536 | none | |
layer_19/width_65k/average_l0_411 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 65536 | none | |
layer_19/width_65k/average_l0_49 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 65536 | none | |
layer_20/width_65k/average_l0_102 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 65536 | none | |
layer_20/width_65k/average_l0_242 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 65536 | none | |
layer_20/width_65k/average_l0_26 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 65536 | none | |
layer_20/width_65k/average_l0_419 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 65536 | none | |
layer_20/width_65k/average_l0_49 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 65536 | none | |
layer_21/width_65k/average_l0_118 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 65536 | none | |
layer_21/width_65k/average_l0_266 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 65536 | none | |
layer_21/width_65k/average_l0_29 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 65536 | none | |
layer_21/width_65k/average_l0_474 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 65536 | none | |
layer_21/width_65k/average_l0_56 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 65536 | none | |
layer_22/width_65k/average_l0_112 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 65536 | none | |
layer_22/width_65k/average_l0_196 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 65536 | none | |
layer_22/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 65536 | none | |
layer_22/width_65k/average_l0_361 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 65536 | none | |
layer_22/width_65k/average_l0_37 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 65536 | none | |
layer_23/width_65k/average_l0_140 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 65536 | none | |
layer_23/width_65k/average_l0_27 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 65536 | none | |
layer_23/width_65k/average_l0_276 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 65536 | none | |
layer_23/width_65k/average_l0_457 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 65536 | none | |
layer_23/width_65k/average_l0_56 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 65536 | none | |
layer_24/width_65k/average_l0_186 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 65536 | none | |
layer_24/width_65k/average_l0_32 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 65536 | none | |
layer_24/width_65k/average_l0_347 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 65536 | none | |
layer_24/width_65k/average_l0_537 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 65536 | none | |
layer_24/width_65k/average_l0_77 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 65536 | none | |
layer_25/width_65k/average_l0_153 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 65536 | none | |
layer_25/width_65k/average_l0_290 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 65536 | none | |
layer_25/width_65k/average_l0_30 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 65536 | none | |
layer_25/width_65k/average_l0_465 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 65536 | none | |
layer_25/width_65k/average_l0_63 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 65536 | none |
gemma-scope-2b-pt-att-canonical
- Huggingface Repo: google/gemma-scope-2b-pt-att
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/0-gemmascope-att-16k | blocks.0.attn.hook_z | 16384 | none |
layer_1/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/1-gemmascope-att-16k | blocks.1.attn.hook_z | 16384 | none |
layer_2/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/2-gemmascope-att-16k | blocks.2.attn.hook_z | 16384 | none |
layer_3/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/3-gemmascope-att-16k | blocks.3.attn.hook_z | 16384 | none |
layer_4/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/4-gemmascope-att-16k | blocks.4.attn.hook_z | 16384 | none |
layer_5/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-att-16k | blocks.5.attn.hook_z | 16384 | none |
layer_6/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/6-gemmascope-att-16k | blocks.6.attn.hook_z | 16384 | none |
layer_7/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/7-gemmascope-att-16k | blocks.7.attn.hook_z | 16384 | none |
layer_8/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/8-gemmascope-att-16k | blocks.8.attn.hook_z | 16384 | none |
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/9-gemmascope-att-16k | blocks.9.attn.hook_z | 16384 | none |
layer_10/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/10-gemmascope-att-16k | blocks.10.attn.hook_z | 16384 | none |
layer_11/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/11-gemmascope-att-16k | blocks.11.attn.hook_z | 16384 | none |
layer_12/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-att-16k | blocks.12.attn.hook_z | 16384 | none |
layer_13/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/13-gemmascope-att-16k | blocks.13.attn.hook_z | 16384 | none |
layer_14/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/14-gemmascope-att-16k | blocks.14.attn.hook_z | 16384 | none |
layer_15/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/15-gemmascope-att-16k | blocks.15.attn.hook_z | 16384 | none |
layer_16/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/16-gemmascope-att-16k | blocks.16.attn.hook_z | 16384 | none |
layer_17/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/17-gemmascope-att-16k | blocks.17.attn.hook_z | 16384 | none |
layer_18/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/18-gemmascope-att-16k | blocks.18.attn.hook_z | 16384 | none |
layer_19/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-att-16k | blocks.19.attn.hook_z | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/20-gemmascope-att-16k | blocks.20.attn.hook_z | 16384 | none |
layer_21/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/21-gemmascope-att-16k | blocks.21.attn.hook_z | 16384 | none |
layer_22/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/22-gemmascope-att-16k | blocks.22.attn.hook_z | 16384 | none |
layer_23/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/23-gemmascope-att-16k | blocks.23.attn.hook_z | 16384 | none |
layer_24/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/24-gemmascope-att-16k | blocks.24.attn.hook_z | 16384 | none |
layer_25/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/25-gemmascope-att-16k | blocks.25.attn.hook_z | 16384 | none |
layer_0/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/0-gemmascope-att-65k | blocks.0.attn.hook_z | 65536 | none |
layer_1/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/1-gemmascope-att-65k | blocks.1.attn.hook_z | 65536 | none |
layer_2/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/2-gemmascope-att-65k | blocks.2.attn.hook_z | 65536 | none |
layer_3/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/3-gemmascope-att-65k | blocks.3.attn.hook_z | 65536 | none |
layer_4/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/4-gemmascope-att-65k | blocks.4.attn.hook_z | 65536 | none |
layer_5/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-att-65k | blocks.5.attn.hook_z | 65536 | none |
layer_6/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/6-gemmascope-att-65k | blocks.6.attn.hook_z | 65536 | none |
layer_7/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/7-gemmascope-att-65k | blocks.7.attn.hook_z | 65536 | none |
layer_8/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/8-gemmascope-att-65k | blocks.8.attn.hook_z | 65536 | none |
layer_9/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/9-gemmascope-att-65k | blocks.9.attn.hook_z | 65536 | none |
layer_10/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/10-gemmascope-att-65k | blocks.10.attn.hook_z | 65536 | none |
layer_11/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/11-gemmascope-att-65k | blocks.11.attn.hook_z | 65536 | none |
layer_12/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-att-65k | blocks.12.attn.hook_z | 65536 | none |
layer_13/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/13-gemmascope-att-65k | blocks.13.attn.hook_z | 65536 | none |
layer_14/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/14-gemmascope-att-65k | blocks.14.attn.hook_z | 65536 | none |
layer_15/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/15-gemmascope-att-65k | blocks.15.attn.hook_z | 65536 | none |
layer_16/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/16-gemmascope-att-65k | blocks.16.attn.hook_z | 65536 | none |
layer_17/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/17-gemmascope-att-65k | blocks.17.attn.hook_z | 65536 | none |
layer_18/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/18-gemmascope-att-65k | blocks.18.attn.hook_z | 65536 | none |
layer_19/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-att-65k | blocks.19.attn.hook_z | 65536 | none |
layer_20/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/20-gemmascope-att-65k | blocks.20.attn.hook_z | 65536 | none |
layer_21/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/21-gemmascope-att-65k | blocks.21.attn.hook_z | 65536 | none |
layer_22/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/22-gemmascope-att-65k | blocks.22.attn.hook_z | 65536 | none |
layer_23/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/23-gemmascope-att-65k | blocks.23.attn.hook_z | 65536 | none |
layer_24/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/24-gemmascope-att-65k | blocks.24.attn.hook_z | 65536 | none |
layer_25/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/25-gemmascope-att-65k | blocks.25.attn.hook_z | 65536 | none |
gemma-scope-2b-pt-mlp
- Huggingface Repo: google/gemma-scope-2b-pt-mlp
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/average_l0_119 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_60 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_9 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_105 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_239 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_50 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_213 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_434 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_95 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_195 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_377 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_44 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_95 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_198 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_433 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_85 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_114 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_269 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_48 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_575 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_133 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_328 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_55 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_699 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_146 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_355 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_60 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_731 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_136 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_27 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_351 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_56 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_739 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_216 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_482 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_861 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_88 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_110 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_266 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_45 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_568 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_908 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_234 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_42 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_499 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_847 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_98 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_108 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_262 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_44 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_548 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_879 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_112 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_267 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_47 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_553 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_892 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_246 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_536 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_894 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_97 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_207 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_35 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_492 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_80 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_879 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_185 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_33 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_452 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_72 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_847 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_179 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_453 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_68 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_853 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_106 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_292 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_47 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_672 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_109 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_295 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_50 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_673 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_109 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_289 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_49 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_658 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_113 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_279 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_48 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_633 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_121 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_290 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_51 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_624 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_128 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_27 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_287 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_57 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_627 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_158 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_35 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_357 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_126 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_277 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_29 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_59 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_0/width_65k/average_l0_12 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 65536 | none | |
layer_0/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 65536 | none | |
layer_0/width_65k/average_l0_39 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 65536 | none | |
layer_0/width_65k/average_l0_7 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 65536 | none | |
layer_0/width_65k/average_l0_72 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 65536 | none | |
layer_1/width_65k/average_l0_11 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 65536 | none | |
layer_1/width_65k/average_l0_127 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 65536 | none | |
layer_1/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 65536 | none | |
layer_1/width_65k/average_l0_37 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 65536 | none | |
layer_1/width_65k/average_l0_67 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 65536 | none | |
layer_2/width_65k/average_l0_134 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 65536 | none | |
layer_2/width_65k/average_l0_16 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 65536 | none | |
layer_2/width_65k/average_l0_265 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 65536 | none | |
layer_2/width_65k/average_l0_31 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 65536 | none | |
layer_2/width_65k/average_l0_60 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 65536 | none | |
layer_3/width_65k/average_l0_144 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 65536 | none | |
layer_3/width_65k/average_l0_18 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 65536 | none | |
layer_3/width_65k/average_l0_279 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 65536 | none | |
layer_3/width_65k/average_l0_33 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 65536 | none | |
layer_3/width_65k/average_l0_68 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 65536 | none | |
layer_4/width_65k/average_l0_138 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 65536 | none | |
layer_4/width_65k/average_l0_17 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 65536 | none | |
layer_4/width_65k/average_l0_299 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 65536 | none | |
layer_4/width_65k/average_l0_32 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 65536 | none | |
layer_4/width_65k/average_l0_66 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 65536 | none | |
layer_5/width_65k/average_l0_186 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 65536 | none | |
layer_5/width_65k/average_l0_22 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 65536 | none | |
layer_5/width_65k/average_l0_407 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 65536 | none | |
layer_5/width_65k/average_l0_43 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 65536 | none | |
layer_5/width_65k/average_l0_86 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 65536 | none | |
layer_6/width_65k/average_l0_101 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 65536 | none | |
layer_6/width_65k/average_l0_224 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 65536 | none | |
layer_6/width_65k/average_l0_24 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 65536 | none | |
layer_6/width_65k/average_l0_47 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 65536 | none | |
layer_6/width_65k/average_l0_515 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 65536 | none | |
layer_7/width_65k/average_l0_115 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 65536 | none | |
layer_7/width_65k/average_l0_266 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 65536 | none | |
layer_7/width_65k/average_l0_28 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 65536 | none | |
layer_7/width_65k/average_l0_56 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 65536 | none | |
layer_7/width_65k/average_l0_571 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 65536 | none | |
layer_8/width_65k/average_l0_110 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 65536 | none | |
layer_8/width_65k/average_l0_256 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 65536 | none | |
layer_8/width_65k/average_l0_31 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 65536 | none | |
layer_8/width_65k/average_l0_547 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 65536 | none | |
layer_8/width_65k/average_l0_55 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 65536 | none | |
layer_9/width_65k/average_l0_168 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 65536 | none | |
layer_9/width_65k/average_l0_38 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 65536 | none | |
layer_9/width_65k/average_l0_387 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 65536 | none | |
layer_9/width_65k/average_l0_745 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 65536 | none | |
layer_9/width_65k/average_l0_77 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 65536 | none | |
layer_10/width_65k/average_l0_218 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 65536 | none | |
layer_10/width_65k/average_l0_43 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 65536 | none | |
layer_10/width_65k/average_l0_474 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 65536 | none | |
layer_10/width_65k/average_l0_851 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 65536 | none | |
layer_10/width_65k/average_l0_95 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 65536 | none | |
layer_11/width_65k/average_l0_200 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 65536 | none | |
layer_11/width_65k/average_l0_41 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 65536 | none | |
layer_11/width_65k/average_l0_436 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 65536 | none | |
layer_11/width_65k/average_l0_771 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 65536 | none | |
layer_11/width_65k/average_l0_88 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 65536 | none | |
layer_12/width_65k/average_l0_222 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 65536 | none | |
layer_12/width_65k/average_l0_44 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 65536 | none | |
layer_12/width_65k/average_l0_482 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 65536 | none | |
layer_12/width_65k/average_l0_848 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 65536 | none | |
layer_12/width_65k/average_l0_96 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 65536 | none | |
layer_13/width_65k/average_l0_228 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 65536 | none | |
layer_13/width_65k/average_l0_44 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 65536 | none | |
layer_13/width_65k/average_l0_480 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 65536 | none | |
layer_13/width_65k/average_l0_841 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 65536 | none | |
layer_13/width_65k/average_l0_98 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 65536 | none | |
layer_14/width_65k/average_l0_204 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 65536 | none | |
layer_14/width_65k/average_l0_39 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 65536 | none | |
layer_14/width_65k/average_l0_463 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 65536 | none | |
layer_14/width_65k/average_l0_816 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 65536 | none | |
layer_14/width_65k/average_l0_89 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 65536 | none | |
layer_15/width_65k/average_l0_164 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 65536 | none | |
layer_15/width_65k/average_l0_35 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 65536 | none | |
layer_15/width_65k/average_l0_405 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 65536 | none | |
layer_15/width_65k/average_l0_72 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 65536 | none | |
layer_15/width_65k/average_l0_754 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 65536 | none | |
layer_16/width_65k/average_l0_142 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 65536 | none | |
layer_16/width_65k/average_l0_32 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 65536 | none | |
layer_16/width_65k/average_l0_348 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 65536 | none | |
layer_16/width_65k/average_l0_66 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 65536 | none | |
layer_16/width_65k/average_l0_695 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 65536 | none | |
layer_17/width_65k/average_l0_136 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 65536 | none | |
layer_17/width_65k/average_l0_30 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 65536 | none | |
layer_17/width_65k/average_l0_342 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 65536 | none | |
layer_17/width_65k/average_l0_61 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 65536 | none | |
layer_17/width_65k/average_l0_666 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 65536 | none | |
layer_18/width_65k/average_l0_191 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 65536 | none | |
layer_18/width_65k/average_l0_24 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 65536 | none | |
layer_18/width_65k/average_l0_44 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 65536 | none | |
layer_18/width_65k/average_l0_491 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 65536 | none | |
layer_18/width_65k/average_l0_88 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 65536 | none | |
layer_19/width_65k/average_l0_192 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 65536 | none | |
layer_19/width_65k/average_l0_25 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 65536 | none | |
layer_19/width_65k/average_l0_45 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 65536 | none | |
layer_19/width_65k/average_l0_470 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 65536 | none | |
layer_19/width_65k/average_l0_88 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 65536 | none | |
layer_20/width_65k/average_l0_189 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 65536 | none | |
layer_20/width_65k/average_l0_23 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 65536 | none | |
layer_20/width_65k/average_l0_44 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 65536 | none | |
layer_20/width_65k/average_l0_446 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 65536 | none | |
layer_20/width_65k/average_l0_88 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 65536 | none | |
layer_21/width_65k/average_l0_192 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 65536 | none | |
layer_21/width_65k/average_l0_23 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 65536 | none | |
layer_21/width_65k/average_l0_42 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 65536 | none | |
layer_21/width_65k/average_l0_472 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 65536 | none | |
layer_21/width_65k/average_l0_86 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 65536 | none | |
layer_22/width_65k/average_l0_203 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 65536 | none | |
layer_22/width_65k/average_l0_23 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 65536 | none | |
layer_22/width_65k/average_l0_46 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 65536 | none | |
layer_22/width_65k/average_l0_487 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 65536 | none | |
layer_22/width_65k/average_l0_92 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 65536 | none | |
layer_23/width_65k/average_l0_102 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 65536 | none | |
layer_23/width_65k/average_l0_218 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 65536 | none | |
layer_23/width_65k/average_l0_25 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 65536 | none | |
layer_23/width_65k/average_l0_49 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 65536 | none | |
layer_23/width_65k/average_l0_497 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 65536 | none | |
layer_24/width_65k/average_l0_128 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 65536 | none | |
layer_24/width_65k/average_l0_18 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 65536 | none | |
layer_24/width_65k/average_l0_268 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 65536 | none | |
layer_24/width_65k/average_l0_32 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 65536 | none | |
layer_24/width_65k/average_l0_62 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 65536 | none | |
layer_25/width_65k/average_l0_107 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 65536 | none | |
layer_25/width_65k/average_l0_14 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 65536 | none | |
layer_25/width_65k/average_l0_215 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 65536 | none | |
layer_25/width_65k/average_l0_26 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 65536 | none | |
layer_25/width_65k/average_l0_52 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 65536 | none |
gemma-scope-2b-pt-mlp-canonical
- Huggingface Repo: google/gemma-scope-2b-pt-mlp
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/0-gemmascope-mlp-16k | blocks.0.hook_mlp_out | 16384 | none |
layer_1/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/1-gemmascope-mlp-16k | blocks.1.hook_mlp_out | 16384 | none |
layer_2/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/2-gemmascope-mlp-16k | blocks.2.hook_mlp_out | 16384 | none |
layer_3/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/3-gemmascope-mlp-16k | blocks.3.hook_mlp_out | 16384 | none |
layer_4/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/4-gemmascope-mlp-16k | blocks.4.hook_mlp_out | 16384 | none |
layer_5/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-mlp-16k | blocks.5.hook_mlp_out | 16384 | none |
layer_6/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/6-gemmascope-mlp-16k | blocks.6.hook_mlp_out | 16384 | none |
layer_7/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/7-gemmascope-mlp-16k | blocks.7.hook_mlp_out | 16384 | none |
layer_8/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/8-gemmascope-mlp-16k | blocks.8.hook_mlp_out | 16384 | none |
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/9-gemmascope-mlp-16k | blocks.9.hook_mlp_out | 16384 | none |
layer_10/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/10-gemmascope-mlp-16k | blocks.10.hook_mlp_out | 16384 | none |
layer_11/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/11-gemmascope-mlp-16k | blocks.11.hook_mlp_out | 16384 | none |
layer_12/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-mlp-16k | blocks.12.hook_mlp_out | 16384 | none |
layer_13/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/13-gemmascope-mlp-16k | blocks.13.hook_mlp_out | 16384 | none |
layer_14/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/14-gemmascope-mlp-16k | blocks.14.hook_mlp_out | 16384 | none |
layer_15/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/15-gemmascope-mlp-16k | blocks.15.hook_mlp_out | 16384 | none |
layer_16/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/16-gemmascope-mlp-16k | blocks.16.hook_mlp_out | 16384 | none |
layer_17/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/17-gemmascope-mlp-16k | blocks.17.hook_mlp_out | 16384 | none |
layer_18/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/18-gemmascope-mlp-16k | blocks.18.hook_mlp_out | 16384 | none |
layer_19/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-mlp-16k | blocks.19.hook_mlp_out | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/20-gemmascope-mlp-16k | blocks.20.hook_mlp_out | 16384 | none |
layer_21/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/21-gemmascope-mlp-16k | blocks.21.hook_mlp_out | 16384 | none |
layer_22/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/22-gemmascope-mlp-16k | blocks.22.hook_mlp_out | 16384 | none |
layer_23/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/23-gemmascope-mlp-16k | blocks.23.hook_mlp_out | 16384 | none |
layer_24/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/24-gemmascope-mlp-16k | blocks.24.hook_mlp_out | 16384 | none |
layer_25/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/25-gemmascope-mlp-16k | blocks.25.hook_mlp_out | 16384 | none |
layer_0/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/0-gemmascope-mlp-65k | blocks.0.hook_mlp_out | 65536 | none |
layer_1/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/1-gemmascope-mlp-65k | blocks.1.hook_mlp_out | 65536 | none |
layer_2/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/2-gemmascope-mlp-65k | blocks.2.hook_mlp_out | 65536 | none |
layer_3/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/3-gemmascope-mlp-65k | blocks.3.hook_mlp_out | 65536 | none |
layer_4/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/4-gemmascope-mlp-65k | blocks.4.hook_mlp_out | 65536 | none |
layer_5/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-mlp-65k | blocks.5.hook_mlp_out | 65536 | none |
layer_6/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/6-gemmascope-mlp-65k | blocks.6.hook_mlp_out | 65536 | none |
layer_7/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/7-gemmascope-mlp-65k | blocks.7.hook_mlp_out | 65536 | none |
layer_8/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/8-gemmascope-mlp-65k | blocks.8.hook_mlp_out | 65536 | none |
layer_9/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/9-gemmascope-mlp-65k | blocks.9.hook_mlp_out | 65536 | none |
layer_10/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/10-gemmascope-mlp-65k | blocks.10.hook_mlp_out | 65536 | none |
layer_11/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/11-gemmascope-mlp-65k | blocks.11.hook_mlp_out | 65536 | none |
layer_12/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-mlp-65k | blocks.12.hook_mlp_out | 65536 | none |
layer_13/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/13-gemmascope-mlp-65k | blocks.13.hook_mlp_out | 65536 | none |
layer_14/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/14-gemmascope-mlp-65k | blocks.14.hook_mlp_out | 65536 | none |
layer_15/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/15-gemmascope-mlp-65k | blocks.15.hook_mlp_out | 65536 | none |
layer_16/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/16-gemmascope-mlp-65k | blocks.16.hook_mlp_out | 65536 | none |
layer_17/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/17-gemmascope-mlp-65k | blocks.17.hook_mlp_out | 65536 | none |
layer_18/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/18-gemmascope-mlp-65k | blocks.18.hook_mlp_out | 65536 | none |
layer_19/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-mlp-65k | blocks.19.hook_mlp_out | 65536 | none |
layer_20/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/20-gemmascope-mlp-65k | blocks.20.hook_mlp_out | 65536 | none |
layer_21/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/21-gemmascope-mlp-65k | blocks.21.hook_mlp_out | 65536 | none |
layer_22/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/22-gemmascope-mlp-65k | blocks.22.hook_mlp_out | 65536 | none |
layer_23/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/23-gemmascope-mlp-65k | blocks.23.hook_mlp_out | 65536 | none |
layer_24/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/24-gemmascope-mlp-65k | blocks.24.hook_mlp_out | 65536 | none |
layer_25/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/25-gemmascope-mlp-65k | blocks.25.hook_mlp_out | 65536 | none |
gemma-scope-2b-pt-res
- Huggingface Repo: google/gemma-scope-2b-pt-res
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
embedding/width_4k/average_l0_6 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
embedding/width_4k/average_l0_44 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
embedding/width_4k/average_l0_21 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
embedding/width_4k/average_l0_111 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
layer_0/width_16k/average_l0_105 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_13 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_226 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_46 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_102 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_250 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_13 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_141 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_142 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_304 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_53 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_142 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_315 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_59 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_124 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_125 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_281 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_60 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_5/width_16k/average_l0_143 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-16k__l0-143 | blocks.5.hook_resid_post | 16384 | none |
layer_5/width_16k/average_l0_18 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-16k__l0-18 | blocks.5.hook_resid_post | 16384 | none |
layer_5/width_16k/average_l0_309 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-16k__l0-309 | blocks.5.hook_resid_post | 16384 | none |
layer_5/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-16k__l0-34 | blocks.5.hook_resid_post | 16384 | none |
layer_5/width_16k/average_l0_68 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_144 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_301 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_70 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_137 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_285 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_69 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_142 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_301 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_37 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_151 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_340 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_37 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_166 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_39 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_395 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_168 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_393 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_80 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_12/width_16k/average_l0_176 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-16k__l0-176 | blocks.12.hook_resid_post | 16384 | none |
layer_12/width_16k/average_l0_22 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-16k__l0-22 | blocks.12.hook_resid_post | 16384 | none |
layer_12/width_16k/average_l0_41 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-16k__l0-41 | blocks.12.hook_resid_post | 16384 | none |
layer_12/width_16k/average_l0_445 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-16k__l0-445 | blocks.12.hook_resid_post | 16384 | none |
layer_12/width_16k/average_l0_82 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_173 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_403 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_43 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_83 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_84 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_173 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_388 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_43 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_83 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_84 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_150 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_308 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_78 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_154 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_335 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_42 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_78 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_150 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_304 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_42 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_138 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_280 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_74 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_19/width_16k/average_l0_137 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-16k__l0-137 | blocks.19.hook_resid_post | 16384 | none |
layer_19/width_16k/average_l0_23 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-16k__l0-23 | blocks.19.hook_resid_post | 16384 | none |
layer_19/width_16k/average_l0_279 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-16k__l0-279 | blocks.19.hook_resid_post | 16384 | none |
layer_19/width_16k/average_l0_40 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-16k__l0-40 | blocks.19.hook_resid_post | 16384 | none |
layer_19/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_139 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_294 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_139 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_301 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_70 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_147 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_349 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_72 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_157 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_404 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_74 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_75 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_158 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_457 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_116 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_285 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_55 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_5/width_1m/average_l0_114 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m__l0-114 | blocks.5.hook_resid_post | 1048576 | none |
layer_5/width_1m/average_l0_13 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m__l0-13 | blocks.5.hook_resid_post | 1048576 | none |
layer_5/width_1m/average_l0_21 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m__l0-21 | blocks.5.hook_resid_post | 1048576 | none |
layer_5/width_1m/average_l0_36 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m__l0-36 | blocks.5.hook_resid_post | 1048576 | none |
layer_5/width_1m/average_l0_63 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m__l0-63 | blocks.5.hook_resid_post | 1048576 | none |
layer_5/width_1m/average_l0_9 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m__l0-9 | blocks.5.hook_resid_post | 1048576 | none |
layer_12/width_1m/average_l0_107 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 1048576 | none | |
layer_12/width_1m/average_l0_19 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-1m__l0-19 | blocks.12.hook_resid_post | 1048576 | none |
layer_12/width_1m/average_l0_207 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-1m__l0-207 | blocks.12.hook_resid_post | 1048576 | none |
layer_12/width_1m/average_l0_26 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-1m__l0-26 | blocks.12.hook_resid_post | 1048576 | none |
layer_12/width_1m/average_l0_58 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-1m__l0-58 | blocks.12.hook_resid_post | 1048576 | none |
layer_12/width_1m/average_l0_73 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-1m__l0-73 | blocks.12.hook_resid_post | 1048576 | none |
layer_19/width_1m/average_l0_157 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-1m__l0-157 | blocks.19.hook_resid_post | 1048576 | none |
layer_19/width_1m/average_l0_16 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-1m__l0-16 | blocks.19.hook_resid_post | 1048576 | none |
layer_19/width_1m/average_l0_18 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-1m__l0-18 | blocks.19.hook_resid_post | 1048576 | none |
layer_19/width_1m/average_l0_29 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-1m__l0-29 | blocks.19.hook_resid_post | 1048576 | none |
layer_19/width_1m/average_l0_50 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-1m__l0-50 | blocks.19.hook_resid_post | 1048576 | none |
layer_19/width_1m/average_l0_88 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 1048576 | none | |
layer_12/width_262k/average_l0_11 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 262144 | none | |
layer_12/width_262k/average_l0_121 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 262144 | none | |
layer_12/width_262k/average_l0_21 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 262144 | none | |
layer_12/width_262k/average_l0_243 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 262144 | none | |
layer_12/width_262k/average_l0_36 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 262144 | none | |
layer_12/width_262k/average_l0_67 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 262144 | none | |
layer_12/width_32k/average_l0_12 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
layer_12/width_32k/average_l0_155 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
layer_12/width_32k/average_l0_22 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
layer_12/width_32k/average_l0_360 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
layer_12/width_32k/average_l0_40 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
layer_12/width_32k/average_l0_76 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
layer_12/width_524k/average_l0_115 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 524288 | none | |
layer_12/width_524k/average_l0_22 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 524288 | none | |
layer_12/width_524k/average_l0_227 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 524288 | none | |
layer_12/width_524k/average_l0_29 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 524288 | none | |
layer_12/width_524k/average_l0_46 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 524288 | none | |
layer_12/width_524k/average_l0_65 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 524288 | none | |
layer_12/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_129 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_264 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_36 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_0/width_65k/average_l0_11 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 65536 | none | |
layer_0/width_65k/average_l0_17 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 65536 | none | |
layer_0/width_65k/average_l0_27 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 65536 | none | |
layer_0/width_65k/average_l0_43 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 65536 | none | |
layer_0/width_65k/average_l0_73 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 65536 | none | |
layer_1/width_65k/average_l0_121 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 65536 | none | |
layer_1/width_65k/average_l0_16 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 65536 | none | |
layer_1/width_65k/average_l0_30 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 65536 | none | |
layer_1/width_65k/average_l0_54 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 65536 | none | |
layer_1/width_65k/average_l0_9 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 65536 | none | |
layer_2/width_65k/average_l0_11 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 65536 | none | |
layer_2/width_65k/average_l0_169 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 65536 | none | |
layer_2/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 65536 | none | |
layer_2/width_65k/average_l0_37 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 65536 | none | |
layer_2/width_65k/average_l0_77 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 65536 | none | |
layer_3/width_65k/average_l0_13 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 65536 | none | |
layer_3/width_65k/average_l0_193 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 65536 | none | |
layer_3/width_65k/average_l0_23 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 65536 | none | |
layer_3/width_65k/average_l0_42 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 65536 | none | |
layer_3/width_65k/average_l0_89 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 65536 | none | |
layer_4/width_65k/average_l0_14 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 65536 | none | |
layer_4/width_65k/average_l0_177 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 65536 | none | |
layer_4/width_65k/average_l0_25 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 65536 | none | |
layer_4/width_65k/average_l0_46 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 65536 | none | |
layer_4/width_65k/average_l0_89 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 65536 | none | |
layer_5/width_65k/average_l0_105 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 65536 | none | |
layer_5/width_65k/average_l0_17 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-65k__l0-17 | blocks.5.hook_resid_post | 65536 | none |
layer_5/width_65k/average_l0_211 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-65k__l0-211 | blocks.5.hook_resid_post | 65536 | none |
layer_5/width_65k/average_l0_29 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-65k__l0-29 | blocks.5.hook_resid_post | 65536 | none |
layer_5/width_65k/average_l0_53 Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-65k__l0-53 | blocks.5.hook_resid_post | 65536 | none |
layer_6/width_65k/average_l0_107 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 65536 | none | |
layer_6/width_65k/average_l0_17 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 65536 | none | |
layer_6/width_65k/average_l0_208 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 65536 | none | |
layer_6/width_65k/average_l0_30 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 65536 | none | |
layer_6/width_65k/average_l0_56 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 65536 | none | |
layer_7/width_65k/average_l0_107 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 65536 | none | |
layer_7/width_65k/average_l0_18 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 65536 | none | |
layer_7/width_65k/average_l0_203 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 65536 | none | |
layer_7/width_65k/average_l0_31 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 65536 | none | |
layer_7/width_65k/average_l0_57 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 65536 | none | |
layer_8/width_65k/average_l0_111 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 65536 | none | |
layer_8/width_65k/average_l0_19 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 65536 | none | |
layer_8/width_65k/average_l0_213 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 65536 | none | |
layer_8/width_65k/average_l0_33 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 65536 | none | |
layer_8/width_65k/average_l0_59 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 65536 | none | |
layer_9/width_65k/average_l0_118 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 65536 | none | |
layer_9/width_65k/average_l0_19 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 65536 | none | |
layer_9/width_65k/average_l0_240 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 65536 | none | |
layer_9/width_65k/average_l0_34 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 65536 | none | |
layer_9/width_65k/average_l0_61 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 65536 | none | |
layer_10/width_65k/average_l0_128 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 65536 | none | |
layer_10/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 65536 | none | |
layer_10/width_65k/average_l0_265 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 65536 | none | |
layer_10/width_65k/average_l0_36 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 65536 | none | |
layer_10/width_65k/average_l0_66 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 65536 | none | |
layer_11/width_65k/average_l0_134 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 65536 | none | |
layer_11/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 65536 | none | |
layer_11/width_65k/average_l0_273 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 65536 | none | |
layer_11/width_65k/average_l0_37 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 65536 | none | |
layer_11/width_65k/average_l0_70 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 65536 | none | |
layer_12/width_65k/average_l0_141 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-65k__l0-141 | blocks.12.hook_resid_post | 65536 | none |
layer_12/width_65k/average_l0_21 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-65k__l0-21 | blocks.12.hook_resid_post | 65536 | none |
layer_12/width_65k/average_l0_297 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-65k__l0-297 | blocks.12.hook_resid_post | 65536 | none |
layer_12/width_65k/average_l0_38 Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-65k__l0-38 | blocks.12.hook_resid_post | 65536 | none |
layer_12/width_65k/average_l0_72 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 65536 | none | |
layer_13/width_65k/average_l0_142 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 65536 | none | |
layer_13/width_65k/average_l0_22 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 65536 | none | |
layer_13/width_65k/average_l0_288 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 65536 | none | |
layer_13/width_65k/average_l0_40 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 65536 | none | |
layer_13/width_65k/average_l0_74 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 65536 | none | |
layer_13/width_65k/average_l0_75 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 65536 | none | |
layer_14/width_65k/average_l0_144 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 65536 | none | |
layer_14/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 65536 | none | |
layer_14/width_65k/average_l0_284 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 65536 | none | |
layer_14/width_65k/average_l0_40 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 65536 | none | |
layer_14/width_65k/average_l0_73 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 65536 | none | |
layer_15/width_65k/average_l0_127 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 65536 | none | |
layer_15/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 65536 | none | |
layer_15/width_65k/average_l0_240 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 65536 | none | |
layer_15/width_65k/average_l0_38 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 65536 | none | |
layer_15/width_65k/average_l0_68 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 65536 | none | |
layer_16/width_65k/average_l0_128 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 65536 | none | |
layer_16/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 65536 | none | |
layer_16/width_65k/average_l0_244 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 65536 | none | |
layer_16/width_65k/average_l0_38 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 65536 | none | |
layer_16/width_65k/average_l0_69 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 65536 | none | |
layer_17/width_65k/average_l0_125 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 65536 | none | |
layer_17/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 65536 | none | |
layer_17/width_65k/average_l0_233 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 65536 | none | |
layer_17/width_65k/average_l0_38 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 65536 | none | |
layer_17/width_65k/average_l0_68 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 65536 | none | |
layer_18/width_65k/average_l0_116 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 65536 | none | |
layer_18/width_65k/average_l0_117 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 65536 | none | |
layer_18/width_65k/average_l0_21 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 65536 | none | |
layer_18/width_65k/average_l0_216 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 65536 | none | |
layer_18/width_65k/average_l0_36 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 65536 | none | |
layer_18/width_65k/average_l0_64 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 65536 | none | |
layer_19/width_65k/average_l0_115 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 65536 | none | |
layer_19/width_65k/average_l0_21 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-65k__l0-21 | blocks.19.hook_resid_post | 65536 | none |
layer_19/width_65k/average_l0_216 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-65k__l0-216 | blocks.19.hook_resid_post | 65536 | none |
layer_19/width_65k/average_l0_35 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-65k__l0-35 | blocks.19.hook_resid_post | 65536 | none |
layer_19/width_65k/average_l0_63 Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-65k__l0-63 | blocks.19.hook_resid_post | 65536 | none |
layer_20/width_65k/average_l0_114 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_20/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_20/width_65k/average_l0_221 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_20/width_65k/average_l0_34 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_20/width_65k/average_l0_61 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_21/width_65k/average_l0_111 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 65536 | none | |
layer_21/width_65k/average_l0_112 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 65536 | none | |
layer_21/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 65536 | none | |
layer_21/width_65k/average_l0_225 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 65536 | none | |
layer_21/width_65k/average_l0_33 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 65536 | none | |
layer_21/width_65k/average_l0_61 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 65536 | none | |
layer_22/width_65k/average_l0_116 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 65536 | none | |
layer_22/width_65k/average_l0_117 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 65536 | none | |
layer_22/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 65536 | none | |
layer_22/width_65k/average_l0_248 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 65536 | none | |
layer_22/width_65k/average_l0_33 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 65536 | none | |
layer_22/width_65k/average_l0_62 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 65536 | none | |
layer_23/width_65k/average_l0_123 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 65536 | none | |
layer_23/width_65k/average_l0_124 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 65536 | none | |
layer_23/width_65k/average_l0_20 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 65536 | none | |
layer_23/width_65k/average_l0_272 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 65536 | none | |
layer_23/width_65k/average_l0_35 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 65536 | none | |
layer_23/width_65k/average_l0_64 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 65536 | none | |
layer_24/width_65k/average_l0_124 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 65536 | none | |
layer_24/width_65k/average_l0_19 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 65536 | none | |
layer_24/width_65k/average_l0_273 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 65536 | none | |
layer_24/width_65k/average_l0_34 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 65536 | none | |
layer_24/width_65k/average_l0_63 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 65536 | none | |
layer_25/width_65k/average_l0_15 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 65536 | none | |
layer_25/width_65k/average_l0_197 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 65536 | none | |
layer_25/width_65k/average_l0_26 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 65536 | none | |
layer_25/width_65k/average_l0_48 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 65536 | none | |
layer_25/width_65k/average_l0_93 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 65536 | none |
gemma-scope-2b-pt-res-canonical
- Huggingface Repo: google/gemma-scope-2b-pt-res
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/0-gemmascope-res-16k | blocks.0.hook_resid_post | 16384 | none |
layer_1/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/1-gemmascope-res-16k | blocks.1.hook_resid_post | 16384 | none |
layer_2/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/2-gemmascope-res-16k | blocks.2.hook_resid_post | 16384 | none |
layer_3/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/3-gemmascope-res-16k | blocks.3.hook_resid_post | 16384 | none |
layer_4/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/4-gemmascope-res-16k | blocks.4.hook_resid_post | 16384 | none |
layer_5/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-16k | blocks.5.hook_resid_post | 16384 | none |
layer_6/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/6-gemmascope-res-16k | blocks.6.hook_resid_post | 16384 | none |
layer_7/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/7-gemmascope-res-16k | blocks.7.hook_resid_post | 16384 | none |
layer_8/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/8-gemmascope-res-16k | blocks.8.hook_resid_post | 16384 | none |
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/9-gemmascope-res-16k | blocks.9.hook_resid_post | 16384 | none |
layer_10/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/10-gemmascope-res-16k | blocks.10.hook_resid_post | 16384 | none |
layer_11/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/11-gemmascope-res-16k | blocks.11.hook_resid_post | 16384 | none |
layer_12/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-16k | blocks.12.hook_resid_post | 16384 | none |
layer_13/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/13-gemmascope-res-16k | blocks.13.hook_resid_post | 16384 | none |
layer_14/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/14-gemmascope-res-16k | blocks.14.hook_resid_post | 16384 | none |
layer_15/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/15-gemmascope-res-16k | blocks.15.hook_resid_post | 16384 | none |
layer_16/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/16-gemmascope-res-16k | blocks.16.hook_resid_post | 16384 | none |
layer_17/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/17-gemmascope-res-16k | blocks.17.hook_resid_post | 16384 | none |
layer_18/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/18-gemmascope-res-16k | blocks.18.hook_resid_post | 16384 | none |
layer_19/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-16k | blocks.19.hook_resid_post | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/20-gemmascope-res-16k | blocks.20.hook_resid_post | 16384 | none |
layer_21/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/21-gemmascope-res-16k | blocks.21.hook_resid_post | 16384 | none |
layer_22/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/22-gemmascope-res-16k | blocks.22.hook_resid_post | 16384 | none |
layer_23/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/23-gemmascope-res-16k | blocks.23.hook_resid_post | 16384 | none |
layer_24/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/24-gemmascope-res-16k | blocks.24.hook_resid_post | 16384 | none |
layer_25/width_16k/canonical Load this SAE |
jumprelu | gemma-2-2b/25-gemmascope-res-16k | blocks.25.hook_resid_post | 16384 | none |
layer_5/width_1m/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-1m | blocks.5.hook_resid_post | 1048576 | none |
layer_12/width_1m/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-1m | blocks.12.hook_resid_post | 1048576 | none |
layer_19/width_1m/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-1m | blocks.19.hook_resid_post | 1048576 | none |
layer_12/width_262k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-262k | blocks.12.hook_resid_post | 262144 | none |
layer_12/width_32k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-32k | blocks.12.hook_resid_post | 32768 | none |
layer_12/width_524k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-524k | blocks.12.hook_resid_post | 524288 | none |
layer_0/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/0-gemmascope-res-65k | blocks.0.hook_resid_post | 65536 | none |
layer_1/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/1-gemmascope-res-65k | blocks.1.hook_resid_post | 65536 | none |
layer_2/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/2-gemmascope-res-65k | blocks.2.hook_resid_post | 65536 | none |
layer_3/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/3-gemmascope-res-65k | blocks.3.hook_resid_post | 65536 | none |
layer_4/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/4-gemmascope-res-65k | blocks.4.hook_resid_post | 65536 | none |
layer_5/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/5-gemmascope-res-65k | blocks.5.hook_resid_post | 65536 | none |
layer_6/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/6-gemmascope-res-65k | blocks.6.hook_resid_post | 65536 | none |
layer_7/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/7-gemmascope-res-65k | blocks.7.hook_resid_post | 65536 | none |
layer_8/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/8-gemmascope-res-65k | blocks.8.hook_resid_post | 65536 | none |
layer_9/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/9-gemmascope-res-65k | blocks.9.hook_resid_post | 65536 | none |
layer_10/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/10-gemmascope-res-65k | blocks.10.hook_resid_post | 65536 | none |
layer_11/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/11-gemmascope-res-65k | blocks.11.hook_resid_post | 65536 | none |
layer_12/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/12-gemmascope-res-65k | blocks.12.hook_resid_post | 65536 | none |
layer_13/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/13-gemmascope-res-65k | blocks.13.hook_resid_post | 65536 | none |
layer_14/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/14-gemmascope-res-65k | blocks.14.hook_resid_post | 65536 | none |
layer_15/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/15-gemmascope-res-65k | blocks.15.hook_resid_post | 65536 | none |
layer_16/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/16-gemmascope-res-65k | blocks.16.hook_resid_post | 65536 | none |
layer_17/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/17-gemmascope-res-65k | blocks.17.hook_resid_post | 65536 | none |
layer_18/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/18-gemmascope-res-65k | blocks.18.hook_resid_post | 65536 | none |
layer_19/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/19-gemmascope-res-65k | blocks.19.hook_resid_post | 65536 | none |
layer_20/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/20-gemmascope-res-65k | blocks.20.hook_resid_post | 65536 | none |
layer_21/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/21-gemmascope-res-65k | blocks.21.hook_resid_post | 65536 | none |
layer_22/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/22-gemmascope-res-65k | blocks.22.hook_resid_post | 65536 | none |
layer_23/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/23-gemmascope-res-65k | blocks.23.hook_resid_post | 65536 | none |
layer_24/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/24-gemmascope-res-65k | blocks.24.hook_resid_post | 65536 | none |
layer_25/width_65k/canonical Load this SAE |
jumprelu | gemma-2-2b/25-gemmascope-res-65k | blocks.25.hook_resid_post | 65536 | none |
gemma-scope-9b-it-res
- Huggingface Repo: google/gemma-scope-9b-it-res
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_20/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 131072 | none | |
layer_20/width_131k/average_l0_153 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 131072 | none | |
layer_20/width_131k/average_l0_24 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 131072 | none | |
layer_20/width_131k/average_l0_43 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 131072 | none | |
layer_20/width_131k/average_l0_81 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 131072 | none | |
layer_20/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_189 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_47 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_16k/average_l0_91 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_31/width_131k/average_l0_109 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 131072 | none | |
layer_31/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 131072 | none | |
layer_31/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 131072 | none | |
layer_31/width_131k/average_l0_37 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 131072 | none | |
layer_31/width_131k/average_l0_63 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 131072 | none | |
layer_31/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 16384 | none | |
layer_31/width_16k/average_l0_142 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 16384 | none | |
layer_31/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 16384 | none | |
layer_31/width_16k/average_l0_43 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 16384 | none | |
layer_31/width_16k/average_l0_76 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 16384 | none | |
layer_9/width_131k/average_l0_121 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 131072 | none | |
layer_9/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 131072 | none | |
layer_9/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 131072 | none | |
layer_9/width_131k/average_l0_39 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 131072 | none | |
layer_9/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 131072 | none | |
layer_9/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_186 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_47 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_88 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none |
gemma-scope-9b-it-res-canonical
- Huggingface Repo: google/gemma-scope-9b-it-res
- model: gemma-2-9b-it
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b-it/9-gemmascope-res-16k | blocks.9.hook_resid_post | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b-it/20-gemmascope-res-16k | blocks.20.hook_resid_post | 16384 | none |
layer_31/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b-it/31-gemmascope-res-16k | blocks.31.hook_resid_post | 16384 | none |
layer_9/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b-it/9-gemmascope-res-131k | blocks.9.hook_resid_post | 131072 | none |
layer_20/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b-it/20-gemmascope-res-131k | blocks.20.hook_resid_post | 131072 | none |
layer_31/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b-it/31-gemmascope-res-131k | blocks.31.hook_resid_post | 131072 | none |
gemma-scope-9b-pt-att
- Huggingface Repo: google/gemma-scope-9b-pt-att
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 16384 | none | |
layer_0/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 131072 | none | |
layer_0/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 131072 | none | |
layer_0/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 131072 | none | |
layer_0/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 131072 | none | |
layer_0/width_131k/average_l0_33 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 131072 | none | |
layer_0/width_131k/average_l0_55 Load this SAE |
jumprelu | blocks.0.attn.hook_z | 131072 | none | |
layer_1/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_34 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_147 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_16k/average_l0_266 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 16384 | none | |
layer_1/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 131072 | none | |
layer_1/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 131072 | none | |
layer_1/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 131072 | none | |
layer_1/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 131072 | none | |
layer_1/width_131k/average_l0_63 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 131072 | none | |
layer_1/width_131k/average_l0_116 Load this SAE |
jumprelu | blocks.1.attn.hook_z | 131072 | none | |
layer_10/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_33 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_63 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_132 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_16k/average_l0_301 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 16384 | none | |
layer_10/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 131072 | none | |
layer_10/width_131k/average_l0_28 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 131072 | none | |
layer_10/width_131k/average_l0_51 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 131072 | none | |
layer_10/width_131k/average_l0_97 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 131072 | none | |
layer_10/width_131k/average_l0_199 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 131072 | none | |
layer_10/width_131k/average_l0_440 Load this SAE |
jumprelu | blocks.10.attn.hook_z | 131072 | none | |
layer_11/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_34 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_67 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_153 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_16k/average_l0_366 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 16384 | none | |
layer_11/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 131072 | none | |
layer_11/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 131072 | none | |
layer_11/width_131k/average_l0_54 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 131072 | none | |
layer_11/width_131k/average_l0_104 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 131072 | none | |
layer_11/width_131k/average_l0_241 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 131072 | none | |
layer_11/width_131k/average_l0_552 Load this SAE |
jumprelu | blocks.11.attn.hook_z | 131072 | none | |
layer_12/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_35 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_68 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_149 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_337 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_16k/average_l0_654 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 16384 | none | |
layer_12/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 131072 | none | |
layer_12/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 131072 | none | |
layer_12/width_131k/average_l0_55 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 131072 | none | |
layer_12/width_131k/average_l0_110 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 131072 | none | |
layer_12/width_131k/average_l0_237 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 131072 | none | |
layer_12/width_131k/average_l0_525 Load this SAE |
jumprelu | blocks.12.attn.hook_z | 131072 | none | |
layer_13/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_170 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_380 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_16k/average_l0_675 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 16384 | none | |
layer_13/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 131072 | none | |
layer_13/width_131k/average_l0_33 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 131072 | none | |
layer_13/width_131k/average_l0_64 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 131072 | none | |
layer_13/width_131k/average_l0_126 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 131072 | none | |
layer_13/width_131k/average_l0_283 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 131072 | none | |
layer_13/width_131k/average_l0_611 Load this SAE |
jumprelu | blocks.13.attn.hook_z | 131072 | none | |
layer_14/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_81 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_179 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_411 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_16k/average_l0_767 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 16384 | none | |
layer_14/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 131072 | none | |
layer_14/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 131072 | none | |
layer_14/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 131072 | none | |
layer_14/width_131k/average_l0_131 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 131072 | none | |
layer_14/width_131k/average_l0_306 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 131072 | none | |
layer_14/width_131k/average_l0_650 Load this SAE |
jumprelu | blocks.14.attn.hook_z | 131072 | none | |
layer_15/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_79 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_168 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_344 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_16k/average_l0_638 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 16384 | none | |
layer_15/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 131072 | none | |
layer_15/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 131072 | none | |
layer_15/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 131072 | none | |
layer_15/width_131k/average_l0_130 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 131072 | none | |
layer_15/width_131k/average_l0_283 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 131072 | none | |
layer_15/width_131k/average_l0_540 Load this SAE |
jumprelu | blocks.15.attn.hook_z | 131072 | none | |
layer_16/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_81 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_172 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_376 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_16k/average_l0_705 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 16384 | none | |
layer_16/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 131072 | none | |
layer_16/width_131k/average_l0_36 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 131072 | none | |
layer_16/width_131k/average_l0_71 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 131072 | none | |
layer_16/width_131k/average_l0_140 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 131072 | none | |
layer_16/width_131k/average_l0_298 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 131072 | none | |
layer_16/width_131k/average_l0_621 Load this SAE |
jumprelu | blocks.16.attn.hook_z | 131072 | none | |
layer_17/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_50 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_110 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_227 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_435 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_16k/average_l0_719 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 16384 | none | |
layer_17/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 131072 | none | |
layer_17/width_131k/average_l0_44 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 131072 | none | |
layer_17/width_131k/average_l0_90 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 131072 | none | |
layer_17/width_131k/average_l0_191 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 131072 | none | |
layer_17/width_131k/average_l0_380 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 131072 | none | |
layer_17/width_131k/average_l0_672 Load this SAE |
jumprelu | blocks.17.attn.hook_z | 131072 | none | |
layer_18/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_80 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_171 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_352 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_16k/average_l0_646 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 16384 | none | |
layer_18/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 131072 | none | |
layer_18/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 131072 | none | |
layer_18/width_131k/average_l0_69 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 131072 | none | |
layer_18/width_131k/average_l0_133 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 131072 | none | |
layer_18/width_131k/average_l0_294 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 131072 | none | |
layer_18/width_131k/average_l0_557 Load this SAE |
jumprelu | blocks.18.attn.hook_z | 131072 | none | |
layer_19/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_86 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_186 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_360 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_16k/average_l0_661 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 16384 | none | |
layer_19/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 131072 | none | |
layer_19/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 131072 | none | |
layer_19/width_131k/average_l0_71 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 131072 | none | |
layer_19/width_131k/average_l0_152 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 131072 | none | |
layer_19/width_131k/average_l0_307 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 131072 | none | |
layer_19/width_131k/average_l0_571 Load this SAE |
jumprelu | blocks.19.attn.hook_z | 131072 | none | |
layer_2/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_69 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_180 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_16k/average_l0_384 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 16384 | none | |
layer_2/width_131k/average_l0_7 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 131072 | none | |
layer_2/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 131072 | none | |
layer_2/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 131072 | none | |
layer_2/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 131072 | none | |
layer_2/width_131k/average_l0_62 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 131072 | none | |
layer_2/width_131k/average_l0_135 Load this SAE |
jumprelu | blocks.2.attn.hook_z | 131072 | none | |
layer_20/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_39 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_76 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_158 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_342 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_16k/average_l0_674 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 16384 | none | |
layer_20/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 131072 | none | |
layer_20/width_131k/average_l0_34 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 131072 | none | |
layer_20/width_131k/average_l0_65 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 131072 | none | |
layer_20/width_131k/average_l0_125 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 131072 | none | |
layer_20/width_131k/average_l0_270 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 131072 | none | |
layer_20/width_131k/average_l0_558 Load this SAE |
jumprelu | blocks.20.attn.hook_z | 131072 | none | |
layer_21/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_86 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_195 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_420 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_16k/average_l0_792 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 16384 | none | |
layer_21/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 131072 | none | |
layer_21/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 131072 | none | |
layer_21/width_131k/average_l0_71 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 131072 | none | |
layer_21/width_131k/average_l0_150 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 131072 | none | |
layer_21/width_131k/average_l0_333 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 131072 | none | |
layer_21/width_131k/average_l0_665 Load this SAE |
jumprelu | blocks.21.attn.hook_z | 131072 | none | |
layer_22/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_70 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_141 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_289 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_16k/average_l0_569 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 16384 | none | |
layer_22/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 131072 | none | |
layer_22/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 131072 | none | |
layer_22/width_131k/average_l0_59 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 131072 | none | |
layer_22/width_131k/average_l0_115 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 131072 | none | |
layer_22/width_131k/average_l0_231 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 131072 | none | |
layer_22/width_131k/average_l0_446 Load this SAE |
jumprelu | blocks.22.attn.hook_z | 131072 | none | |
layer_23/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_41 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_80 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_173 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_356 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_16k/average_l0_649 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 16384 | none | |
layer_23/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 131072 | none | |
layer_23/width_131k/average_l0_36 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 131072 | none | |
layer_23/width_131k/average_l0_66 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 131072 | none | |
layer_23/width_131k/average_l0_134 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 131072 | none | |
layer_23/width_131k/average_l0_288 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 131072 | none | |
layer_23/width_131k/average_l0_568 Load this SAE |
jumprelu | blocks.23.attn.hook_z | 131072 | none | |
layer_24/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_79 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_167 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_348 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_16k/average_l0_615 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 16384 | none | |
layer_24/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 131072 | none | |
layer_24/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 131072 | none | |
layer_24/width_131k/average_l0_66 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 131072 | none | |
layer_24/width_131k/average_l0_130 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 131072 | none | |
layer_24/width_131k/average_l0_273 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 131072 | none | |
layer_24/width_131k/average_l0_542 Load this SAE |
jumprelu | blocks.24.attn.hook_z | 131072 | none | |
layer_25/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_156 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_371 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_16k/average_l0_686 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 16384 | none | |
layer_25/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 131072 | none | |
layer_25/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 131072 | none | |
layer_25/width_131k/average_l0_59 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 131072 | none | |
layer_25/width_131k/average_l0_115 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 131072 | none | |
layer_25/width_131k/average_l0_261 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 131072 | none | |
layer_25/width_131k/average_l0_605 Load this SAE |
jumprelu | blocks.25.attn.hook_z | 131072 | none | |
layer_26/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 16384 | none | |
layer_26/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 16384 | none | |
layer_26/width_16k/average_l0_75 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 16384 | none | |
layer_26/width_16k/average_l0_159 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 16384 | none | |
layer_26/width_16k/average_l0_336 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 16384 | none | |
layer_26/width_16k/average_l0_634 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 16384 | none | |
layer_26/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 131072 | none | |
layer_26/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 131072 | none | |
layer_26/width_131k/average_l0_62 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 131072 | none | |
layer_26/width_131k/average_l0_120 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 131072 | none | |
layer_26/width_131k/average_l0_267 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 131072 | none | |
layer_26/width_131k/average_l0_525 Load this SAE |
jumprelu | blocks.26.attn.hook_z | 131072 | none | |
layer_27/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 16384 | none | |
layer_27/width_16k/average_l0_33 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 16384 | none | |
layer_27/width_16k/average_l0_64 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 16384 | none | |
layer_27/width_16k/average_l0_136 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 16384 | none | |
layer_27/width_16k/average_l0_306 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 16384 | none | |
layer_27/width_16k/average_l0_613 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 16384 | none | |
layer_27/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 131072 | none | |
layer_27/width_131k/average_l0_28 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 131072 | none | |
layer_27/width_131k/average_l0_53 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 131072 | none | |
layer_27/width_131k/average_l0_102 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 131072 | none | |
layer_27/width_131k/average_l0_211 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 131072 | none | |
layer_27/width_131k/average_l0_458 Load this SAE |
jumprelu | blocks.27.attn.hook_z | 131072 | none | |
layer_28/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 16384 | none | |
layer_28/width_16k/average_l0_37 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 16384 | none | |
layer_28/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 16384 | none | |
layer_28/width_16k/average_l0_143 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 16384 | none | |
layer_28/width_16k/average_l0_279 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 16384 | none | |
layer_28/width_16k/average_l0_498 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 16384 | none | |
layer_28/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 131072 | none | |
layer_28/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 131072 | none | |
layer_28/width_131k/average_l0_59 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 131072 | none | |
layer_28/width_131k/average_l0_115 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 131072 | none | |
layer_28/width_131k/average_l0_230 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 131072 | none | |
layer_28/width_131k/average_l0_452 Load this SAE |
jumprelu | blocks.28.attn.hook_z | 131072 | none | |
layer_29/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 16384 | none | |
layer_29/width_16k/average_l0_35 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 16384 | none | |
layer_29/width_16k/average_l0_76 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 16384 | none | |
layer_29/width_16k/average_l0_171 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 16384 | none | |
layer_29/width_16k/average_l0_308 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 16384 | none | |
layer_29/width_16k/average_l0_559 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 16384 | none | |
layer_29/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 131072 | none | |
layer_29/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 131072 | none | |
layer_29/width_131k/average_l0_57 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 131072 | none | |
layer_29/width_131k/average_l0_128 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 131072 | none | |
layer_29/width_131k/average_l0_265 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 131072 | none | |
layer_29/width_131k/average_l0_446 Load this SAE |
jumprelu | blocks.29.attn.hook_z | 131072 | none | |
layer_3/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_44 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_102 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_221 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_16k/average_l0_435 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 16384 | none | |
layer_3/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 131072 | none | |
layer_3/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 131072 | none | |
layer_3/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 131072 | none | |
layer_3/width_131k/average_l0_58 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 131072 | none | |
layer_3/width_131k/average_l0_119 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 131072 | none | |
layer_3/width_131k/average_l0_252 Load this SAE |
jumprelu | blocks.3.attn.hook_z | 131072 | none | |
layer_30/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 16384 | none | |
layer_30/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 16384 | none | |
layer_30/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 16384 | none | |
layer_30/width_16k/average_l0_157 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 16384 | none | |
layer_30/width_16k/average_l0_313 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 16384 | none | |
layer_30/width_16k/average_l0_558 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 16384 | none | |
layer_30/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 131072 | none | |
layer_30/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 131072 | none | |
layer_30/width_131k/average_l0_55 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 131072 | none | |
layer_30/width_131k/average_l0_109 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 131072 | none | |
layer_30/width_131k/average_l0_236 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 131072 | none | |
layer_30/width_131k/average_l0_491 Load this SAE |
jumprelu | blocks.30.attn.hook_z | 131072 | none | |
layer_31/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 16384 | none | |
layer_31/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 16384 | none | |
layer_31/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 16384 | none | |
layer_31/width_16k/average_l0_168 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 16384 | none | |
layer_31/width_16k/average_l0_356 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 16384 | none | |
layer_31/width_16k/average_l0_630 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 16384 | none | |
layer_31/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 131072 | none | |
layer_31/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 131072 | none | |
layer_31/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 131072 | none | |
layer_31/width_131k/average_l0_117 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 131072 | none | |
layer_31/width_131k/average_l0_265 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 131072 | none | |
layer_31/width_131k/average_l0_543 Load this SAE |
jumprelu | blocks.31.attn.hook_z | 131072 | none | |
layer_32/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 16384 | none | |
layer_32/width_16k/average_l0_35 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 16384 | none | |
layer_32/width_16k/average_l0_74 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 16384 | none | |
layer_32/width_16k/average_l0_158 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 16384 | none | |
layer_32/width_16k/average_l0_306 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 16384 | none | |
layer_32/width_16k/average_l0_534 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 16384 | none | |
layer_32/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 131072 | none | |
layer_32/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 131072 | none | |
layer_32/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 131072 | none | |
layer_32/width_131k/average_l0_117 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 131072 | none | |
layer_32/width_131k/average_l0_248 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 131072 | none | |
layer_32/width_131k/average_l0_464 Load this SAE |
jumprelu | blocks.32.attn.hook_z | 131072 | none | |
layer_33/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 16384 | none | |
layer_33/width_16k/average_l0_37 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 16384 | none | |
layer_33/width_16k/average_l0_78 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 16384 | none | |
layer_33/width_16k/average_l0_158 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 16384 | none | |
layer_33/width_16k/average_l0_318 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 16384 | none | |
layer_33/width_16k/average_l0_531 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 16384 | none | |
layer_33/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 131072 | none | |
layer_33/width_131k/average_l0_28 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 131072 | none | |
layer_33/width_131k/average_l0_58 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 131072 | none | |
layer_33/width_131k/average_l0_128 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 131072 | none | |
layer_33/width_131k/average_l0_248 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 131072 | none | |
layer_33/width_131k/average_l0_471 Load this SAE |
jumprelu | blocks.33.attn.hook_z | 131072 | none | |
layer_34/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 16384 | none | |
layer_34/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 16384 | none | |
layer_34/width_16k/average_l0_91 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 16384 | none | |
layer_34/width_16k/average_l0_192 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 16384 | none | |
layer_34/width_16k/average_l0_339 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 16384 | none | |
layer_34/width_16k/average_l0_527 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 16384 | none | |
layer_34/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 131072 | none | |
layer_34/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 131072 | none | |
layer_34/width_131k/average_l0_63 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 131072 | none | |
layer_34/width_131k/average_l0_199 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 131072 | none | |
layer_34/width_131k/average_l0_291 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 131072 | none | |
layer_34/width_131k/average_l0_483 Load this SAE |
jumprelu | blocks.34.attn.hook_z | 131072 | none | |
layer_35/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 16384 | none | |
layer_35/width_16k/average_l0_33 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 16384 | none | |
layer_35/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 16384 | none | |
layer_35/width_16k/average_l0_168 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 16384 | none | |
layer_35/width_16k/average_l0_303 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 16384 | none | |
layer_35/width_16k/average_l0_488 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 16384 | none | |
layer_35/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 131072 | none | |
layer_35/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 131072 | none | |
layer_35/width_131k/average_l0_54 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 131072 | none | |
layer_35/width_131k/average_l0_124 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 131072 | none | |
layer_35/width_131k/average_l0_258 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 131072 | none | |
layer_35/width_131k/average_l0_427 Load this SAE |
jumprelu | blocks.35.attn.hook_z | 131072 | none | |
layer_36/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 16384 | none | |
layer_36/width_16k/average_l0_32 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 16384 | none | |
layer_36/width_16k/average_l0_69 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 16384 | none | |
layer_36/width_16k/average_l0_144 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 16384 | none | |
layer_36/width_16k/average_l0_293 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 16384 | none | |
layer_36/width_16k/average_l0_544 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 16384 | none | |
layer_36/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 131072 | none | |
layer_36/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 131072 | none | |
layer_36/width_131k/average_l0_51 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 131072 | none | |
layer_36/width_131k/average_l0_105 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 131072 | none | |
layer_36/width_131k/average_l0_229 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 131072 | none | |
layer_36/width_131k/average_l0_455 Load this SAE |
jumprelu | blocks.36.attn.hook_z | 131072 | none | |
layer_37/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 16384 | none | |
layer_37/width_16k/average_l0_34 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 16384 | none | |
layer_37/width_16k/average_l0_82 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 16384 | none | |
layer_37/width_16k/average_l0_172 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 16384 | none | |
layer_37/width_16k/average_l0_309 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 16384 | none | |
layer_37/width_16k/average_l0_519 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 16384 | none | |
layer_37/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 131072 | none | |
layer_37/width_131k/average_l0_28 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 131072 | none | |
layer_37/width_131k/average_l0_55 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 131072 | none | |
layer_37/width_131k/average_l0_124 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 131072 | none | |
layer_37/width_131k/average_l0_248 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 131072 | none | |
layer_37/width_131k/average_l0_450 Load this SAE |
jumprelu | blocks.37.attn.hook_z | 131072 | none | |
layer_38/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 16384 | none | |
layer_38/width_16k/average_l0_36 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 16384 | none | |
layer_38/width_16k/average_l0_81 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 16384 | none | |
layer_38/width_16k/average_l0_175 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 16384 | none | |
layer_38/width_16k/average_l0_334 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 16384 | none | |
layer_38/width_16k/average_l0_547 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 16384 | none | |
layer_38/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 131072 | none | |
layer_38/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 131072 | none | |
layer_38/width_131k/average_l0_60 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 131072 | none | |
layer_38/width_131k/average_l0_135 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 131072 | none | |
layer_38/width_131k/average_l0_284 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 131072 | none | |
layer_38/width_131k/average_l0_489 Load this SAE |
jumprelu | blocks.38.attn.hook_z | 131072 | none | |
layer_39/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 16384 | none | |
layer_39/width_16k/average_l0_33 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 16384 | none | |
layer_39/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 16384 | none | |
layer_39/width_16k/average_l0_176 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 16384 | none | |
layer_39/width_16k/average_l0_391 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 16384 | none | |
layer_39/width_16k/average_l0_694 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 16384 | none | |
layer_39/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 131072 | none | |
layer_39/width_131k/average_l0_27 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 131072 | none | |
layer_39/width_131k/average_l0_54 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 131072 | none | |
layer_39/width_131k/average_l0_120 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 131072 | none | |
layer_39/width_131k/average_l0_273 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 131072 | none | |
layer_39/width_131k/average_l0_604 Load this SAE |
jumprelu | blocks.39.attn.hook_z | 131072 | none | |
layer_4/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_54 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_126 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_274 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_16k/average_l0_524 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 16384 | none | |
layer_4/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 131072 | none | |
layer_4/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 131072 | none | |
layer_4/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 131072 | none | |
layer_4/width_131k/average_l0_75 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 131072 | none | |
layer_4/width_131k/average_l0_163 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 131072 | none | |
layer_4/width_131k/average_l0_330 Load this SAE |
jumprelu | blocks.4.attn.hook_z | 131072 | none | |
layer_40/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 16384 | none | |
layer_40/width_16k/average_l0_38 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 16384 | none | |
layer_40/width_16k/average_l0_91 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 16384 | none | |
layer_40/width_16k/average_l0_189 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 16384 | none | |
layer_40/width_16k/average_l0_341 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 16384 | none | |
layer_40/width_16k/average_l0_603 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 16384 | none | |
layer_40/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 131072 | none | |
layer_40/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 131072 | none | |
layer_40/width_131k/average_l0_64 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 131072 | none | |
layer_40/width_131k/average_l0_144 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 131072 | none | |
layer_40/width_131k/average_l0_269 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 131072 | none | |
layer_40/width_131k/average_l0_493 Load this SAE |
jumprelu | blocks.40.attn.hook_z | 131072 | none | |
layer_41/width_16k/average_l0_13 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 16384 | none | |
layer_41/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 16384 | none | |
layer_41/width_16k/average_l0_56 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 16384 | none | |
layer_41/width_16k/average_l0_129 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 16384 | none | |
layer_41/width_16k/average_l0_254 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 16384 | none | |
layer_41/width_16k/average_l0_450 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 16384 | none | |
layer_41/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 131072 | none | |
layer_41/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 131072 | none | |
layer_41/width_131k/average_l0_43 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 131072 | none | |
layer_41/width_131k/average_l0_92 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 131072 | none | |
layer_41/width_131k/average_l0_202 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 131072 | none | |
layer_41/width_131k/average_l0_370 Load this SAE |
jumprelu | blocks.41.attn.hook_z | 131072 | none | |
layer_5/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_53 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_125 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_270 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_16k/average_l0_529 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 16384 | none | |
layer_5/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 131072 | none | |
layer_5/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 131072 | none | |
layer_5/width_131k/average_l0_39 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 131072 | none | |
layer_5/width_131k/average_l0_78 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 131072 | none | |
layer_5/width_131k/average_l0_160 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 131072 | none | |
layer_5/width_131k/average_l0_351 Load this SAE |
jumprelu | blocks.5.attn.hook_z | 131072 | none | |
layer_6/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_51 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_108 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_16k/average_l0_258 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 16384 | none | |
layer_6/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 131072 | none | |
layer_6/width_131k/average_l0_24 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 131072 | none | |
layer_6/width_131k/average_l0_41 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 131072 | none | |
layer_6/width_131k/average_l0_73 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 131072 | none | |
layer_6/width_131k/average_l0_148 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 131072 | none | |
layer_6/width_131k/average_l0_353 Load this SAE |
jumprelu | blocks.6.attn.hook_z | 131072 | none | |
layer_7/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_33 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_70 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_160 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_16k/average_l0_335 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 16384 | none | |
layer_7/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 131072 | none | |
layer_7/width_131k/average_l0_28 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 131072 | none | |
layer_7/width_131k/average_l0_52 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 131072 | none | |
layer_7/width_131k/average_l0_106 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 131072 | none | |
layer_7/width_131k/average_l0_229 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 131072 | none | |
layer_7/width_131k/average_l0_473 Load this SAE |
jumprelu | blocks.7.attn.hook_z | 131072 | none | |
layer_8/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_32 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_150 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_16k/average_l0_362 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 16384 | none | |
layer_8/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 131072 | none | |
layer_8/width_131k/average_l0_27 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 131072 | none | |
layer_8/width_131k/average_l0_51 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 131072 | none | |
layer_8/width_131k/average_l0_98 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 131072 | none | |
layer_8/width_131k/average_l0_222 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 131072 | none | |
layer_8/width_131k/average_l0_531 Load this SAE |
jumprelu | blocks.8.attn.hook_z | 131072 | none | |
layer_9/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_34 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_172 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_16k/average_l0_349 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 16384 | none | |
layer_9/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 131072 | none | |
layer_9/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 131072 | none | |
layer_9/width_131k/average_l0_54 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 131072 | none | |
layer_9/width_131k/average_l0_111 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 131072 | none | |
layer_9/width_131k/average_l0_263 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 131072 | none | |
layer_9/width_131k/average_l0_511 Load this SAE |
jumprelu | blocks.9.attn.hook_z | 131072 | none |
gemma-scope-9b-pt-att-canonical
- Huggingface Repo: google/gemma-scope-9b-pt-att
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-att-16k | blocks.0.attn.hook_z | 16384 | none |
layer_1/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-att-16k | blocks.1.attn.hook_z | 16384 | none |
layer_2/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-att-16k | blocks.2.attn.hook_z | 16384 | none |
layer_3/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-att-16k | blocks.3.attn.hook_z | 16384 | none |
layer_4/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-att-16k | blocks.4.attn.hook_z | 16384 | none |
layer_5/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-att-16k | blocks.5.attn.hook_z | 16384 | none |
layer_6/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-att-16k | blocks.6.attn.hook_z | 16384 | none |
layer_7/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-att-16k | blocks.7.attn.hook_z | 16384 | none |
layer_8/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-att-16k | blocks.8.attn.hook_z | 16384 | none |
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-att-16k | blocks.9.attn.hook_z | 16384 | none |
layer_10/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-att-16k | blocks.10.attn.hook_z | 16384 | none |
layer_11/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-att-16k | blocks.11.attn.hook_z | 16384 | none |
layer_12/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-att-16k | blocks.12.attn.hook_z | 16384 | none |
layer_13/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-att-16k | blocks.13.attn.hook_z | 16384 | none |
layer_14/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-att-16k | blocks.14.attn.hook_z | 16384 | none |
layer_15/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-att-16k | blocks.15.attn.hook_z | 16384 | none |
layer_16/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-att-16k | blocks.16.attn.hook_z | 16384 | none |
layer_17/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-att-16k | blocks.17.attn.hook_z | 16384 | none |
layer_18/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-att-16k | blocks.18.attn.hook_z | 16384 | none |
layer_19/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-att-16k | blocks.19.attn.hook_z | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-att-16k | blocks.20.attn.hook_z | 16384 | none |
layer_21/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-att-16k | blocks.21.attn.hook_z | 16384 | none |
layer_22/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-att-16k | blocks.22.attn.hook_z | 16384 | none |
layer_23/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-att-16k | blocks.23.attn.hook_z | 16384 | none |
layer_24/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-att-16k | blocks.24.attn.hook_z | 16384 | none |
layer_25/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-att-16k | blocks.25.attn.hook_z | 16384 | none |
layer_26/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-att-16k | blocks.26.attn.hook_z | 16384 | none |
layer_27/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-att-16k | blocks.27.attn.hook_z | 16384 | none |
layer_28/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-att-16k | blocks.28.attn.hook_z | 16384 | none |
layer_29/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-att-16k | blocks.29.attn.hook_z | 16384 | none |
layer_30/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-att-16k | blocks.30.attn.hook_z | 16384 | none |
layer_31/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-att-16k | blocks.31.attn.hook_z | 16384 | none |
layer_32/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-att-16k | blocks.32.attn.hook_z | 16384 | none |
layer_33/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-att-16k | blocks.33.attn.hook_z | 16384 | none |
layer_34/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-att-16k | blocks.34.attn.hook_z | 16384 | none |
layer_35/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-att-16k | blocks.35.attn.hook_z | 16384 | none |
layer_36/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-att-16k | blocks.36.attn.hook_z | 16384 | none |
layer_37/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-att-16k | blocks.37.attn.hook_z | 16384 | none |
layer_38/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-att-16k | blocks.38.attn.hook_z | 16384 | none |
layer_39/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-att-16k | blocks.39.attn.hook_z | 16384 | none |
layer_40/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-att-16k | blocks.40.attn.hook_z | 16384 | none |
layer_41/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-att-16k | blocks.41.attn.hook_z | 16384 | none |
layer_0/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-att-131k | blocks.0.attn.hook_z | 131072 | none |
layer_1/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-att-131k | blocks.1.attn.hook_z | 131072 | none |
layer_2/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-att-131k | blocks.2.attn.hook_z | 131072 | none |
layer_3/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-att-131k | blocks.3.attn.hook_z | 131072 | none |
layer_4/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-att-131k | blocks.4.attn.hook_z | 131072 | none |
layer_5/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-att-131k | blocks.5.attn.hook_z | 131072 | none |
layer_6/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-att-131k | blocks.6.attn.hook_z | 131072 | none |
layer_7/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-att-131k | blocks.7.attn.hook_z | 131072 | none |
layer_8/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-att-131k | blocks.8.attn.hook_z | 131072 | none |
layer_9/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-att-131k | blocks.9.attn.hook_z | 131072 | none |
layer_10/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-att-131k | blocks.10.attn.hook_z | 131072 | none |
layer_11/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-att-131k | blocks.11.attn.hook_z | 131072 | none |
layer_12/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-att-131k | blocks.12.attn.hook_z | 131072 | none |
layer_13/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-att-131k | blocks.13.attn.hook_z | 131072 | none |
layer_14/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-att-131k | blocks.14.attn.hook_z | 131072 | none |
layer_15/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-att-131k | blocks.15.attn.hook_z | 131072 | none |
layer_16/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-att-131k | blocks.16.attn.hook_z | 131072 | none |
layer_17/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-att-131k | blocks.17.attn.hook_z | 131072 | none |
layer_18/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-att-131k | blocks.18.attn.hook_z | 131072 | none |
layer_19/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-att-131k | blocks.19.attn.hook_z | 131072 | none |
layer_20/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-att-131k | blocks.20.attn.hook_z | 131072 | none |
layer_21/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-att-131k | blocks.21.attn.hook_z | 131072 | none |
layer_22/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-att-131k | blocks.22.attn.hook_z | 131072 | none |
layer_23/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-att-131k | blocks.23.attn.hook_z | 131072 | none |
layer_24/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-att-131k | blocks.24.attn.hook_z | 131072 | none |
layer_25/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-att-131k | blocks.25.attn.hook_z | 131072 | none |
layer_26/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-att-131k | blocks.26.attn.hook_z | 131072 | none |
layer_27/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-att-131k | blocks.27.attn.hook_z | 131072 | none |
layer_28/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-att-131k | blocks.28.attn.hook_z | 131072 | none |
layer_29/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-att-131k | blocks.29.attn.hook_z | 131072 | none |
layer_30/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-att-131k | blocks.30.attn.hook_z | 131072 | none |
layer_31/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-att-131k | blocks.31.attn.hook_z | 131072 | none |
layer_32/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-att-131k | blocks.32.attn.hook_z | 131072 | none |
layer_33/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-att-131k | blocks.33.attn.hook_z | 131072 | none |
layer_34/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-att-131k | blocks.34.attn.hook_z | 131072 | none |
layer_35/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-att-131k | blocks.35.attn.hook_z | 131072 | none |
layer_36/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-att-131k | blocks.36.attn.hook_z | 131072 | none |
layer_37/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-att-131k | blocks.37.attn.hook_z | 131072 | none |
layer_38/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-att-131k | blocks.38.attn.hook_z | 131072 | none |
layer_39/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-att-131k | blocks.39.attn.hook_z | 131072 | none |
layer_40/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-att-131k | blocks.40.attn.hook_z | 131072 | none |
layer_41/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-att-131k | blocks.41.attn.hook_z | 131072 | none |
gemma-scope-9b-pt-mlp
- Huggingface Repo: google/gemma-scope-9b-pt-mlp
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/average_l0_6 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 16384 | none | |
layer_0/width_16k/average_l0_50 Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-mlp-16k__l0-50 | blocks.0.hook_mlp_out | 16384 | none |
layer_0/width_131k/average_l0_3 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 131072 | none | |
layer_0/width_131k/average_l0_5 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 131072 | none | |
layer_0/width_131k/average_l0_7 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 131072 | none | |
layer_0/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 131072 | none | |
layer_0/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 131072 | none | |
layer_0/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.0.hook_mlp_out | 131072 | none | |
layer_1/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_56 Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-mlp-16k__l0-56 | blocks.1.hook_mlp_out | 16384 | none |
layer_1/width_16k/average_l0_128 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_16k/average_l0_278 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 16384 | none | |
layer_1/width_131k/average_l0_6 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 131072 | none | |
layer_1/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 131072 | none | |
layer_1/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 131072 | none | |
layer_1/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 131072 | none | |
layer_1/width_131k/average_l0_59 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 131072 | none | |
layer_1/width_131k/average_l0_106 Load this SAE |
jumprelu | blocks.1.hook_mlp_out | 131072 | none | |
layer_10/width_16k/average_l0_13 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_49 Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-mlp-16k__l0-49 | blocks.10.hook_mlp_out | 16384 | none |
layer_10/width_16k/average_l0_114 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_16k/average_l0_276 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 16384 | none | |
layer_10/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 131072 | none | |
layer_10/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 131072 | none | |
layer_10/width_131k/average_l0_42 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 131072 | none | |
layer_10/width_131k/average_l0_83 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 131072 | none | |
layer_10/width_131k/average_l0_167 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 131072 | none | |
layer_10/width_131k/average_l0_362 Load this SAE |
jumprelu | blocks.10.hook_mlp_out | 131072 | none | |
layer_11/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-mlp-16k__l0-34 | blocks.11.hook_mlp_out | 16384 | none |
layer_11/width_16k/average_l0_76 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_180 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_16k/average_l0_421 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 16384 | none | |
layer_11/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 131072 | none | |
layer_11/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 131072 | none | |
layer_11/width_131k/average_l0_60 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 131072 | none | |
layer_11/width_131k/average_l0_120 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 131072 | none | |
layer_11/width_131k/average_l0_259 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 131072 | none | |
layer_11/width_131k/average_l0_569 Load this SAE |
jumprelu | blocks.11.hook_mlp_out | 131072 | none | |
layer_12/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_42 Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-mlp-16k__l0-42 | blocks.12.hook_mlp_out | 16384 | none |
layer_12/width_16k/average_l0_96 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_237 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_543 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_16k/average_l0_1033 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 16384 | none | |
layer_12/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 131072 | none | |
layer_12/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 131072 | none | |
layer_12/width_131k/average_l0_77 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 131072 | none | |
layer_12/width_131k/average_l0_159 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 131072 | none | |
layer_12/width_131k/average_l0_338 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 131072 | none | |
layer_12/width_131k/average_l0_745 Load this SAE |
jumprelu | blocks.12.hook_mlp_out | 131072 | none | |
layer_13/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_40 Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-mlp-16k__l0-40 | blocks.13.hook_mlp_out | 16384 | none |
layer_13/width_16k/average_l0_94 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_225 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_512 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_16k/average_l0_992 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 16384 | none | |
layer_13/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 131072 | none | |
layer_13/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 131072 | none | |
layer_13/width_131k/average_l0_75 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 131072 | none | |
layer_13/width_131k/average_l0_160 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 131072 | none | |
layer_13/width_131k/average_l0_351 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 131072 | none | |
layer_13/width_131k/average_l0_703 Load this SAE |
jumprelu | blocks.13.hook_mlp_out | 131072 | none | |
layer_14/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_41 Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-mlp-16k__l0-41 | blocks.14.hook_mlp_out | 16384 | none |
layer_14/width_16k/average_l0_97 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_236 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_538 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_16k/average_l0_1023 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 16384 | none | |
layer_14/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 131072 | none | |
layer_14/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 131072 | none | |
layer_14/width_131k/average_l0_80 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 131072 | none | |
layer_14/width_131k/average_l0_174 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 131072 | none | |
layer_14/width_131k/average_l0_374 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 131072 | none | |
layer_14/width_131k/average_l0_743 Load this SAE |
jumprelu | blocks.14.hook_mlp_out | 131072 | none | |
layer_15/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_45 Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-mlp-16k__l0-45 | blocks.15.hook_mlp_out | 16384 | none |
layer_15/width_16k/average_l0_107 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_260 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_572 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_16k/average_l0_1053 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 16384 | none | |
layer_15/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 131072 | none | |
layer_15/width_131k/average_l0_43 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 131072 | none | |
layer_15/width_131k/average_l0_89 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 131072 | none | |
layer_15/width_131k/average_l0_194 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 131072 | none | |
layer_15/width_131k/average_l0_421 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 131072 | none | |
layer_15/width_131k/average_l0_828 Load this SAE |
jumprelu | blocks.15.hook_mlp_out | 131072 | none | |
layer_16/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-mlp-16k__l0-37 | blocks.16.hook_mlp_out | 16384 | none |
layer_16/width_16k/average_l0_91 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_221 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_489 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_16k/average_l0_916 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 16384 | none | |
layer_16/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 131072 | none | |
layer_16/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 131072 | none | |
layer_16/width_131k/average_l0_81 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 131072 | none | |
layer_16/width_131k/average_l0_175 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 131072 | none | |
layer_16/width_131k/average_l0_384 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 131072 | none | |
layer_16/width_131k/average_l0_744 Load this SAE |
jumprelu | blocks.16.hook_mlp_out | 131072 | none | |
layer_17/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_41 Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-mlp-16k__l0-41 | blocks.17.hook_mlp_out | 16384 | none |
layer_17/width_16k/average_l0_104 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_274 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_624 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_16k/average_l0_1137 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 16384 | none | |
layer_17/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 131072 | none | |
layer_17/width_131k/average_l0_43 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 131072 | none | |
layer_17/width_131k/average_l0_91 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 131072 | none | |
layer_17/width_131k/average_l0_207 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 131072 | none | |
layer_17/width_131k/average_l0_483 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 131072 | none | |
layer_17/width_131k/average_l0_950 Load this SAE |
jumprelu | blocks.17.hook_mlp_out | 131072 | none | |
layer_18/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_36 Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-mlp-16k__l0-36 | blocks.18.hook_mlp_out | 16384 | none |
layer_18/width_16k/average_l0_89 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_235 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_564 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_16k/average_l0_1052 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 16384 | none | |
layer_18/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 131072 | none | |
layer_18/width_131k/average_l0_37 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 131072 | none | |
layer_18/width_131k/average_l0_82 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 131072 | none | |
layer_18/width_131k/average_l0_174 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 131072 | none | |
layer_18/width_131k/average_l0_420 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 131072 | none | |
layer_18/width_131k/average_l0_865 Load this SAE |
jumprelu | blocks.18.hook_mlp_out | 131072 | none | |
layer_19/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_38 Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-mlp-16k__l0-38 | blocks.19.hook_mlp_out | 16384 | none |
layer_19/width_16k/average_l0_98 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_255 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_599 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_16k/average_l0_1097 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 16384 | none | |
layer_19/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 131072 | none | |
layer_19/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 131072 | none | |
layer_19/width_131k/average_l0_85 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 131072 | none | |
layer_19/width_131k/average_l0_189 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 131072 | none | |
layer_19/width_131k/average_l0_440 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 131072 | none | |
layer_19/width_131k/average_l0_899 Load this SAE |
jumprelu | blocks.19.hook_mlp_out | 131072 | none | |
layer_2/width_16k/average_l0_8 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_33 Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-mlp-16k__l0-33 | blocks.2.hook_mlp_out | 16384 | none |
layer_2/width_16k/average_l0_81 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_16k/average_l0_163 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 16384 | none | |
layer_2/width_131k/average_l0_4 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 131072 | none | |
layer_2/width_131k/average_l0_7 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 131072 | none | |
layer_2/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 131072 | none | |
layer_2/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 131072 | none | |
layer_2/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 131072 | none | |
layer_2/width_131k/average_l0_61 Load this SAE |
jumprelu | blocks.2.hook_mlp_out | 131072 | none | |
layer_20/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_41 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-mlp-16k__l0-41 | blocks.20.hook_mlp_out | 16384 | none |
layer_20/width_16k/average_l0_108 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_284 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_643 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_16k/average_l0_1127 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 16384 | none | |
layer_20/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 131072 | none | |
layer_20/width_131k/average_l0_41 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 131072 | none | |
layer_20/width_131k/average_l0_93 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 131072 | none | |
layer_20/width_131k/average_l0_212 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 131072 | none | |
layer_20/width_131k/average_l0_477 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 131072 | none | |
layer_20/width_131k/average_l0_992 Load this SAE |
jumprelu | blocks.20.hook_mlp_out | 131072 | none | |
layer_21/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-mlp-16k__l0-34 | blocks.21.hook_mlp_out | 16384 | none |
layer_21/width_16k/average_l0_88 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_241 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_571 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_16k/average_l0_1063 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 16384 | none | |
layer_21/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 131072 | none | |
layer_21/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 131072 | none | |
layer_21/width_131k/average_l0_79 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 131072 | none | |
layer_21/width_131k/average_l0_179 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 131072 | none | |
layer_21/width_131k/average_l0_417 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 131072 | none | |
layer_21/width_131k/average_l0_884 Load this SAE |
jumprelu | blocks.21.hook_mlp_out | 131072 | none | |
layer_22/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-mlp-16k__l0-34 | blocks.22.hook_mlp_out | 16384 | none |
layer_22/width_16k/average_l0_85 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_226 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_566 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_16k/average_l0_1065 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 16384 | none | |
layer_22/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 131072 | none | |
layer_22/width_131k/average_l0_35 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 131072 | none | |
layer_22/width_131k/average_l0_77 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 131072 | none | |
layer_22/width_131k/average_l0_172 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 131072 | none | |
layer_22/width_131k/average_l0_404 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 131072 | none | |
layer_22/width_131k/average_l0_861 Load this SAE |
jumprelu | blocks.22.hook_mlp_out | 131072 | none | |
layer_23/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_73 Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-mlp-16k__l0-73 | blocks.23.hook_mlp_out | 16384 | none |
layer_23/width_16k/average_l0_190 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_492 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_16k/average_l0_990 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 16384 | none | |
layer_23/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 131072 | none | |
layer_23/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 131072 | none | |
layer_23/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 131072 | none | |
layer_23/width_131k/average_l0_146 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 131072 | none | |
layer_23/width_131k/average_l0_354 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 131072 | none | |
layer_23/width_131k/average_l0_754 Load this SAE |
jumprelu | blocks.23.hook_mlp_out | 131072 | none | |
layer_24/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-mlp-16k__l0-32 | blocks.24.hook_mlp_out | 16384 | none |
layer_24/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_192 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_494 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_16k/average_l0_999 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 16384 | none | |
layer_24/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 131072 | none | |
layer_24/width_131k/average_l0_33 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 131072 | none | |
layer_24/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 131072 | none | |
layer_24/width_131k/average_l0_147 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 131072 | none | |
layer_24/width_131k/average_l0_351 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 131072 | none | |
layer_24/width_131k/average_l0_709 Load this SAE |
jumprelu | blocks.24.hook_mlp_out | 131072 | none | |
layer_25/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_72 Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-mlp-16k__l0-72 | blocks.25.hook_mlp_out | 16384 | none |
layer_25/width_16k/average_l0_184 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_494 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_16k/average_l0_1013 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 16384 | none | |
layer_25/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 131072 | none | |
layer_25/width_131k/average_l0_32 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 131072 | none | |
layer_25/width_131k/average_l0_65 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 131072 | none | |
layer_25/width_131k/average_l0_139 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 131072 | none | |
layer_25/width_131k/average_l0_326 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 131072 | none | |
layer_25/width_131k/average_l0_691 Load this SAE |
jumprelu | blocks.25.hook_mlp_out | 131072 | none | |
layer_26/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 16384 | none | |
layer_26/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 16384 | none | |
layer_26/width_16k/average_l0_57 Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-mlp-16k__l0-57 | blocks.26.hook_mlp_out | 16384 | none |
layer_26/width_16k/average_l0_142 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 16384 | none | |
layer_26/width_16k/average_l0_394 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 16384 | none | |
layer_26/width_16k/average_l0_887 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 16384 | none | |
layer_26/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 131072 | none | |
layer_26/width_131k/average_l0_27 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 131072 | none | |
layer_26/width_131k/average_l0_53 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 131072 | none | |
layer_26/width_131k/average_l0_110 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 131072 | none | |
layer_26/width_131k/average_l0_249 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 131072 | none | |
layer_26/width_131k/average_l0_568 Load this SAE |
jumprelu | blocks.26.hook_mlp_out | 131072 | none | |
layer_27/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 16384 | none | |
layer_27/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 16384 | none | |
layer_27/width_16k/average_l0_52 Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-mlp-16k__l0-52 | blocks.27.hook_mlp_out | 16384 | none |
layer_27/width_16k/average_l0_126 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 16384 | none | |
layer_27/width_16k/average_l0_352 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 16384 | none | |
layer_27/width_16k/average_l0_813 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 16384 | none | |
layer_27/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 131072 | none | |
layer_27/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 131072 | none | |
layer_27/width_131k/average_l0_49 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 131072 | none | |
layer_27/width_131k/average_l0_99 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 131072 | none | |
layer_27/width_131k/average_l0_211 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 131072 | none | |
layer_27/width_131k/average_l0_487 Load this SAE |
jumprelu | blocks.27.hook_mlp_out | 131072 | none | |
layer_28/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 16384 | none | |
layer_28/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 16384 | none | |
layer_28/width_16k/average_l0_50 Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-mlp-16k__l0-50 | blocks.28.hook_mlp_out | 16384 | none |
layer_28/width_16k/average_l0_115 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 16384 | none | |
layer_28/width_16k/average_l0_324 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 16384 | none | |
layer_28/width_16k/average_l0_773 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 16384 | none | |
layer_28/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 131072 | none | |
layer_28/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 131072 | none | |
layer_28/width_131k/average_l0_47 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 131072 | none | |
layer_28/width_131k/average_l0_91 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 131072 | none | |
layer_28/width_131k/average_l0_189 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 131072 | none | |
layer_28/width_131k/average_l0_425 Load this SAE |
jumprelu | blocks.28.hook_mlp_out | 131072 | none | |
layer_29/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 16384 | none | |
layer_29/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 16384 | none | |
layer_29/width_16k/average_l0_49 Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-mlp-16k__l0-49 | blocks.29.hook_mlp_out | 16384 | none |
layer_29/width_16k/average_l0_111 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 16384 | none | |
layer_29/width_16k/average_l0_311 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 16384 | none | |
layer_29/width_16k/average_l0_725 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 16384 | none | |
layer_29/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 131072 | none | |
layer_29/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 131072 | none | |
layer_29/width_131k/average_l0_47 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 131072 | none | |
layer_29/width_131k/average_l0_87 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 131072 | none | |
layer_29/width_131k/average_l0_174 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 131072 | none | |
layer_29/width_131k/average_l0_386 Load this SAE |
jumprelu | blocks.29.hook_mlp_out | 131072 | none | |
layer_3/width_16k/average_l0_13 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_55 Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-mlp-16k__l0-55 | blocks.3.hook_mlp_out | 16384 | none |
layer_3/width_16k/average_l0_126 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_16k/average_l0_234 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 16384 | none | |
layer_3/width_131k/average_l0_6 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 131072 | none | |
layer_3/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 131072 | none | |
layer_3/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 131072 | none | |
layer_3/width_131k/average_l0_33 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 131072 | none | |
layer_3/width_131k/average_l0_58 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 131072 | none | |
layer_3/width_131k/average_l0_109 Load this SAE |
jumprelu | blocks.3.hook_mlp_out | 131072 | none | |
layer_30/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 16384 | none | |
layer_30/width_16k/average_l0_26 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 16384 | none | |
layer_30/width_16k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-mlp-16k__l0-51 | blocks.30.hook_mlp_out | 16384 | none |
layer_30/width_16k/average_l0_116 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 16384 | none | |
layer_30/width_16k/average_l0_333 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 16384 | none | |
layer_30/width_16k/average_l0_806 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 16384 | none | |
layer_30/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 131072 | none | |
layer_30/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 131072 | none | |
layer_30/width_131k/average_l0_47 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 131072 | none | |
layer_30/width_131k/average_l0_89 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 131072 | none | |
layer_30/width_131k/average_l0_179 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 131072 | none | |
layer_30/width_131k/average_l0_391 Load this SAE |
jumprelu | blocks.30.hook_mlp_out | 131072 | none | |
layer_31/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 16384 | none | |
layer_31/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 16384 | none | |
layer_31/width_16k/average_l0_43 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-mlp-16k__l0-43 | blocks.31.hook_mlp_out | 16384 | none |
layer_31/width_16k/average_l0_94 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 16384 | none | |
layer_31/width_16k/average_l0_263 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 16384 | none | |
layer_31/width_16k/average_l0_671 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 16384 | none | |
layer_31/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 131072 | none | |
layer_31/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 131072 | none | |
layer_31/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 131072 | none | |
layer_31/width_131k/average_l0_77 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 131072 | none | |
layer_31/width_131k/average_l0_153 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 131072 | none | |
layer_31/width_131k/average_l0_326 Load this SAE |
jumprelu | blocks.31.hook_mlp_out | 131072 | none | |
layer_32/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 16384 | none | |
layer_32/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 16384 | none | |
layer_32/width_16k/average_l0_44 Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-mlp-16k__l0-44 | blocks.32.hook_mlp_out | 16384 | none |
layer_32/width_16k/average_l0_98 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 16384 | none | |
layer_32/width_16k/average_l0_267 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 16384 | none | |
layer_32/width_16k/average_l0_623 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 16384 | none | |
layer_32/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 131072 | none | |
layer_32/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 131072 | none | |
layer_32/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 131072 | none | |
layer_32/width_131k/average_l0_76 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 131072 | none | |
layer_32/width_131k/average_l0_155 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 131072 | none | |
layer_32/width_131k/average_l0_336 Load this SAE |
jumprelu | blocks.32.hook_mlp_out | 131072 | none | |
layer_33/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 16384 | none | |
layer_33/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 16384 | none | |
layer_33/width_16k/average_l0_48 Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-mlp-16k__l0-48 | blocks.33.hook_mlp_out | 16384 | none |
layer_33/width_16k/average_l0_107 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 16384 | none | |
layer_33/width_16k/average_l0_282 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 16384 | none | |
layer_33/width_16k/average_l0_628 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 16384 | none | |
layer_33/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 131072 | none | |
layer_33/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 131072 | none | |
layer_33/width_131k/average_l0_42 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 131072 | none | |
layer_33/width_131k/average_l0_83 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 131072 | none | |
layer_33/width_131k/average_l0_168 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 131072 | none | |
layer_33/width_131k/average_l0_394 Load this SAE |
jumprelu | blocks.33.hook_mlp_out | 131072 | none | |
layer_34/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 16384 | none | |
layer_34/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 16384 | none | |
layer_34/width_16k/average_l0_47 Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-mlp-16k__l0-47 | blocks.34.hook_mlp_out | 16384 | none |
layer_34/width_16k/average_l0_107 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 16384 | none | |
layer_34/width_16k/average_l0_268 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 16384 | none | |
layer_34/width_16k/average_l0_559 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 16384 | none | |
layer_34/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 131072 | none | |
layer_34/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 131072 | none | |
layer_34/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 131072 | none | |
layer_34/width_131k/average_l0_82 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 131072 | none | |
layer_34/width_131k/average_l0_167 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 131072 | none | |
layer_34/width_131k/average_l0_390 Load this SAE |
jumprelu | blocks.34.hook_mlp_out | 131072 | none | |
layer_35/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 16384 | none | |
layer_35/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 16384 | none | |
layer_35/width_16k/average_l0_46 Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-mlp-16k__l0-46 | blocks.35.hook_mlp_out | 16384 | none |
layer_35/width_16k/average_l0_108 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 16384 | none | |
layer_35/width_16k/average_l0_254 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 16384 | none | |
layer_35/width_16k/average_l0_538 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 16384 | none | |
layer_35/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 131072 | none | |
layer_35/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 131072 | none | |
layer_35/width_131k/average_l0_39 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 131072 | none | |
layer_35/width_131k/average_l0_80 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 131072 | none | |
layer_35/width_131k/average_l0_176 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 131072 | none | |
layer_35/width_131k/average_l0_389 Load this SAE |
jumprelu | blocks.35.hook_mlp_out | 131072 | none | |
layer_36/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 16384 | none | |
layer_36/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 16384 | none | |
layer_36/width_16k/average_l0_47 Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-mlp-16k__l0-47 | blocks.36.hook_mlp_out | 16384 | none |
layer_36/width_16k/average_l0_109 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 16384 | none | |
layer_36/width_16k/average_l0_256 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 16384 | none | |
layer_36/width_16k/average_l0_523 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 16384 | none | |
layer_36/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 131072 | none | |
layer_36/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 131072 | none | |
layer_36/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 131072 | none | |
layer_36/width_131k/average_l0_81 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 131072 | none | |
layer_36/width_131k/average_l0_174 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 131072 | none | |
layer_36/width_131k/average_l0_389 Load this SAE |
jumprelu | blocks.36.hook_mlp_out | 131072 | none | |
layer_37/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 16384 | none | |
layer_37/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 16384 | none | |
layer_37/width_16k/average_l0_53 Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-mlp-16k__l0-53 | blocks.37.hook_mlp_out | 16384 | none |
layer_37/width_16k/average_l0_119 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 16384 | none | |
layer_37/width_16k/average_l0_267 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 16384 | none | |
layer_37/width_16k/average_l0_549 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 16384 | none | |
layer_37/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 131072 | none | |
layer_37/width_131k/average_l0_23 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 131072 | none | |
layer_37/width_131k/average_l0_44 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 131072 | none | |
layer_37/width_131k/average_l0_90 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 131072 | none | |
layer_37/width_131k/average_l0_203 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 131072 | none | |
layer_37/width_131k/average_l0_403 Load this SAE |
jumprelu | blocks.37.hook_mlp_out | 131072 | none | |
layer_38/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 16384 | none | |
layer_38/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 16384 | none | |
layer_38/width_16k/average_l0_45 Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-mlp-16k__l0-45 | blocks.38.hook_mlp_out | 16384 | none |
layer_38/width_16k/average_l0_98 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 16384 | none | |
layer_38/width_16k/average_l0_225 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 16384 | none | |
layer_38/width_16k/average_l0_491 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 16384 | none | |
layer_38/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 131072 | none | |
layer_38/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 131072 | none | |
layer_38/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 131072 | none | |
layer_38/width_131k/average_l0_79 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 131072 | none | |
layer_38/width_131k/average_l0_161 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 131072 | none | |
layer_38/width_131k/average_l0_347 Load this SAE |
jumprelu | blocks.38.hook_mlp_out | 131072 | none | |
layer_39/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 16384 | none | |
layer_39/width_16k/average_l0_22 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 16384 | none | |
layer_39/width_16k/average_l0_43 Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-mlp-16k__l0-43 | blocks.39.hook_mlp_out | 16384 | none |
layer_39/width_16k/average_l0_90 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 16384 | none | |
layer_39/width_16k/average_l0_207 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 16384 | none | |
layer_39/width_16k/average_l0_458 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 16384 | none | |
layer_39/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 131072 | none | |
layer_39/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 131072 | none | |
layer_39/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 131072 | none | |
layer_39/width_131k/average_l0_75 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 131072 | none | |
layer_39/width_131k/average_l0_150 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 131072 | none | |
layer_39/width_131k/average_l0_319 Load this SAE |
jumprelu | blocks.39.hook_mlp_out | 131072 | none | |
layer_4/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_30 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_66 Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-mlp-16k__l0-66 | blocks.4.hook_mlp_out | 16384 | none |
layer_4/width_16k/average_l0_151 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_16k/average_l0_343 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 16384 | none | |
layer_4/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 131072 | none | |
layer_4/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 131072 | none | |
layer_4/width_131k/average_l0_24 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 131072 | none | |
layer_4/width_131k/average_l0_45 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 131072 | none | |
layer_4/width_131k/average_l0_84 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 131072 | none | |
layer_4/width_131k/average_l0_157 Load this SAE |
jumprelu | blocks.4.hook_mlp_out | 131072 | none | |
layer_40/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 16384 | none | |
layer_40/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 16384 | none | |
layer_40/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-mlp-16k__l0-37 | blocks.40.hook_mlp_out | 16384 | none |
layer_40/width_16k/average_l0_74 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 16384 | none | |
layer_40/width_16k/average_l0_162 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 16384 | none | |
layer_40/width_16k/average_l0_371 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 16384 | none | |
layer_40/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 131072 | none | |
layer_40/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 131072 | none | |
layer_40/width_131k/average_l0_33 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 131072 | none | |
layer_40/width_131k/average_l0_63 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 131072 | none | |
layer_40/width_131k/average_l0_125 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 131072 | none | |
layer_40/width_131k/average_l0_267 Load this SAE |
jumprelu | blocks.40.hook_mlp_out | 131072 | none | |
layer_41/width_16k/average_l0_8 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 16384 | none | |
layer_41/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 16384 | none | |
layer_41/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 16384 | none | |
layer_41/width_16k/average_l0_58 Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-mlp-16k__l0-58 | blocks.41.hook_mlp_out | 16384 | none |
layer_41/width_16k/average_l0_126 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 16384 | none | |
layer_41/width_16k/average_l0_288 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 16384 | none | |
layer_41/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 131072 | none | |
layer_41/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 131072 | none | |
layer_41/width_131k/average_l0_25 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 131072 | none | |
layer_41/width_131k/average_l0_49 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 131072 | none | |
layer_41/width_131k/average_l0_99 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 131072 | none | |
layer_41/width_131k/average_l0_208 Load this SAE |
jumprelu | blocks.41.hook_mlp_out | 131072 | none | |
layer_5/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_24 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_46 Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-mlp-16k__l0-46 | blocks.5.hook_mlp_out | 16384 | none |
layer_5/width_16k/average_l0_93 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_16k/average_l0_194 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 16384 | none | |
layer_5/width_131k/average_l0_7 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 131072 | none | |
layer_5/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 131072 | none | |
layer_5/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 131072 | none | |
layer_5/width_131k/average_l0_37 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 131072 | none | |
layer_5/width_131k/average_l0_68 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 131072 | none | |
layer_5/width_131k/average_l0_131 Load this SAE |
jumprelu | blocks.5.hook_mlp_out | 131072 | none | |
layer_6/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_23 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_46 Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-mlp-16k__l0-46 | blocks.6.hook_mlp_out | 16384 | none |
layer_6/width_16k/average_l0_96 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_16k/average_l0_206 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 16384 | none | |
layer_6/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 131072 | none | |
layer_6/width_131k/average_l0_22 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 131072 | none | |
layer_6/width_131k/average_l0_40 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 131072 | none | |
layer_6/width_131k/average_l0_72 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 131072 | none | |
layer_6/width_131k/average_l0_135 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 131072 | none | |
layer_6/width_131k/average_l0_271 Load this SAE |
jumprelu | blocks.6.hook_mlp_out | 131072 | none | |
layer_7/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_47 Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-mlp-16k__l0-47 | blocks.7.hook_mlp_out | 16384 | none |
layer_7/width_16k/average_l0_101 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_16k/average_l0_231 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 16384 | none | |
layer_7/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 131072 | none | |
layer_7/width_131k/average_l0_23 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 131072 | none | |
layer_7/width_131k/average_l0_41 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 131072 | none | |
layer_7/width_131k/average_l0_75 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 131072 | none | |
layer_7/width_131k/average_l0_143 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 131072 | none | |
layer_7/width_131k/average_l0_309 Load this SAE |
jumprelu | blocks.7.hook_mlp_out | 131072 | none | |
layer_8/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_27 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_55 Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-mlp-16k__l0-55 | blocks.8.hook_mlp_out | 16384 | none |
layer_8/width_16k/average_l0_124 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_16k/average_l0_309 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 16384 | none | |
layer_8/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 131072 | none | |
layer_8/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 131072 | none | |
layer_8/width_131k/average_l0_48 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 131072 | none | |
layer_8/width_131k/average_l0_89 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 131072 | none | |
layer_8/width_131k/average_l0_184 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 131072 | none | |
layer_8/width_131k/average_l0_423 Load this SAE |
jumprelu | blocks.8.hook_mlp_out | 131072 | none | |
layer_9/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_40 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_16k/average_l0_83 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-mlp-16k__l0-83 | blocks.9.hook_mlp_out | 16384 | none |
layer_9/width_16k/average_l0_200 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 16384 | none | |
layer_9/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 131072 | none | |
layer_9/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 131072 | none | |
layer_9/width_131k/average_l0_38 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 131072 | none | |
layer_9/width_131k/average_l0_67 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 131072 | none | |
layer_9/width_131k/average_l0_129 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 131072 | none | |
layer_9/width_131k/average_l0_269 Load this SAE |
jumprelu | blocks.9.hook_mlp_out | 131072 | none |
gemma-scope-9b-pt-mlp-canonical
- Huggingface Repo: google/gemma-scope-9b-pt-mlp
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-mlp-16k | blocks.0.hook_mlp_out | 16384 | none |
layer_1/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-mlp-16k | blocks.1.hook_mlp_out | 16384 | none |
layer_2/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-mlp-16k | blocks.2.hook_mlp_out | 16384 | none |
layer_3/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-mlp-16k | blocks.3.hook_mlp_out | 16384 | none |
layer_4/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-mlp-16k | blocks.4.hook_mlp_out | 16384 | none |
layer_5/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-mlp-16k | blocks.5.hook_mlp_out | 16384 | none |
layer_6/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-mlp-16k | blocks.6.hook_mlp_out | 16384 | none |
layer_7/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-mlp-16k | blocks.7.hook_mlp_out | 16384 | none |
layer_8/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-mlp-16k | blocks.8.hook_mlp_out | 16384 | none |
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-mlp-16k | blocks.9.hook_mlp_out | 16384 | none |
layer_10/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-mlp-16k | blocks.10.hook_mlp_out | 16384 | none |
layer_11/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-mlp-16k | blocks.11.hook_mlp_out | 16384 | none |
layer_12/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-mlp-16k | blocks.12.hook_mlp_out | 16384 | none |
layer_13/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-mlp-16k | blocks.13.hook_mlp_out | 16384 | none |
layer_14/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-mlp-16k | blocks.14.hook_mlp_out | 16384 | none |
layer_15/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-mlp-16k | blocks.15.hook_mlp_out | 16384 | none |
layer_16/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-mlp-16k | blocks.16.hook_mlp_out | 16384 | none |
layer_17/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-mlp-16k | blocks.17.hook_mlp_out | 16384 | none |
layer_18/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-mlp-16k | blocks.18.hook_mlp_out | 16384 | none |
layer_19/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-mlp-16k | blocks.19.hook_mlp_out | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-mlp-16k | blocks.20.hook_mlp_out | 16384 | none |
layer_21/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-mlp-16k | blocks.21.hook_mlp_out | 16384 | none |
layer_22/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-mlp-16k | blocks.22.hook_mlp_out | 16384 | none |
layer_23/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-mlp-16k | blocks.23.hook_mlp_out | 16384 | none |
layer_24/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-mlp-16k | blocks.24.hook_mlp_out | 16384 | none |
layer_25/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-mlp-16k | blocks.25.hook_mlp_out | 16384 | none |
layer_26/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-mlp-16k | blocks.26.hook_mlp_out | 16384 | none |
layer_27/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-mlp-16k | blocks.27.hook_mlp_out | 16384 | none |
layer_28/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-mlp-16k | blocks.28.hook_mlp_out | 16384 | none |
layer_29/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-mlp-16k | blocks.29.hook_mlp_out | 16384 | none |
layer_30/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-mlp-16k | blocks.30.hook_mlp_out | 16384 | none |
layer_31/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-mlp-16k | blocks.31.hook_mlp_out | 16384 | none |
layer_32/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-mlp-16k | blocks.32.hook_mlp_out | 16384 | none |
layer_33/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-mlp-16k | blocks.33.hook_mlp_out | 16384 | none |
layer_34/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-mlp-16k | blocks.34.hook_mlp_out | 16384 | none |
layer_35/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-mlp-16k | blocks.35.hook_mlp_out | 16384 | none |
layer_36/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-mlp-16k | blocks.36.hook_mlp_out | 16384 | none |
layer_37/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-mlp-16k | blocks.37.hook_mlp_out | 16384 | none |
layer_38/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-mlp-16k | blocks.38.hook_mlp_out | 16384 | none |
layer_39/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-mlp-16k | blocks.39.hook_mlp_out | 16384 | none |
layer_40/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-mlp-16k | blocks.40.hook_mlp_out | 16384 | none |
layer_41/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-mlp-16k | blocks.41.hook_mlp_out | 16384 | none |
layer_0/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-mlp-131k | blocks.0.hook_mlp_out | 131072 | none |
layer_1/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-mlp-131k | blocks.1.hook_mlp_out | 131072 | none |
layer_2/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-mlp-131k | blocks.2.hook_mlp_out | 131072 | none |
layer_3/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-mlp-131k | blocks.3.hook_mlp_out | 131072 | none |
layer_4/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-mlp-131k | blocks.4.hook_mlp_out | 131072 | none |
layer_5/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-mlp-131k | blocks.5.hook_mlp_out | 131072 | none |
layer_6/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-mlp-131k | blocks.6.hook_mlp_out | 131072 | none |
layer_7/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-mlp-131k | blocks.7.hook_mlp_out | 131072 | none |
layer_8/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-mlp-131k | blocks.8.hook_mlp_out | 131072 | none |
layer_9/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-mlp-131k | blocks.9.hook_mlp_out | 131072 | none |
layer_10/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-mlp-131k | blocks.10.hook_mlp_out | 131072 | none |
layer_11/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-mlp-131k | blocks.11.hook_mlp_out | 131072 | none |
layer_12/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-mlp-131k | blocks.12.hook_mlp_out | 131072 | none |
layer_13/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-mlp-131k | blocks.13.hook_mlp_out | 131072 | none |
layer_14/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-mlp-131k | blocks.14.hook_mlp_out | 131072 | none |
layer_15/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-mlp-131k | blocks.15.hook_mlp_out | 131072 | none |
layer_16/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-mlp-131k | blocks.16.hook_mlp_out | 131072 | none |
layer_17/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-mlp-131k | blocks.17.hook_mlp_out | 131072 | none |
layer_18/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-mlp-131k | blocks.18.hook_mlp_out | 131072 | none |
layer_19/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-mlp-131k | blocks.19.hook_mlp_out | 131072 | none |
layer_20/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-mlp-131k | blocks.20.hook_mlp_out | 131072 | none |
layer_21/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-mlp-131k | blocks.21.hook_mlp_out | 131072 | none |
layer_22/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-mlp-131k | blocks.22.hook_mlp_out | 131072 | none |
layer_23/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-mlp-131k | blocks.23.hook_mlp_out | 131072 | none |
layer_24/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-mlp-131k | blocks.24.hook_mlp_out | 131072 | none |
layer_25/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-mlp-131k | blocks.25.hook_mlp_out | 131072 | none |
layer_26/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-mlp-131k | blocks.26.hook_mlp_out | 131072 | none |
layer_27/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-mlp-131k | blocks.27.hook_mlp_out | 131072 | none |
layer_28/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-mlp-131k | blocks.28.hook_mlp_out | 131072 | none |
layer_29/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-mlp-131k | blocks.29.hook_mlp_out | 131072 | none |
layer_30/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-mlp-131k | blocks.30.hook_mlp_out | 131072 | none |
layer_31/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-mlp-131k | blocks.31.hook_mlp_out | 131072 | none |
layer_32/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-mlp-131k | blocks.32.hook_mlp_out | 131072 | none |
layer_33/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-mlp-131k | blocks.33.hook_mlp_out | 131072 | none |
layer_34/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-mlp-131k | blocks.34.hook_mlp_out | 131072 | none |
layer_35/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-mlp-131k | blocks.35.hook_mlp_out | 131072 | none |
layer_36/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-mlp-131k | blocks.36.hook_mlp_out | 131072 | none |
layer_37/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-mlp-131k | blocks.37.hook_mlp_out | 131072 | none |
layer_38/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-mlp-131k | blocks.38.hook_mlp_out | 131072 | none |
layer_39/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-mlp-131k | blocks.39.hook_mlp_out | 131072 | none |
layer_40/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-mlp-131k | blocks.40.hook_mlp_out | 131072 | none |
layer_41/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-mlp-131k | blocks.41.hook_mlp_out | 131072 | none |
gemma-scope-9b-pt-res
- Huggingface Repo: google/gemma-scope-9b-pt-res
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
embedding/width_4k/average_l0_14 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
embedding/width_4k/average_l0_22 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
embedding/width_4k/average_l0_7 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
embedding/width_4k/average_l0_80 Load this SAE |
jumprelu | hook_embed | 4096 | none | |
layer_0/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 131072 | none | |
layer_0/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 131072 | none | |
layer_0/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 131072 | none | |
layer_0/width_131k/average_l0_30 Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-res-131k__l0-30 | blocks.0.hook_resid_post | 131072 | none |
layer_0/width_131k/average_l0_41 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 131072 | none | |
layer_0/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 131072 | none | |
layer_0/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_129 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_0/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-res-16k__l0-35 | blocks.0.hook_resid_post | 16384 | none |
layer_0/width_16k/average_l0_68 Load this SAE |
jumprelu | blocks.0.hook_resid_post | 16384 | none | |
layer_1/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 131072 | none | |
layer_1/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 131072 | none | |
layer_1/width_131k/average_l0_33 Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-res-131k__l0-33 | blocks.1.hook_resid_post | 131072 | none |
layer_1/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 131072 | none | |
layer_1/width_131k/average_l0_6 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 131072 | none | |
layer_1/width_131k/average_l0_9 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 131072 | none | |
layer_1/width_16k/average_l0_15 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_175 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_1/width_16k/average_l0_69 Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-res-16k__l0-69 | blocks.1.hook_resid_post | 16384 | none |
layer_1/width_16k/average_l0_9 Load this SAE |
jumprelu | blocks.1.hook_resid_post | 16384 | none | |
layer_10/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_151 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_27 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_47 Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-res-131k__l0-47 | blocks.10.hook_resid_post | 131072 | none |
layer_10/width_131k/average_l0_84 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_131k/average_l0_9 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 131072 | none | |
layer_10/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_113 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_243 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_31 Load this SAE |
jumprelu | blocks.10.hook_resid_post | 16384 | none | |
layer_10/width_16k/average_l0_57 Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-res-16k__l0-57 | blocks.10.hook_resid_post | 16384 | none |
layer_11/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 131072 | none | |
layer_11/width_131k/average_l0_162 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 131072 | none | |
layer_11/width_131k/average_l0_27 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 131072 | none | |
layer_11/width_131k/average_l0_49 Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-res-131k__l0-49 | blocks.11.hook_resid_post | 131072 | none |
layer_11/width_131k/average_l0_88 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 131072 | none | |
layer_11/width_131k/average_l0_9 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 131072 | none | |
layer_11/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_118 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_255 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_11/width_16k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-res-16k__l0-32 | blocks.11.hook_resid_post | 16384 | none |
layer_11/width_16k/average_l0_60 Load this SAE |
jumprelu | blocks.11.hook_resid_post | 16384 | none | |
layer_12/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_183 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_131k/average_l0_52 Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-res-131k__l0-52 | blocks.12.hook_resid_post | 131072 | none |
layer_12/width_131k/average_l0_96 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 131072 | none | |
layer_12/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 16384 | none | |
layer_12/width_16k/average_l0_130 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 16384 | none | |
layer_12/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 16384 | none | |
layer_12/width_16k/average_l0_287 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 16384 | none | |
layer_12/width_16k/average_l0_33 Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-res-16k__l0-33 | blocks.12.hook_resid_post | 16384 | none |
layer_12/width_16k/average_l0_64 Load this SAE |
jumprelu | blocks.12.hook_resid_post | 16384 | none | |
layer_13/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 131072 | none | |
layer_13/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 131072 | none | |
layer_13/width_131k/average_l0_189 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 131072 | none | |
layer_13/width_131k/average_l0_30 Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-res-131k__l0-30 | blocks.13.hook_resid_post | 131072 | none |
layer_13/width_131k/average_l0_54 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 131072 | none | |
layer_13/width_131k/average_l0_99 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 131072 | none | |
layer_13/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_132 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_285 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_13/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-res-16k__l0-34 | blocks.13.hook_resid_post | 16384 | none |
layer_13/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.13.hook_resid_post | 16384 | none | |
layer_14/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 131072 | none | |
layer_14/width_131k/average_l0_105 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 131072 | none | |
layer_14/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 131072 | none | |
layer_14/width_131k/average_l0_197 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 131072 | none | |
layer_14/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 131072 | none | |
layer_14/width_131k/average_l0_56 Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-res-131k__l0-56 | blocks.14.hook_resid_post | 131072 | none |
layer_14/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_137 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_294 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_14/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-res-16k__l0-35 | blocks.14.hook_resid_post | 16384 | none |
layer_14/width_16k/average_l0_67 Load this SAE |
jumprelu | blocks.14.hook_resid_post | 16384 | none | |
layer_15/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 131072 | none | |
layer_15/width_131k/average_l0_103 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 131072 | none | |
layer_15/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 131072 | none | |
layer_15/width_131k/average_l0_198 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 131072 | none | |
layer_15/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 131072 | none | |
layer_15/width_131k/average_l0_55 Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-res-131k__l0-55 | blocks.15.hook_resid_post | 131072 | none |
layer_15/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_131 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_290 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_15/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-res-16k__l0-34 | blocks.15.hook_resid_post | 16384 | none |
layer_15/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.15.hook_resid_post | 16384 | none | |
layer_16/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 131072 | none | |
layer_16/width_131k/average_l0_121 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 131072 | none | |
layer_16/width_131k/average_l0_20 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 131072 | none | |
layer_16/width_131k/average_l0_232 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 131072 | none | |
layer_16/width_131k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-res-131k__l0-35 | blocks.16.hook_resid_post | 131072 | none |
layer_16/width_131k/average_l0_65 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 131072 | none | |
layer_16/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_152 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_346 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_16/width_16k/average_l0_39 Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-res-16k__l0-39 | blocks.16.hook_resid_post | 16384 | none |
layer_16/width_16k/average_l0_75 Load this SAE |
jumprelu | blocks.16.hook_resid_post | 16384 | none | |
layer_17/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 131072 | none | |
layer_17/width_131k/average_l0_117 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 131072 | none | |
layer_17/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 131072 | none | |
layer_17/width_131k/average_l0_221 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 131072 | none | |
layer_17/width_131k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-res-131k__l0-35 | blocks.17.hook_resid_post | 131072 | none |
layer_17/width_131k/average_l0_64 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 131072 | none | |
layer_17/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_144 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_317 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_17/width_16k/average_l0_38 Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-res-16k__l0-38 | blocks.17.hook_resid_post | 16384 | none |
layer_17/width_16k/average_l0_73 Load this SAE |
jumprelu | blocks.17.hook_resid_post | 16384 | none | |
layer_18/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 131072 | none | |
layer_18/width_131k/average_l0_113 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 131072 | none | |
layer_18/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 131072 | none | |
layer_18/width_131k/average_l0_221 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 131072 | none | |
layer_18/width_131k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-res-131k__l0-34 | blocks.18.hook_resid_post | 131072 | none |
layer_18/width_131k/average_l0_62 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 131072 | none | |
layer_18/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_140 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_309 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_18/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-res-16k__l0-37 | blocks.18.hook_resid_post | 16384 | none |
layer_18/width_16k/average_l0_71 Load this SAE |
jumprelu | blocks.18.hook_resid_post | 16384 | none | |
layer_19/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 131072 | none | |
layer_19/width_131k/average_l0_110 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 131072 | none | |
layer_19/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 131072 | none | |
layer_19/width_131k/average_l0_210 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 131072 | none | |
layer_19/width_131k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-res-131k__l0-32 | blocks.19.hook_resid_post | 131072 | none |
layer_19/width_131k/average_l0_60 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 131072 | none | |
layer_19/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 16384 | none | |
layer_19/width_16k/average_l0_132 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 16384 | none | |
layer_19/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 16384 | none | |
layer_19/width_16k/average_l0_293 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 16384 | none | |
layer_19/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-res-16k__l0-35 | blocks.19.hook_resid_post | 16384 | none |
layer_19/width_16k/average_l0_67 Load this SAE |
jumprelu | blocks.19.hook_resid_post | 16384 | none | |
layer_2/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 131072 | none | |
layer_2/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 131072 | none | |
layer_2/width_131k/average_l0_36 Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-res-131k__l0-36 | blocks.2.hook_resid_post | 131072 | none |
layer_2/width_131k/average_l0_5 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 131072 | none | |
layer_2/width_131k/average_l0_70 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 131072 | none | |
layer_2/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 131072 | none | |
layer_2/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_189 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_29 Load this SAE |
jumprelu | blocks.2.hook_resid_post | 16384 | none | |
layer_2/width_16k/average_l0_67 Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-res-16k__l0-67 | blocks.2.hook_resid_post | 16384 | none |
layer_2/width_16k/average_l0_8 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-10 | blocks.2.hook_resid_post | 16384 | none |
layer_20/width_131k/average_l0_11 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-11 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_114 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-12 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_19 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-19 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_221 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-221 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_276 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-276 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-34 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_53 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-53 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_131k/average_l0_62 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k__l0-62 | blocks.20.hook_resid_post | 131072 | none |
layer_20/width_16k/average_l0_11 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-11 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_138 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-138 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_20 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-20 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_310 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-310 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_36 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-36 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_408 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-408 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_58 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k__l0-58 | blocks.20.hook_resid_post | 16384 | none |
layer_20/width_16k/average_l0_68 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 16384 | none | |
layer_20/width_1m/average_l0_101 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 1048576 | none | |
layer_20/width_1m/average_l0_11 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-1m__l0-11 | blocks.20.hook_resid_post | 1048576 | none |
layer_20/width_1m/average_l0_19 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-1m__l0-19 | blocks.20.hook_resid_post | 1048576 | none |
layer_20/width_1m/average_l0_193 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-1m__l0-193 | blocks.20.hook_resid_post | 1048576 | none |
layer_20/width_1m/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-1m__l0-34 | blocks.20.hook_resid_post | 1048576 | none |
layer_20/width_1m/average_l0_57 Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-1m__l0-57 | blocks.20.hook_resid_post | 1048576 | none |
layer_20/width_262k/average_l0_11 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 262144 | none | |
layer_20/width_262k/average_l0_259 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 262144 | none | |
layer_20/width_262k/average_l0_50 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 262144 | none | |
layer_20/width_32k/average_l0_11 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 32768 | none | |
layer_20/width_32k/average_l0_344 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 32768 | none | |
layer_20/width_32k/average_l0_57 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 32768 | none | |
layer_20/width_524k/average_l0_10 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 524288 | none | |
layer_20/width_524k/average_l0_241 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 524288 | none | |
layer_20/width_524k/average_l0_48 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 524288 | none | |
layer_20/width_65k/average_l0_11 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_20/width_65k/average_l0_55 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_20/width_65k/average_l0_298 Load this SAE |
jumprelu | blocks.20.hook_resid_post | 65536 | none | |
layer_21/width_131k/average_l0_109 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 131072 | none | |
layer_21/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 131072 | none | |
layer_21/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 131072 | none | |
layer_21/width_131k/average_l0_204 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 131072 | none | |
layer_21/width_131k/average_l0_33 Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-res-131k__l0-33 | blocks.21.hook_resid_post | 131072 | none |
layer_21/width_131k/average_l0_58 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 131072 | none | |
layer_21/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_129 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_278 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_21/width_16k/average_l0_36 Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-res-16k__l0-36 | blocks.21.hook_resid_post | 16384 | none |
layer_21/width_16k/average_l0_66 Load this SAE |
jumprelu | blocks.21.hook_resid_post | 16384 | none | |
layer_22/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_105 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_197 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_131k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-res-131k__l0-32 | blocks.22.hook_resid_post | 131072 | none |
layer_22/width_131k/average_l0_58 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 131072 | none | |
layer_22/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_123 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_268 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_22/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-res-16k__l0-35 | blocks.22.hook_resid_post | 16384 | none |
layer_22/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.22.hook_resid_post | 16384 | none | |
layer_23/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 131072 | none | |
layer_23/width_131k/average_l0_101 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 131072 | none | |
layer_23/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 131072 | none | |
layer_23/width_131k/average_l0_187 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 131072 | none | |
layer_23/width_131k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-res-131k__l0-32 | blocks.23.hook_resid_post | 131072 | none |
layer_23/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 131072 | none | |
layer_23/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_120 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_248 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_23/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-res-16k__l0-35 | blocks.23.hook_resid_post | 16384 | none |
layer_23/width_16k/average_l0_63 Load this SAE |
jumprelu | blocks.23.hook_resid_post | 16384 | none | |
layer_24/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 131072 | none | |
layer_24/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 131072 | none | |
layer_24/width_131k/average_l0_180 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 131072 | none | |
layer_24/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 131072 | none | |
layer_24/width_131k/average_l0_55 Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-res-131k__l0-55 | blocks.24.hook_resid_post | 131072 | none |
layer_24/width_131k/average_l0_97 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 131072 | none | |
layer_24/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_114 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_234 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_24/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-res-16k__l0-34 | blocks.24.hook_resid_post | 16384 | none |
layer_24/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.24.hook_resid_post | 16384 | none | |
layer_25/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 131072 | none | |
layer_25/width_131k/average_l0_177 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 131072 | none | |
layer_25/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 131072 | none | |
layer_25/width_131k/average_l0_31 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 131072 | none | |
layer_25/width_131k/average_l0_54 Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-res-131k__l0-54 | blocks.25.hook_resid_post | 131072 | none |
layer_25/width_131k/average_l0_96 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 131072 | none | |
layer_25/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_114 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_231 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_25/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-res-16k__l0-34 | blocks.25.hook_resid_post | 16384 | none |
layer_25/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.25.hook_resid_post | 16384 | none | |
layer_26/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 131072 | none | |
layer_26/width_131k/average_l0_176 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 131072 | none | |
layer_26/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 131072 | none | |
layer_26/width_131k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-res-131k__l0-32 | blocks.26.hook_resid_post | 131072 | none |
layer_26/width_131k/average_l0_55 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 131072 | none | |
layer_26/width_131k/average_l0_97 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 131072 | none | |
layer_26/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 16384 | none | |
layer_26/width_16k/average_l0_116 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 16384 | none | |
layer_26/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 16384 | none | |
layer_26/width_16k/average_l0_233 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 16384 | none | |
layer_26/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-res-16k__l0-35 | blocks.26.hook_resid_post | 16384 | none |
layer_26/width_16k/average_l0_63 Load this SAE |
jumprelu | blocks.26.hook_resid_post | 16384 | none | |
layer_27/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 131072 | none | |
layer_27/width_131k/average_l0_171 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 131072 | none | |
layer_27/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 131072 | none | |
layer_27/width_131k/average_l0_33 Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-res-131k__l0-33 | blocks.27.hook_resid_post | 131072 | none |
layer_27/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 131072 | none | |
layer_27/width_131k/average_l0_96 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 131072 | none | |
layer_27/width_16k/average_l0_118 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 16384 | none | |
layer_27/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 16384 | none | |
layer_27/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 16384 | none | |
layer_27/width_16k/average_l0_230 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 16384 | none | |
layer_27/width_16k/average_l0_36 Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-res-16k__l0-36 | blocks.27.hook_resid_post | 16384 | none |
layer_27/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.27.hook_resid_post | 16384 | none | |
layer_28/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 131072 | none | |
layer_28/width_131k/average_l0_171 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 131072 | none | |
layer_28/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 131072 | none | |
layer_28/width_131k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-res-131k__l0-32 | blocks.28.hook_resid_post | 131072 | none |
layer_28/width_131k/average_l0_57 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 131072 | none | |
layer_28/width_131k/average_l0_98 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 131072 | none | |
layer_28/width_16k/average_l0_119 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 16384 | none | |
layer_28/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 16384 | none | |
layer_28/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 16384 | none | |
layer_28/width_16k/average_l0_229 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 16384 | none | |
layer_28/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-res-16k__l0-37 | blocks.28.hook_resid_post | 16384 | none |
layer_28/width_16k/average_l0_65 Load this SAE |
jumprelu | blocks.28.hook_resid_post | 16384 | none | |
layer_29/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 131072 | none | |
layer_29/width_131k/average_l0_171 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 131072 | none | |
layer_29/width_131k/average_l0_19 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 131072 | none | |
layer_29/width_131k/average_l0_33 Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-res-131k__l0-33 | blocks.29.hook_resid_post | 131072 | none |
layer_29/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 131072 | none | |
layer_29/width_131k/average_l0_97 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 131072 | none | |
layer_29/width_16k/average_l0_119 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 16384 | none | |
layer_29/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 16384 | none | |
layer_29/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 16384 | none | |
layer_29/width_16k/average_l0_224 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 16384 | none | |
layer_29/width_16k/average_l0_38 Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-res-16k__l0-38 | blocks.29.hook_resid_post | 16384 | none |
layer_29/width_16k/average_l0_66 Load this SAE |
jumprelu | blocks.29.hook_resid_post | 16384 | none | |
layer_3/width_131k/average_l0_103 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 131072 | none | |
layer_3/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 131072 | none | |
layer_3/width_131k/average_l0_25 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 131072 | none | |
layer_3/width_131k/average_l0_46 Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-res-131k__l0-46 | blocks.3.hook_resid_post | 131072 | none |
layer_3/width_131k/average_l0_6 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 131072 | none | |
layer_3/width_131k/average_l0_9 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 131072 | none | |
layer_3/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_17 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_229 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_3/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-res-16k__l0-37 | blocks.3.hook_resid_post | 16384 | none |
layer_3/width_16k/average_l0_90 Load this SAE |
jumprelu | blocks.3.hook_resid_post | 16384 | none | |
layer_30/width_131k/average_l0_11 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 131072 | none | |
layer_30/width_131k/average_l0_170 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 131072 | none | |
layer_30/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 131072 | none | |
layer_30/width_131k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-res-131k__l0-32 | blocks.30.hook_resid_post | 131072 | none |
layer_30/width_131k/average_l0_56 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 131072 | none | |
layer_30/width_131k/average_l0_95 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 131072 | none | |
layer_30/width_16k/average_l0_12 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 16384 | none | |
layer_30/width_16k/average_l0_120 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 16384 | none | |
layer_30/width_16k/average_l0_21 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 16384 | none | |
layer_30/width_16k/average_l0_226 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 16384 | none | |
layer_30/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-res-16k__l0-37 | blocks.30.hook_resid_post | 16384 | none |
layer_30/width_16k/average_l0_66 Load this SAE |
jumprelu | blocks.30.hook_resid_post | 16384 | none | |
layer_31/width_131k/average_l0_10 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-131k__l0-10 | blocks.31.hook_resid_post | 131072 | none |
layer_31/width_131k/average_l0_160 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-131k__l0-160 | blocks.31.hook_resid_post | 131072 | none |
layer_31/width_131k/average_l0_18 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-131k__l0-18 | blocks.31.hook_resid_post | 131072 | none |
layer_31/width_131k/average_l0_31 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-131k__l0-31 | blocks.31.hook_resid_post | 131072 | none |
layer_31/width_131k/average_l0_52 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-131k__l0-52 | blocks.31.hook_resid_post | 131072 | none |
layer_31/width_131k/average_l0_92 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 131072 | none | |
layer_31/width_16k/average_l0_11 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k__l0-11 | blocks.31.hook_resid_post | 16384 | none |
layer_31/width_16k/average_l0_114 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k__l0-114 | blocks.31.hook_resid_post | 16384 | none |
layer_31/width_16k/average_l0_20 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k__l0-20 | blocks.31.hook_resid_post | 16384 | none |
layer_31/width_16k/average_l0_218 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k__l0-218 | blocks.31.hook_resid_post | 16384 | none |
layer_31/width_16k/average_l0_35 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k__l0-35 | blocks.31.hook_resid_post | 16384 | none |
layer_31/width_16k/average_l0_63 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k__l0-63 | blocks.31.hook_resid_post | 16384 | none |
layer_31/width_1m/average_l0_11 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-1m__l0-11 | blocks.31.hook_resid_post | 1048576 | none |
layer_31/width_1m/average_l0_132 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-1m__l0-132 | blocks.31.hook_resid_post | 1048576 | none |
layer_31/width_1m/average_l0_25 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-1m__l0-25 | blocks.31.hook_resid_post | 1048576 | none |
layer_31/width_1m/average_l0_27 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-1m__l0-27 | blocks.31.hook_resid_post | 1048576 | none |
layer_31/width_1m/average_l0_45 Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-1m__l0-45 | blocks.31.hook_resid_post | 1048576 | none |
layer_31/width_1m/average_l0_77 Load this SAE |
jumprelu | blocks.31.hook_resid_post | 1048576 | none | |
layer_32/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 131072 | none | |
layer_32/width_131k/average_l0_158 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 131072 | none | |
layer_32/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 131072 | none | |
layer_32/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 131072 | none | |
layer_32/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-res-131k__l0-51 | blocks.32.hook_resid_post | 131072 | none |
layer_32/width_131k/average_l0_88 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 131072 | none | |
layer_32/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 16384 | none | |
layer_32/width_16k/average_l0_111 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 16384 | none | |
layer_32/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 16384 | none | |
layer_32/width_16k/average_l0_219 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 16384 | none | |
layer_32/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-res-16k__l0-34 | blocks.32.hook_resid_post | 16384 | none |
layer_32/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.32.hook_resid_post | 16384 | none | |
layer_33/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 131072 | none | |
layer_33/width_131k/average_l0_165 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 131072 | none | |
layer_33/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 131072 | none | |
layer_33/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 131072 | none | |
layer_33/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-res-131k__l0-51 | blocks.33.hook_resid_post | 131072 | none |
layer_33/width_131k/average_l0_91 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 131072 | none | |
layer_33/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 16384 | none | |
layer_33/width_16k/average_l0_114 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 16384 | none | |
layer_33/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 16384 | none | |
layer_33/width_16k/average_l0_228 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 16384 | none | |
layer_33/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-res-16k__l0-34 | blocks.33.hook_resid_post | 16384 | none |
layer_33/width_16k/average_l0_63 Load this SAE |
jumprelu | blocks.33.hook_resid_post | 16384 | none | |
layer_34/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_163 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-res-131k__l0-51 | blocks.34.hook_resid_post | 131072 | none |
layer_34/width_131k/average_l0_89 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 131072 | none | |
layer_34/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 16384 | none | |
layer_34/width_16k/average_l0_114 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 16384 | none | |
layer_34/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 16384 | none | |
layer_34/width_16k/average_l0_229 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 16384 | none | |
layer_34/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-res-16k__l0-34 | blocks.34.hook_resid_post | 16384 | none |
layer_34/width_16k/average_l0_60 Load this SAE |
jumprelu | blocks.34.hook_resid_post | 16384 | none | |
layer_35/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 131072 | none | |
layer_35/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 131072 | none | |
layer_35/width_131k/average_l0_171 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 131072 | none | |
layer_35/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 131072 | none | |
layer_35/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-res-131k__l0-51 | blocks.35.hook_resid_post | 131072 | none |
layer_35/width_131k/average_l0_94 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 131072 | none | |
layer_35/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 16384 | none | |
layer_35/width_16k/average_l0_120 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 16384 | none | |
layer_35/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 16384 | none | |
layer_35/width_16k/average_l0_246 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 16384 | none | |
layer_35/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-res-16k__l0-34 | blocks.35.hook_resid_post | 16384 | none |
layer_35/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.35.hook_resid_post | 16384 | none | |
layer_36/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 131072 | none | |
layer_36/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 131072 | none | |
layer_36/width_131k/average_l0_180 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 131072 | none | |
layer_36/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 131072 | none | |
layer_36/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-res-131k__l0-51 | blocks.36.hook_resid_post | 131072 | none |
layer_36/width_131k/average_l0_93 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 131072 | none | |
layer_36/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 16384 | none | |
layer_36/width_16k/average_l0_120 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 16384 | none | |
layer_36/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 16384 | none | |
layer_36/width_16k/average_l0_252 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 16384 | none | |
layer_36/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-res-16k__l0-34 | blocks.36.hook_resid_post | 16384 | none |
layer_36/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.36.hook_resid_post | 16384 | none | |
layer_37/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 131072 | none | |
layer_37/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 131072 | none | |
layer_37/width_131k/average_l0_184 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 131072 | none | |
layer_37/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 131072 | none | |
layer_37/width_131k/average_l0_53 Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-res-131k__l0-53 | blocks.37.hook_resid_post | 131072 | none |
layer_37/width_131k/average_l0_96 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 131072 | none | |
layer_37/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 16384 | none | |
layer_37/width_16k/average_l0_124 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 16384 | none | |
layer_37/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 16384 | none | |
layer_37/width_16k/average_l0_266 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 16384 | none | |
layer_37/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-res-16k__l0-34 | blocks.37.hook_resid_post | 16384 | none |
layer_37/width_16k/average_l0_63 Load this SAE |
jumprelu | blocks.37.hook_resid_post | 16384 | none | |
layer_38/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 131072 | none | |
layer_38/width_131k/average_l0_101 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 131072 | none | |
layer_38/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 131072 | none | |
layer_38/width_131k/average_l0_194 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 131072 | none | |
layer_38/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 131072 | none | |
layer_38/width_131k/average_l0_53 Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-res-131k__l0-53 | blocks.38.hook_resid_post | 131072 | none |
layer_38/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 16384 | none | |
layer_38/width_16k/average_l0_128 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 16384 | none | |
layer_38/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 16384 | none | |
layer_38/width_16k/average_l0_286 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 16384 | none | |
layer_38/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-res-16k__l0-34 | blocks.38.hook_resid_post | 16384 | none |
layer_38/width_16k/average_l0_64 Load this SAE |
jumprelu | blocks.38.hook_resid_post | 16384 | none | |
layer_39/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 131072 | none | |
layer_39/width_131k/average_l0_18 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 131072 | none | |
layer_39/width_131k/average_l0_199 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 131072 | none | |
layer_39/width_131k/average_l0_30 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 131072 | none | |
layer_39/width_131k/average_l0_54 Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-res-131k__l0-54 | blocks.39.hook_resid_post | 131072 | none |
layer_39/width_131k/average_l0_99 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 131072 | none | |
layer_39/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 16384 | none | |
layer_39/width_16k/average_l0_131 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 16384 | none | |
layer_39/width_16k/average_l0_19 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 16384 | none | |
layer_39/width_16k/average_l0_298 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 16384 | none | |
layer_39/width_16k/average_l0_34 Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-res-16k__l0-34 | blocks.39.hook_resid_post | 16384 | none |
layer_39/width_16k/average_l0_64 Load this SAE |
jumprelu | blocks.39.hook_resid_post | 16384 | none | |
layer_4/width_131k/average_l0_101 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 131072 | none | |
layer_4/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 131072 | none | |
layer_4/width_131k/average_l0_28 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 131072 | none | |
layer_4/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-res-131k__l0-51 | blocks.4.hook_resid_post | 131072 | none |
layer_4/width_131k/average_l0_6 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 131072 | none | |
layer_4/width_131k/average_l0_9 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 131072 | none | |
layer_4/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_234 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_4/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-res-16k__l0-37 | blocks.4.hook_resid_post | 16384 | none |
layer_4/width_16k/average_l0_91 Load this SAE |
jumprelu | blocks.4.hook_resid_post | 16384 | none | |
layer_40/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 131072 | none | |
layer_40/width_131k/average_l0_17 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 131072 | none | |
layer_40/width_131k/average_l0_193 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 131072 | none | |
layer_40/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 131072 | none | |
layer_40/width_131k/average_l0_49 Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-res-131k__l0-49 | blocks.40.hook_resid_post | 131072 | none |
layer_40/width_131k/average_l0_94 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 131072 | none | |
layer_40/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 16384 | none | |
layer_40/width_16k/average_l0_125 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 16384 | none | |
layer_40/width_16k/average_l0_18 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 16384 | none | |
layer_40/width_16k/average_l0_292 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 16384 | none | |
layer_40/width_16k/average_l0_32 Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-res-16k__l0-32 | blocks.40.hook_resid_post | 16384 | none |
layer_40/width_16k/average_l0_61 Load this SAE |
jumprelu | blocks.40.hook_resid_post | 16384 | none | |
layer_41/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 131072 | none | |
layer_41/width_131k/average_l0_15 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 131072 | none | |
layer_41/width_131k/average_l0_175 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 131072 | none | |
layer_41/width_131k/average_l0_26 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 131072 | none | |
layer_41/width_131k/average_l0_45 Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-res-131k__l0-45 | blocks.41.hook_resid_post | 131072 | none |
layer_41/width_131k/average_l0_84 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 131072 | none | |
layer_41/width_16k/average_l0_10 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 16384 | none | |
layer_41/width_16k/average_l0_113 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 16384 | none | |
layer_41/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 16384 | none | |
layer_41/width_16k/average_l0_270 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 16384 | none | |
layer_41/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.41.hook_resid_post | 16384 | none | |
layer_41/width_16k/average_l0_52 Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-res-16k__l0-52 | blocks.41.hook_resid_post | 16384 | none |
layer_5/width_131k/average_l0_10 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 131072 | none | |
layer_5/width_131k/average_l0_16 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 131072 | none | |
layer_5/width_131k/average_l0_29 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 131072 | none | |
layer_5/width_131k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-res-131k__l0-51 | blocks.5.hook_resid_post | 131072 | none |
layer_5/width_131k/average_l0_6 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 131072 | none | |
layer_5/width_131k/average_l0_94 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 131072 | none | |
layer_5/width_16k/average_l0_11 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 16384 | none | |
layer_5/width_16k/average_l0_193 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 16384 | none | |
layer_5/width_16k/average_l0_20 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 16384 | none | |
layer_5/width_16k/average_l0_37 Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-res-16k__l0-37 | blocks.5.hook_resid_post | 16384 | none |
layer_5/width_16k/average_l0_77 Load this SAE |
jumprelu | blocks.5.hook_resid_post | 16384 | none | |
layer_6/width_131k/average_l0_12 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 131072 | none | |
layer_6/width_131k/average_l0_120 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 131072 | none | |
layer_6/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 131072 | none | |
layer_6/width_131k/average_l0_36 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 131072 | none | |
layer_6/width_131k/average_l0_66 Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-res-131k__l0-66 | blocks.6.hook_resid_post | 131072 | none |
layer_6/width_131k/average_l0_7 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 131072 | none | |
layer_6/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_224 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_47 Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-res-16k__l0-47 | blocks.6.hook_resid_post | 16384 | none |
layer_6/width_16k/average_l0_8 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_6/width_16k/average_l0_93 Load this SAE |
jumprelu | blocks.6.hook_resid_post | 16384 | none | |
layer_7/width_131k/average_l0_119 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 131072 | none | |
layer_7/width_131k/average_l0_13 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 131072 | none | |
layer_7/width_131k/average_l0_21 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 131072 | none | |
layer_7/width_131k/average_l0_38 Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-res-131k__l0-38 | blocks.7.hook_resid_post | 131072 | none |
layer_7/width_131k/average_l0_65 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 131072 | none | |
layer_7/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 131072 | none | |
layer_7/width_16k/average_l0_14 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_198 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_25 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_46 Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-res-16k__l0-46 | blocks.7.hook_resid_post | 16384 | none |
layer_7/width_16k/average_l0_8 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_7/width_16k/average_l0_92 Load this SAE |
jumprelu | blocks.7.hook_resid_post | 16384 | none | |
layer_8/width_131k/average_l0_129 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 131072 | none | |
layer_8/width_131k/average_l0_14 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 131072 | none | |
layer_8/width_131k/average_l0_24 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 131072 | none | |
layer_8/width_131k/average_l0_41 Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-res-131k__l0-41 | blocks.8.hook_resid_post | 131072 | none |
layer_8/width_131k/average_l0_72 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 131072 | none | |
layer_8/width_131k/average_l0_8 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 131072 | none | |
layer_8/width_16k/average_l0_16 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_207 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_28 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-res-16k__l0-51 | blocks.8.hook_resid_post | 16384 | none |
layer_8/width_16k/average_l0_9 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_8/width_16k/average_l0_99 Load this SAE |
jumprelu | blocks.8.hook_resid_post | 16384 | none | |
layer_9/width_131k/average_l0_134 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-131k__l0-134 | blocks.9.hook_resid_post | 131072 | none |
layer_9/width_131k/average_l0_14 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-131k__l0-14 | blocks.9.hook_resid_post | 131072 | none |
layer_9/width_131k/average_l0_25 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-131k__l0-25 | blocks.9.hook_resid_post | 131072 | none |
layer_9/width_131k/average_l0_42 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-131k__l0-42 | blocks.9.hook_resid_post | 131072 | none |
layer_9/width_131k/average_l0_75 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 131072 | none | |
layer_9/width_131k/average_l0_8 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-131k__l0-8 | blocks.9.hook_resid_post | 131072 | none |
layer_9/width_16k/average_l0_100 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 16384 | none | |
layer_9/width_16k/average_l0_16 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-16k__l0-16 | blocks.9.hook_resid_post | 16384 | none |
layer_9/width_16k/average_l0_209 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-16k__l0-209 | blocks.9.hook_resid_post | 16384 | none |
layer_9/width_16k/average_l0_28 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-16k__l0-28 | blocks.9.hook_resid_post | 16384 | none |
layer_9/width_16k/average_l0_51 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-16k__l0-51 | blocks.9.hook_resid_post | 16384 | none |
layer_9/width_16k/average_l0_9 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-16k__l0-9 | blocks.9.hook_resid_post | 16384 | none |
layer_9/width_1m/average_l0_122 Load this SAE |
jumprelu | blocks.9.hook_resid_post | 1048576 | none | |
layer_9/width_1m/average_l0_14 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-1m__l0-14 | blocks.9.hook_resid_post | 1048576 | none |
layer_9/width_1m/average_l0_24 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-1m__l0-24 | blocks.9.hook_resid_post | 1048576 | none |
layer_9/width_1m/average_l0_41 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-1m__l0-41 | blocks.9.hook_resid_post | 1048576 | none |
layer_9/width_1m/average_l0_70 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-1m__l0-70 | blocks.9.hook_resid_post | 1048576 | none |
layer_9/width_1m/average_l0_9 Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-1m__l0-9 | blocks.9.hook_resid_post | 1048576 | none |
gemma-scope-9b-pt-res-canonical
- Huggingface Repo: google/gemma-scope-9b-pt-res
- model: gemma-2-9b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-res-16k | blocks.0.hook_resid_post | 16384 | none |
layer_1/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-res-16k | blocks.1.hook_resid_post | 16384 | none |
layer_2/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-res-16k | blocks.2.hook_resid_post | 16384 | none |
layer_3/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-res-16k | blocks.3.hook_resid_post | 16384 | none |
layer_4/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-res-16k | blocks.4.hook_resid_post | 16384 | none |
layer_5/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-res-16k | blocks.5.hook_resid_post | 16384 | none |
layer_6/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-res-16k | blocks.6.hook_resid_post | 16384 | none |
layer_7/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-res-16k | blocks.7.hook_resid_post | 16384 | none |
layer_8/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-res-16k | blocks.8.hook_resid_post | 16384 | none |
layer_9/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-16k | blocks.9.hook_resid_post | 16384 | none |
layer_10/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-res-16k | blocks.10.hook_resid_post | 16384 | none |
layer_11/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-res-16k | blocks.11.hook_resid_post | 16384 | none |
layer_12/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-res-16k | blocks.12.hook_resid_post | 16384 | none |
layer_13/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-res-16k | blocks.13.hook_resid_post | 16384 | none |
layer_14/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-res-16k | blocks.14.hook_resid_post | 16384 | none |
layer_15/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-res-16k | blocks.15.hook_resid_post | 16384 | none |
layer_16/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-res-16k | blocks.16.hook_resid_post | 16384 | none |
layer_17/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-res-16k | blocks.17.hook_resid_post | 16384 | none |
layer_18/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-res-16k | blocks.18.hook_resid_post | 16384 | none |
layer_19/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-res-16k | blocks.19.hook_resid_post | 16384 | none |
layer_20/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-16k | blocks.20.hook_resid_post | 16384 | none |
layer_21/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-res-16k | blocks.21.hook_resid_post | 16384 | none |
layer_22/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-res-16k | blocks.22.hook_resid_post | 16384 | none |
layer_23/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-res-16k | blocks.23.hook_resid_post | 16384 | none |
layer_24/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-res-16k | blocks.24.hook_resid_post | 16384 | none |
layer_25/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-res-16k | blocks.25.hook_resid_post | 16384 | none |
layer_26/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-res-16k | blocks.26.hook_resid_post | 16384 | none |
layer_27/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-res-16k | blocks.27.hook_resid_post | 16384 | none |
layer_28/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-res-16k | blocks.28.hook_resid_post | 16384 | none |
layer_29/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-res-16k | blocks.29.hook_resid_post | 16384 | none |
layer_30/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-res-16k | blocks.30.hook_resid_post | 16384 | none |
layer_31/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-16k | blocks.31.hook_resid_post | 16384 | none |
layer_32/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-res-16k | blocks.32.hook_resid_post | 16384 | none |
layer_33/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-res-16k | blocks.33.hook_resid_post | 16384 | none |
layer_34/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-res-16k | blocks.34.hook_resid_post | 16384 | none |
layer_35/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-res-16k | blocks.35.hook_resid_post | 16384 | none |
layer_36/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-res-16k | blocks.36.hook_resid_post | 16384 | none |
layer_37/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-res-16k | blocks.37.hook_resid_post | 16384 | none |
layer_38/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-res-16k | blocks.38.hook_resid_post | 16384 | none |
layer_39/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-res-16k | blocks.39.hook_resid_post | 16384 | none |
layer_40/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-res-16k | blocks.40.hook_resid_post | 16384 | none |
layer_41/width_16k/canonical Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-res-16k | blocks.41.hook_resid_post | 16384 | none |
layer_0/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/0-gemmascope-res-131k | blocks.0.hook_resid_post | 131072 | none |
layer_1/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/1-gemmascope-res-131k | blocks.1.hook_resid_post | 131072 | none |
layer_2/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/2-gemmascope-res-131k | blocks.2.hook_resid_post | 131072 | none |
layer_3/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/3-gemmascope-res-131k | blocks.3.hook_resid_post | 131072 | none |
layer_4/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/4-gemmascope-res-131k | blocks.4.hook_resid_post | 131072 | none |
layer_5/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/5-gemmascope-res-131k | blocks.5.hook_resid_post | 131072 | none |
layer_6/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/6-gemmascope-res-131k | blocks.6.hook_resid_post | 131072 | none |
layer_7/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/7-gemmascope-res-131k | blocks.7.hook_resid_post | 131072 | none |
layer_8/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/8-gemmascope-res-131k | blocks.8.hook_resid_post | 131072 | none |
layer_9/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-131k | blocks.9.hook_resid_post | 131072 | none |
layer_10/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/10-gemmascope-res-131k | blocks.10.hook_resid_post | 131072 | none |
layer_11/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/11-gemmascope-res-131k | blocks.11.hook_resid_post | 131072 | none |
layer_12/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/12-gemmascope-res-131k | blocks.12.hook_resid_post | 131072 | none |
layer_13/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/13-gemmascope-res-131k | blocks.13.hook_resid_post | 131072 | none |
layer_14/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/14-gemmascope-res-131k | blocks.14.hook_resid_post | 131072 | none |
layer_15/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/15-gemmascope-res-131k | blocks.15.hook_resid_post | 131072 | none |
layer_16/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/16-gemmascope-res-131k | blocks.16.hook_resid_post | 131072 | none |
layer_17/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/17-gemmascope-res-131k | blocks.17.hook_resid_post | 131072 | none |
layer_18/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/18-gemmascope-res-131k | blocks.18.hook_resid_post | 131072 | none |
layer_19/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/19-gemmascope-res-131k | blocks.19.hook_resid_post | 131072 | none |
layer_20/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-131k | blocks.20.hook_resid_post | 131072 | none |
layer_21/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/21-gemmascope-res-131k | blocks.21.hook_resid_post | 131072 | none |
layer_22/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/22-gemmascope-res-131k | blocks.22.hook_resid_post | 131072 | none |
layer_23/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/23-gemmascope-res-131k | blocks.23.hook_resid_post | 131072 | none |
layer_24/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/24-gemmascope-res-131k | blocks.24.hook_resid_post | 131072 | none |
layer_25/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/25-gemmascope-res-131k | blocks.25.hook_resid_post | 131072 | none |
layer_26/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/26-gemmascope-res-131k | blocks.26.hook_resid_post | 131072 | none |
layer_27/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/27-gemmascope-res-131k | blocks.27.hook_resid_post | 131072 | none |
layer_28/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/28-gemmascope-res-131k | blocks.28.hook_resid_post | 131072 | none |
layer_29/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/29-gemmascope-res-131k | blocks.29.hook_resid_post | 131072 | none |
layer_30/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/30-gemmascope-res-131k | blocks.30.hook_resid_post | 131072 | none |
layer_31/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-131k | blocks.31.hook_resid_post | 131072 | none |
layer_32/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/32-gemmascope-res-131k | blocks.32.hook_resid_post | 131072 | none |
layer_33/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/33-gemmascope-res-131k | blocks.33.hook_resid_post | 131072 | none |
layer_34/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/34-gemmascope-res-131k | blocks.34.hook_resid_post | 131072 | none |
layer_35/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/35-gemmascope-res-131k | blocks.35.hook_resid_post | 131072 | none |
layer_36/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/36-gemmascope-res-131k | blocks.36.hook_resid_post | 131072 | none |
layer_37/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/37-gemmascope-res-131k | blocks.37.hook_resid_post | 131072 | none |
layer_38/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/38-gemmascope-res-131k | blocks.38.hook_resid_post | 131072 | none |
layer_39/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/39-gemmascope-res-131k | blocks.39.hook_resid_post | 131072 | none |
layer_40/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/40-gemmascope-res-131k | blocks.40.hook_resid_post | 131072 | none |
layer_41/width_131k/canonical Load this SAE |
jumprelu | gemma-2-9b/41-gemmascope-res-131k | blocks.41.hook_resid_post | 131072 | none |
layer_9/width_1m/canonical Load this SAE |
jumprelu | gemma-2-9b/9-gemmascope-res-1m | blocks.9.hook_resid_post | 1048576 | none |
layer_20/width_1m/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-1m | blocks.20.hook_resid_post | 1048576 | none |
layer_31/width_1m/canonical Load this SAE |
jumprelu | gemma-2-9b/31-gemmascope-res-1m | blocks.31.hook_resid_post | 1048576 | none |
layer_20/width_32k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-32k | blocks.20.hook_resid_post | 32768 | none |
layer_20/width_524k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-524k | blocks.20.hook_resid_post | 524288 | none |
layer_20/width_65k/canonical Load this SAE |
jumprelu | gemma-2-9b/20-gemmascope-res-65k | blocks.20.hook_resid_post | 65536 | none |
gpt2-small-attn-out-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-attn-out-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_attn_out Load this SAE |
topk | gpt2-small/0-att_128k-oai | blocks.0.hook_attn_out | 131072 | layer_norm |
blocks.1.hook_attn_out Load this SAE |
topk | gpt2-small/1-att_128k-oai | blocks.1.hook_attn_out | 131072 | layer_norm |
blocks.2.hook_attn_out Load this SAE |
topk | gpt2-small/2-att_128k-oai | blocks.2.hook_attn_out | 131072 | layer_norm |
blocks.3.hook_attn_out Load this SAE |
topk | gpt2-small/3-att_128k-oai | blocks.3.hook_attn_out | 131072 | layer_norm |
blocks.4.hook_attn_out Load this SAE |
topk | gpt2-small/4-att_128k-oai | blocks.4.hook_attn_out | 131072 | layer_norm |
blocks.5.hook_attn_out Load this SAE |
topk | gpt2-small/5-att_128k-oai | blocks.5.hook_attn_out | 131072 | layer_norm |
blocks.6.hook_attn_out Load this SAE |
topk | gpt2-small/6-att_128k-oai | blocks.6.hook_attn_out | 131072 | layer_norm |
blocks.7.hook_attn_out Load this SAE |
topk | gpt2-small/7-att_128k-oai | blocks.7.hook_attn_out | 131072 | layer_norm |
blocks.8.hook_attn_out Load this SAE |
topk | gpt2-small/8-att_128k-oai | blocks.8.hook_attn_out | 131072 | layer_norm |
blocks.9.hook_attn_out Load this SAE |
topk | gpt2-small/9-att_128k-oai | blocks.9.hook_attn_out | 131072 | layer_norm |
blocks.10.hook_attn_out Load this SAE |
topk | gpt2-small/10-att_128k-oai | blocks.10.hook_attn_out | 131072 | layer_norm |
blocks.11.hook_attn_out Load this SAE |
topk | gpt2-small/11-att_128k-oai | blocks.11.hook_attn_out | 131072 | layer_norm |
gpt2-small-attn-out-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-attn-out-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_attn_out Load this SAE |
topk | gpt2-small/0-att_32k-oai | blocks.0.hook_attn_out | 32768 | layer_norm |
blocks.1.hook_attn_out Load this SAE |
topk | gpt2-small/1-att_32k-oai | blocks.1.hook_attn_out | 32768 | layer_norm |
blocks.2.hook_attn_out Load this SAE |
topk | gpt2-small/2-att_32k-oai | blocks.2.hook_attn_out | 32768 | layer_norm |
blocks.3.hook_attn_out Load this SAE |
topk | gpt2-small/3-att_32k-oai | blocks.3.hook_attn_out | 32768 | layer_norm |
blocks.4.hook_attn_out Load this SAE |
topk | gpt2-small/4-att_32k-oai | blocks.4.hook_attn_out | 32768 | layer_norm |
blocks.5.hook_attn_out Load this SAE |
topk | gpt2-small/5-att_32k-oai | blocks.5.hook_attn_out | 32768 | layer_norm |
blocks.6.hook_attn_out Load this SAE |
topk | gpt2-small/6-att_32k-oai | blocks.6.hook_attn_out | 32768 | layer_norm |
blocks.7.hook_attn_out Load this SAE |
topk | gpt2-small/7-att_32k-oai | blocks.7.hook_attn_out | 32768 | layer_norm |
blocks.8.hook_attn_out Load this SAE |
topk | gpt2-small/8-att_32k-oai | blocks.8.hook_attn_out | 32768 | layer_norm |
blocks.9.hook_attn_out Load this SAE |
topk | gpt2-small/9-att_32k-oai | blocks.9.hook_attn_out | 32768 | layer_norm |
blocks.10.hook_attn_out Load this SAE |
topk | gpt2-small/10-att_32k-oai | blocks.10.hook_attn_out | 32768 | layer_norm |
blocks.11.hook_attn_out Load this SAE |
topk | gpt2-small/11-att_32k-oai | blocks.11.hook_attn_out | 32768 | layer_norm |
gpt2-small-hook-z-kk
- Huggingface Repo: ckkissane/attn-saes-gpt2-small-all-layers
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_z Load this SAE |
standard | gpt2-small/0-att-kk | blocks.0.attn.hook_z | 24576 | none |
blocks.1.hook_z Load this SAE |
standard | gpt2-small/1-att-kk | blocks.1.attn.hook_z | 24576 | none |
blocks.2.hook_z Load this SAE |
standard | gpt2-small/2-att-kk | blocks.2.attn.hook_z | 24576 | none |
blocks.3.hook_z Load this SAE |
standard | gpt2-small/3-att-kk | blocks.3.attn.hook_z | 24576 | none |
blocks.4.hook_z Load this SAE |
standard | gpt2-small/4-att-kk | blocks.4.attn.hook_z | 24576 | none |
blocks.5.hook_z Load this SAE |
standard | gpt2-small/5-att-kk | blocks.5.attn.hook_z | 49152 | none |
blocks.6.hook_z Load this SAE |
standard | gpt2-small/6-att-kk | blocks.6.attn.hook_z | 24576 | none |
blocks.7.hook_z Load this SAE |
standard | gpt2-small/7-att-kk | blocks.7.attn.hook_z | 49152 | none |
blocks.8.hook_z Load this SAE |
standard | gpt2-small/8-att-kk | blocks.8.attn.hook_z | 24576 | none |
blocks.9.hook_z Load this SAE |
standard | gpt2-small/9-att-kk | blocks.9.attn.hook_z | 24576 | none |
blocks.10.hook_z Load this SAE |
standard | gpt2-small/10-att-kk | blocks.10.attn.hook_z | 24576 | none |
blocks.11.hook_z Load this SAE |
standard | gpt2-small/11-att-kk | blocks.11.attn.hook_z | 24576 | none |
gpt2-small-mlp-out-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-mlp-out-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
topk | gpt2-small/0-mlp_128k-oai | blocks.0.hook_mlp_out | 131072 | layer_norm |
blocks.1.hook_mlp_out Load this SAE |
topk | gpt2-small/1-mlp_128k-oai | blocks.1.hook_mlp_out | 131072 | layer_norm |
blocks.2.hook_mlp_out Load this SAE |
topk | gpt2-small/2-mlp_128k-oai | blocks.2.hook_mlp_out | 131072 | layer_norm |
blocks.3.hook_mlp_out Load this SAE |
topk | gpt2-small/3-mlp_128k-oai | blocks.3.hook_mlp_out | 131072 | layer_norm |
blocks.4.hook_mlp_out Load this SAE |
topk | gpt2-small/4-mlp_128k-oai | blocks.4.hook_mlp_out | 131072 | layer_norm |
blocks.5.hook_mlp_out Load this SAE |
topk | gpt2-small/5-mlp_128k-oai | blocks.5.hook_mlp_out | 131072 | layer_norm |
blocks.6.hook_mlp_out Load this SAE |
topk | gpt2-small/6-mlp_128k-oai | blocks.6.hook_mlp_out | 131072 | layer_norm |
blocks.7.hook_mlp_out Load this SAE |
topk | gpt2-small/7-mlp_128k-oai | blocks.7.hook_mlp_out | 131072 | layer_norm |
blocks.8.hook_mlp_out Load this SAE |
topk | gpt2-small/8-mlp_128k-oai | blocks.8.hook_mlp_out | 131072 | layer_norm |
blocks.9.hook_mlp_out Load this SAE |
topk | gpt2-small/9-mlp_128k-oai | blocks.9.hook_mlp_out | 131072 | layer_norm |
blocks.10.hook_mlp_out Load this SAE |
topk | gpt2-small/10-mlp_128k-oai | blocks.10.hook_mlp_out | 131072 | layer_norm |
blocks.11.hook_mlp_out Load this SAE |
topk | gpt2-small/11-mlp_128k-oai | blocks.11.hook_mlp_out | 131072 | layer_norm |
gpt2-small-mlp-out-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-mlp-out-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
topk | gpt2-small/0-mlp_32k-oai | blocks.0.hook_mlp_out | 32768 | layer_norm |
blocks.1.hook_mlp_out Load this SAE |
topk | gpt2-small/1-mlp_32k-oai | blocks.1.hook_mlp_out | 32768 | layer_norm |
blocks.2.hook_mlp_out Load this SAE |
topk | gpt2-small/2-mlp_32k-oai | blocks.2.hook_mlp_out | 32768 | layer_norm |
blocks.3.hook_mlp_out Load this SAE |
topk | gpt2-small/3-mlp_32k-oai | blocks.3.hook_mlp_out | 32768 | layer_norm |
blocks.4.hook_mlp_out Load this SAE |
topk | gpt2-small/4-mlp_32k-oai | blocks.4.hook_mlp_out | 32768 | layer_norm |
blocks.5.hook_mlp_out Load this SAE |
topk | gpt2-small/5-mlp_32k-oai | blocks.5.hook_mlp_out | 32768 | layer_norm |
blocks.6.hook_mlp_out Load this SAE |
topk | gpt2-small/6-mlp_32k-oai | blocks.6.hook_mlp_out | 32768 | layer_norm |
blocks.7.hook_mlp_out Load this SAE |
topk | gpt2-small/7-mlp_32k-oai | blocks.7.hook_mlp_out | 32768 | layer_norm |
blocks.8.hook_mlp_out Load this SAE |
topk | gpt2-small/8-mlp_32k-oai | blocks.8.hook_mlp_out | 32768 | layer_norm |
blocks.9.hook_mlp_out Load this SAE |
topk | gpt2-small/9-mlp_32k-oai | blocks.9.hook_mlp_out | 32768 | layer_norm |
blocks.10.hook_mlp_out Load this SAE |
topk | gpt2-small/10-mlp_32k-oai | blocks.10.hook_mlp_out | 32768 | layer_norm |
blocks.11.hook_mlp_out Load this SAE |
topk | gpt2-small/11-mlp_32k-oai | blocks.11.hook_mlp_out | 32768 | layer_norm |
gpt2-small-mlp-tm
- Huggingface Repo: tommmcgrath/gpt2-small-mlp-out-saes
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
standard | blocks.0.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.1.hook_mlp_out Load this SAE |
standard | blocks.1.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.2.hook_mlp_out Load this SAE |
standard | blocks.2.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.3.hook_mlp_out Load this SAE |
standard | blocks.3.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.4.hook_mlp_out Load this SAE |
standard | blocks.4.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.5.hook_mlp_out Load this SAE |
standard | blocks.5.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.6.hook_mlp_out Load this SAE |
standard | blocks.6.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.7.hook_mlp_out Load this SAE |
standard | blocks.7.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.8.hook_mlp_out Load this SAE |
standard | blocks.8.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.9.hook_mlp_out Load this SAE |
standard | blocks.9.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.10.hook_mlp_out Load this SAE |
standard | blocks.10.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.11.hook_mlp_out Load this SAE |
standard | blocks.11.hook_mlp_out | 24576 | expected_average_only_in |
gpt2-small-res-jb
- Huggingface Repo: jbloom/GPT2-Small-SAEs-Reformatted
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_pre Load this SAE |
standard | gpt2-small/0-res-jb | blocks.0.hook_resid_pre | 24576 | none |
blocks.1.hook_resid_pre Load this SAE |
standard | gpt2-small/1-res-jb | blocks.1.hook_resid_pre | 24576 | none |
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res-jb | blocks.2.hook_resid_pre | 24576 | none |
blocks.3.hook_resid_pre Load this SAE |
standard | gpt2-small/3-res-jb | blocks.3.hook_resid_pre | 24576 | none |
blocks.4.hook_resid_pre Load this SAE |
standard | gpt2-small/4-res-jb | blocks.4.hook_resid_pre | 24576 | none |
blocks.5.hook_resid_pre Load this SAE |
standard | gpt2-small/5-res-jb | blocks.5.hook_resid_pre | 24576 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res-jb | blocks.6.hook_resid_pre | 24576 | none |
blocks.7.hook_resid_pre Load this SAE |
standard | gpt2-small/7-res-jb | blocks.7.hook_resid_pre | 24576 | none |
blocks.8.hook_resid_pre Load this SAE |
standard | gpt2-small/8-res-jb | blocks.8.hook_resid_pre | 24576 | none |
blocks.9.hook_resid_pre Load this SAE |
standard | gpt2-small/9-res-jb | blocks.9.hook_resid_pre | 24576 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res-jb | blocks.10.hook_resid_pre | 24576 | none |
blocks.11.hook_resid_pre Load this SAE |
standard | gpt2-small/11-res-jb | blocks.11.hook_resid_pre | 24576 | none |
blocks.11.hook_resid_post Load this SAE |
standard | gpt2-small/12-res-jb | blocks.11.hook_resid_post | 24576 | none |
gpt2-small-res-jb-feature-splitting
- Huggingface Repo: jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.8.hook_resid_pre_768 Load this SAE |
standard | gpt2-small/8-res_fs768-jb | blocks.8.hook_resid_pre | 768 | none |
blocks.8.hook_resid_pre_1536 Load this SAE |
standard | gpt2-small/8-res_fs1536-jb | blocks.8.hook_resid_pre | 1536 | none |
blocks.8.hook_resid_pre_3072 Load this SAE |
standard | gpt2-small/8-res_fs3072-jb | blocks.8.hook_resid_pre | 3072 | none |
blocks.8.hook_resid_pre_6144 Load this SAE |
standard | gpt2-small/8-res_fs6144-jb | blocks.8.hook_resid_pre | 6144 | none |
blocks.8.hook_resid_pre_12288 Load this SAE |
standard | gpt2-small/8-res_fs12288-jb | blocks.8.hook_resid_pre | 12288 | none |
blocks.8.hook_resid_pre_24576 Load this SAE |
standard | gpt2-small/8-res_fs24576-jb | blocks.8.hook_resid_pre | 24576 | none |
blocks.8.hook_resid_pre_49152 Load this SAE |
standard | gpt2-small/8-res_fs49152-jb | blocks.8.hook_resid_pre | 49152 | none |
blocks.8.hook_resid_pre_98304 Load this SAE |
standard | gpt2-small/8-res_fs98304-jb | blocks.8.hook_resid_pre | 98304 | none |
gpt2-small-res_sce-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_sce-ajt
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res_sce-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res_sce-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res_sce-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_scefr-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_scefr-ajt
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res_scefr-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res_scefr-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res_scefr-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_scl-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_scl-ajt
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res_scl-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res_scl-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res_scl-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_sle-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_sle-ajt
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res_sle-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res_sle-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res_sle-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_slefr-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_slefr-ajt
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res_slefr-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res_slefr-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res_slefr-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_sll-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_sll-ajt
- model: gpt2-small
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
standard | gpt2-small/2-res_sll-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
standard | gpt2-small/6-res_sll-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
standard | gpt2-small/10-res_sll-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-resid-mid-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-mid-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_mid Load this SAE |
topk | gpt2-small/0-res_mid_128k-oai | blocks.0.hook_resid_mid | 131072 | layer_norm |
blocks.1.hook_resid_mid Load this SAE |
topk | gpt2-small/1-res_mid_128k-oai | blocks.1.hook_resid_mid | 131072 | layer_norm |
blocks.2.hook_resid_mid Load this SAE |
topk | gpt2-small/2-res_mid_128k-oai | blocks.2.hook_resid_mid | 131072 | layer_norm |
blocks.3.hook_resid_mid Load this SAE |
topk | gpt2-small/3-res_mid_128k-oai | blocks.3.hook_resid_mid | 131072 | layer_norm |
blocks.4.hook_resid_mid Load this SAE |
topk | gpt2-small/4-res_mid_128k-oai | blocks.4.hook_resid_mid | 131072 | layer_norm |
blocks.5.hook_resid_mid Load this SAE |
topk | gpt2-small/5-res_mid_128k-oai | blocks.5.hook_resid_mid | 131072 | layer_norm |
blocks.6.hook_resid_mid Load this SAE |
topk | gpt2-small/6-res_mid_128k-oai | blocks.6.hook_resid_mid | 131072 | layer_norm |
blocks.7.hook_resid_mid Load this SAE |
topk | gpt2-small/7-res_mid_128k-oai | blocks.7.hook_resid_mid | 131072 | layer_norm |
blocks.8.hook_resid_mid Load this SAE |
topk | gpt2-small/8-res_mid_128k-oai | blocks.8.hook_resid_mid | 131072 | layer_norm |
blocks.9.hook_resid_mid Load this SAE |
topk | gpt2-small/9-res_mid_128k-oai | blocks.9.hook_resid_mid | 131072 | layer_norm |
blocks.10.hook_resid_mid Load this SAE |
topk | gpt2-small/10-res_mid_128k-oai | blocks.10.hook_resid_mid | 131072 | layer_norm |
blocks.11.hook_resid_mid Load this SAE |
topk | gpt2-small/11-res_mid_128k-oai | blocks.11.hook_resid_mid | 131072 | layer_norm |
gpt2-small-resid-mid-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-mid-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_mid Load this SAE |
topk | gpt2-small/0-res_mid_32k-oai | blocks.0.hook_resid_mid | 32768 | layer_norm |
blocks.1.hook_resid_mid Load this SAE |
topk | gpt2-small/1-res_mid_32k-oai | blocks.1.hook_resid_mid | 32768 | layer_norm |
blocks.2.hook_resid_mid Load this SAE |
topk | gpt2-small/2-res_mid_32k-oai | blocks.2.hook_resid_mid | 32768 | layer_norm |
blocks.3.hook_resid_mid Load this SAE |
topk | gpt2-small/3-res_mid_32k-oai | blocks.3.hook_resid_mid | 32768 | layer_norm |
blocks.4.hook_resid_mid Load this SAE |
topk | gpt2-small/4-res_mid_32k-oai | blocks.4.hook_resid_mid | 32768 | layer_norm |
blocks.5.hook_resid_mid Load this SAE |
topk | gpt2-small/5-res_mid_32k-oai | blocks.5.hook_resid_mid | 32768 | layer_norm |
blocks.6.hook_resid_mid Load this SAE |
topk | gpt2-small/6-res_mid_32k-oai | blocks.6.hook_resid_mid | 32768 | layer_norm |
blocks.7.hook_resid_mid Load this SAE |
topk | gpt2-small/7-res_mid_32k-oai | blocks.7.hook_resid_mid | 32768 | layer_norm |
blocks.8.hook_resid_mid Load this SAE |
topk | gpt2-small/8-res_mid_32k-oai | blocks.8.hook_resid_mid | 32768 | layer_norm |
blocks.9.hook_resid_mid Load this SAE |
topk | gpt2-small/9-res_mid_32k-oai | blocks.9.hook_resid_mid | 32768 | layer_norm |
blocks.10.hook_resid_mid Load this SAE |
topk | gpt2-small/10-res_mid_32k-oai | blocks.10.hook_resid_mid | 32768 | layer_norm |
blocks.11.hook_resid_mid Load this SAE |
topk | gpt2-small/11-res_mid_32k-oai | blocks.11.hook_resid_mid | 32768 | layer_norm |
gpt2-small-resid-post-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-post-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
topk | gpt2-small/0-res_post_128k-oai | blocks.0.hook_resid_post | 131072 | layer_norm |
blocks.1.hook_resid_post Load this SAE |
topk | gpt2-small/1-res_post_128k-oai | blocks.1.hook_resid_post | 131072 | layer_norm |
blocks.2.hook_resid_post Load this SAE |
topk | gpt2-small/2-res_post_128k-oai | blocks.2.hook_resid_post | 131072 | layer_norm |
blocks.3.hook_resid_post Load this SAE |
topk | gpt2-small/3-res_post_128k-oai | blocks.3.hook_resid_post | 131072 | layer_norm |
blocks.4.hook_resid_post Load this SAE |
topk | gpt2-small/4-res_post_128k-oai | blocks.4.hook_resid_post | 131072 | layer_norm |
blocks.5.hook_resid_post Load this SAE |
topk | gpt2-small/5-res_post_128k-oai | blocks.5.hook_resid_post | 131072 | layer_norm |
blocks.6.hook_resid_post Load this SAE |
topk | gpt2-small/6-res_post_128k-oai | blocks.6.hook_resid_post | 131072 | layer_norm |
blocks.7.hook_resid_post Load this SAE |
topk | gpt2-small/7-res_post_128k-oai | blocks.7.hook_resid_post | 131072 | layer_norm |
blocks.8.hook_resid_post Load this SAE |
topk | gpt2-small/8-res_post_128k-oai | blocks.8.hook_resid_post | 131072 | layer_norm |
blocks.9.hook_resid_post Load this SAE |
topk | gpt2-small/9-res_post_128k-oai | blocks.9.hook_resid_post | 131072 | layer_norm |
blocks.10.hook_resid_post Load this SAE |
topk | gpt2-small/10-res_post_128k-oai | blocks.10.hook_resid_post | 131072 | layer_norm |
blocks.11.hook_resid_post Load this SAE |
topk | gpt2-small/11-res_post_128k-oai | blocks.11.hook_resid_post | 131072 | layer_norm |
gpt2-small-resid-post-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-post-SAEs
- model: gpt2-small
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
topk | gpt2-small/0-res_post_32k-oai | blocks.0.hook_resid_post | 32768 | layer_norm |
blocks.1.hook_resid_post Load this SAE |
topk | gpt2-small/1-res_post_32k-oai | blocks.1.hook_resid_post | 32768 | layer_norm |
blocks.2.hook_resid_post Load this SAE |
topk | gpt2-small/2-res_post_32k-oai | blocks.2.hook_resid_post | 32768 | layer_norm |
blocks.3.hook_resid_post Load this SAE |
topk | gpt2-small/3-res_post_32k-oai | blocks.3.hook_resid_post | 32768 | layer_norm |
blocks.4.hook_resid_post Load this SAE |
topk | gpt2-small/4-res_post_32k-oai | blocks.4.hook_resid_post | 32768 | layer_norm |
blocks.5.hook_resid_post Load this SAE |
topk | gpt2-small/5-res_post_32k-oai | blocks.5.hook_resid_post | 32768 | layer_norm |
blocks.6.hook_resid_post Load this SAE |
topk | gpt2-small/6-res_post_32k-oai | blocks.6.hook_resid_post | 32768 | layer_norm |
blocks.7.hook_resid_post Load this SAE |
topk | gpt2-small/7-res_post_32k-oai | blocks.7.hook_resid_post | 32768 | layer_norm |
blocks.8.hook_resid_post Load this SAE |
topk | gpt2-small/8-res_post_32k-oai | blocks.8.hook_resid_post | 32768 | layer_norm |
blocks.9.hook_resid_post Load this SAE |
topk | gpt2-small/9-res_post_32k-oai | blocks.9.hook_resid_post | 32768 | layer_norm |
blocks.10.hook_resid_post Load this SAE |
topk | gpt2-small/10-res_post_32k-oai | blocks.10.hook_resid_post | 32768 | layer_norm |
blocks.11.hook_resid_post Load this SAE |
topk | gpt2-small/11-res_post_32k-oai | blocks.11.hook_resid_post | 32768 | layer_norm |
llama-3-8b-it-res-jh
- Huggingface Repo: Juliushanhanhan/llama-3-8b-it-res
- model: meta-llama/Meta-Llama-3-8B-Instruct
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.25.hook_resid_post Load this SAE |
gated | llama3-8b-it/25-res-jh | blocks.25.hook_resid_post | 65536 | expected_average_only_in |
llama_scope_lxa_32x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-32x
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0a_32x Load this SAE |
jumprelu | llama3.1-8b/0-llamascope-att-131k | blocks.0.hook_attn_out | 131072 | expected_average_only_in |
l1a_32x Load this SAE |
jumprelu | llama3.1-8b/1-llamascope-att-131k | blocks.1.hook_attn_out | 131072 | expected_average_only_in |
l2a_32x Load this SAE |
jumprelu | llama3.1-8b/2-llamascope-att-131k | blocks.2.hook_attn_out | 131072 | expected_average_only_in |
l3a_32x Load this SAE |
jumprelu | llama3.1-8b/3-llamascope-att-131k | blocks.3.hook_attn_out | 131072 | expected_average_only_in |
l4a_32x Load this SAE |
jumprelu | llama3.1-8b/4-llamascope-att-131k | blocks.4.hook_attn_out | 131072 | expected_average_only_in |
l5a_32x Load this SAE |
jumprelu | llama3.1-8b/5-llamascope-att-131k | blocks.5.hook_attn_out | 131072 | expected_average_only_in |
l6a_32x Load this SAE |
jumprelu | llama3.1-8b/6-llamascope-att-131k | blocks.6.hook_attn_out | 131072 | expected_average_only_in |
l7a_32x Load this SAE |
jumprelu | llama3.1-8b/7-llamascope-att-131k | blocks.7.hook_attn_out | 131072 | expected_average_only_in |
l8a_32x Load this SAE |
jumprelu | llama3.1-8b/8-llamascope-att-131k | blocks.8.hook_attn_out | 131072 | expected_average_only_in |
l9a_32x Load this SAE |
jumprelu | llama3.1-8b/9-llamascope-att-131k | blocks.9.hook_attn_out | 131072 | expected_average_only_in |
l10a_32x Load this SAE |
jumprelu | llama3.1-8b/10-llamascope-att-131k | blocks.10.hook_attn_out | 131072 | expected_average_only_in |
l11a_32x Load this SAE |
jumprelu | llama3.1-8b/11-llamascope-att-131k | blocks.11.hook_attn_out | 131072 | expected_average_only_in |
l12a_32x Load this SAE |
jumprelu | llama3.1-8b/12-llamascope-att-131k | blocks.12.hook_attn_out | 131072 | expected_average_only_in |
l13a_32x Load this SAE |
jumprelu | llama3.1-8b/13-llamascope-att-131k | blocks.13.hook_attn_out | 131072 | expected_average_only_in |
l14a_32x Load this SAE |
jumprelu | llama3.1-8b/14-llamascope-att-131k | blocks.14.hook_attn_out | 131072 | expected_average_only_in |
l15a_32x Load this SAE |
jumprelu | llama3.1-8b/15-llamascope-att-131k | blocks.15.hook_attn_out | 131072 | expected_average_only_in |
l16a_32x Load this SAE |
jumprelu | llama3.1-8b/16-llamascope-att-131k | blocks.16.hook_attn_out | 131072 | expected_average_only_in |
l17a_32x Load this SAE |
jumprelu | llama3.1-8b/17-llamascope-att-131k | blocks.17.hook_attn_out | 131072 | expected_average_only_in |
l18a_32x Load this SAE |
jumprelu | llama3.1-8b/18-llamascope-att-131k | blocks.18.hook_attn_out | 131072 | expected_average_only_in |
l19a_32x Load this SAE |
jumprelu | llama3.1-8b/19-llamascope-att-131k | blocks.19.hook_attn_out | 131072 | expected_average_only_in |
l20a_32x Load this SAE |
jumprelu | llama3.1-8b/20-llamascope-att-131k | blocks.20.hook_attn_out | 131072 | expected_average_only_in |
l21a_32x Load this SAE |
jumprelu | llama3.1-8b/21-llamascope-att-131k | blocks.21.hook_attn_out | 131072 | expected_average_only_in |
l22a_32x Load this SAE |
jumprelu | llama3.1-8b/22-llamascope-att-131k | blocks.22.hook_attn_out | 131072 | expected_average_only_in |
l23a_32x Load this SAE |
jumprelu | llama3.1-8b/23-llamascope-att-131k | blocks.23.hook_attn_out | 131072 | expected_average_only_in |
l24a_32x Load this SAE |
jumprelu | llama3.1-8b/24-llamascope-att-131k | blocks.24.hook_attn_out | 131072 | expected_average_only_in |
l25a_32x Load this SAE |
jumprelu | llama3.1-8b/25-llamascope-att-131k | blocks.25.hook_attn_out | 131072 | expected_average_only_in |
l26a_32x Load this SAE |
jumprelu | llama3.1-8b/26-llamascope-att-131k | blocks.26.hook_attn_out | 131072 | expected_average_only_in |
l27a_32x Load this SAE |
jumprelu | llama3.1-8b/27-llamascope-att-131k | blocks.27.hook_attn_out | 131072 | expected_average_only_in |
l28a_32x Load this SAE |
jumprelu | llama3.1-8b/28-llamascope-att-131k | blocks.28.hook_attn_out | 131072 | expected_average_only_in |
l29a_32x Load this SAE |
jumprelu | llama3.1-8b/29-llamascope-att-131k | blocks.29.hook_attn_out | 131072 | expected_average_only_in |
l30a_32x Load this SAE |
jumprelu | llama3.1-8b/30-llamascope-att-131k | blocks.30.hook_attn_out | 131072 | expected_average_only_in |
l31a_32x Load this SAE |
jumprelu | llama3.1-8b/31-llamascope-att-131k | blocks.31.hook_attn_out | 131072 | expected_average_only_in |
llama_scope_lxa_8x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-8x
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0a_8x Load this SAE |
jumprelu | llama3.1-8b/0-llamascope-att-32k | blocks.0.hook_attn_out | 32768 | expected_average_only_in |
l1a_8x Load this SAE |
jumprelu | llama3.1-8b/1-llamascope-att-32k | blocks.1.hook_attn_out | 32768 | expected_average_only_in |
l2a_8x Load this SAE |
jumprelu | llama3.1-8b/2-llamascope-att-32k | blocks.2.hook_attn_out | 32768 | expected_average_only_in |
l3a_8x Load this SAE |
jumprelu | llama3.1-8b/3-llamascope-att-32k | blocks.3.hook_attn_out | 32768 | expected_average_only_in |
l4a_8x Load this SAE |
jumprelu | llama3.1-8b/4-llamascope-att-32k | blocks.4.hook_attn_out | 32768 | expected_average_only_in |
l5a_8x Load this SAE |
jumprelu | llama3.1-8b/5-llamascope-att-32k | blocks.5.hook_attn_out | 32768 | expected_average_only_in |
l6a_8x Load this SAE |
jumprelu | llama3.1-8b/6-llamascope-att-32k | blocks.6.hook_attn_out | 32768 | expected_average_only_in |
l7a_8x Load this SAE |
jumprelu | llama3.1-8b/7-llamascope-att-32k | blocks.7.hook_attn_out | 32768 | expected_average_only_in |
l8a_8x Load this SAE |
jumprelu | llama3.1-8b/8-llamascope-att-32k | blocks.8.hook_attn_out | 32768 | expected_average_only_in |
l9a_8x Load this SAE |
jumprelu | llama3.1-8b/9-llamascope-att-32k | blocks.9.hook_attn_out | 32768 | expected_average_only_in |
l10a_8x Load this SAE |
jumprelu | llama3.1-8b/10-llamascope-att-32k | blocks.10.hook_attn_out | 32768 | expected_average_only_in |
l11a_8x Load this SAE |
jumprelu | llama3.1-8b/11-llamascope-att-32k | blocks.11.hook_attn_out | 32768 | expected_average_only_in |
l12a_8x Load this SAE |
jumprelu | llama3.1-8b/12-llamascope-att-32k | blocks.12.hook_attn_out | 32768 | expected_average_only_in |
l13a_8x Load this SAE |
jumprelu | llama3.1-8b/13-llamascope-att-32k | blocks.13.hook_attn_out | 32768 | expected_average_only_in |
l14a_8x Load this SAE |
jumprelu | llama3.1-8b/14-llamascope-att-32k | blocks.14.hook_attn_out | 32768 | expected_average_only_in |
l15a_8x Load this SAE |
jumprelu | llama3.1-8b/15-llamascope-att-32k | blocks.15.hook_attn_out | 32768 | expected_average_only_in |
l16a_8x Load this SAE |
jumprelu | llama3.1-8b/16-llamascope-att-32k | blocks.16.hook_attn_out | 32768 | expected_average_only_in |
l17a_8x Load this SAE |
jumprelu | llama3.1-8b/17-llamascope-att-32k | blocks.17.hook_attn_out | 32768 | expected_average_only_in |
l18a_8x Load this SAE |
jumprelu | llama3.1-8b/18-llamascope-att-32k | blocks.18.hook_attn_out | 32768 | expected_average_only_in |
l19a_8x Load this SAE |
jumprelu | llama3.1-8b/19-llamascope-att-32k | blocks.19.hook_attn_out | 32768 | expected_average_only_in |
l20a_8x Load this SAE |
jumprelu | llama3.1-8b/20-llamascope-att-32k | blocks.20.hook_attn_out | 32768 | expected_average_only_in |
l21a_8x Load this SAE |
jumprelu | llama3.1-8b/21-llamascope-att-32k | blocks.21.hook_attn_out | 32768 | expected_average_only_in |
l22a_8x Load this SAE |
jumprelu | llama3.1-8b/22-llamascope-att-32k | blocks.22.hook_attn_out | 32768 | expected_average_only_in |
l23a_8x Load this SAE |
jumprelu | llama3.1-8b/23-llamascope-att-32k | blocks.23.hook_attn_out | 32768 | expected_average_only_in |
l24a_8x Load this SAE |
jumprelu | llama3.1-8b/24-llamascope-att-32k | blocks.24.hook_attn_out | 32768 | expected_average_only_in |
l25a_8x Load this SAE |
jumprelu | llama3.1-8b/25-llamascope-att-32k | blocks.25.hook_attn_out | 32768 | expected_average_only_in |
l26a_8x Load this SAE |
jumprelu | llama3.1-8b/26-llamascope-att-32k | blocks.26.hook_attn_out | 32768 | expected_average_only_in |
l27a_8x Load this SAE |
jumprelu | llama3.1-8b/27-llamascope-att-32k | blocks.27.hook_attn_out | 32768 | expected_average_only_in |
l28a_8x Load this SAE |
jumprelu | llama3.1-8b/28-llamascope-att-32k | blocks.28.hook_attn_out | 32768 | expected_average_only_in |
l29a_8x Load this SAE |
jumprelu | llama3.1-8b/29-llamascope-att-32k | blocks.29.hook_attn_out | 32768 | expected_average_only_in |
l30a_8x Load this SAE |
jumprelu | llama3.1-8b/30-llamascope-att-32k | blocks.30.hook_attn_out | 32768 | expected_average_only_in |
l31a_8x Load this SAE |
jumprelu | llama3.1-8b/31-llamascope-att-32k | blocks.31.hook_attn_out | 32768 | expected_average_only_in |
llama_scope_lxm_32x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-32x
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0m_32x Load this SAE |
jumprelu | llama3.1-8b/0-llamascope-mlp-131k | blocks.0.hook_mlp_out | 131072 | expected_average_only_in |
l1m_32x Load this SAE |
jumprelu | llama3.1-8b/1-llamascope-mlp-131k | blocks.1.hook_mlp_out | 131072 | expected_average_only_in |
l2m_32x Load this SAE |
jumprelu | llama3.1-8b/2-llamascope-mlp-131k | blocks.2.hook_mlp_out | 131072 | expected_average_only_in |
l3m_32x Load this SAE |
jumprelu | llama3.1-8b/3-llamascope-mlp-131k | blocks.3.hook_mlp_out | 131072 | expected_average_only_in |
l4m_32x Load this SAE |
jumprelu | llama3.1-8b/4-llamascope-mlp-131k | blocks.4.hook_mlp_out | 131072 | expected_average_only_in |
l5m_32x Load this SAE |
jumprelu | llama3.1-8b/5-llamascope-mlp-131k | blocks.5.hook_mlp_out | 131072 | expected_average_only_in |
l6m_32x Load this SAE |
jumprelu | llama3.1-8b/6-llamascope-mlp-131k | blocks.6.hook_mlp_out | 131072 | expected_average_only_in |
l7m_32x Load this SAE |
jumprelu | llama3.1-8b/7-llamascope-mlp-131k | blocks.7.hook_mlp_out | 131072 | expected_average_only_in |
l8m_32x Load this SAE |
jumprelu | llama3.1-8b/8-llamascope-mlp-131k | blocks.8.hook_mlp_out | 131072 | expected_average_only_in |
l9m_32x Load this SAE |
jumprelu | llama3.1-8b/9-llamascope-mlp-131k | blocks.9.hook_mlp_out | 131072 | expected_average_only_in |
l10m_32x Load this SAE |
jumprelu | llama3.1-8b/10-llamascope-mlp-131k | blocks.10.hook_mlp_out | 131072 | expected_average_only_in |
l11m_32x Load this SAE |
jumprelu | llama3.1-8b/11-llamascope-mlp-131k | blocks.11.hook_mlp_out | 131072 | expected_average_only_in |
l12m_32x Load this SAE |
jumprelu | llama3.1-8b/12-llamascope-mlp-131k | blocks.12.hook_mlp_out | 131072 | expected_average_only_in |
l13m_32x Load this SAE |
jumprelu | llama3.1-8b/13-llamascope-mlp-131k | blocks.13.hook_mlp_out | 131072 | expected_average_only_in |
l14m_32x Load this SAE |
jumprelu | llama3.1-8b/14-llamascope-mlp-131k | blocks.14.hook_mlp_out | 131072 | expected_average_only_in |
l15m_32x Load this SAE |
jumprelu | llama3.1-8b/15-llamascope-mlp-131k | blocks.15.hook_mlp_out | 131072 | expected_average_only_in |
l16m_32x Load this SAE |
jumprelu | llama3.1-8b/16-llamascope-mlp-131k | blocks.16.hook_mlp_out | 131072 | expected_average_only_in |
l17m_32x Load this SAE |
jumprelu | llama3.1-8b/17-llamascope-mlp-131k | blocks.17.hook_mlp_out | 131072 | expected_average_only_in |
l18m_32x Load this SAE |
jumprelu | llama3.1-8b/18-llamascope-mlp-131k | blocks.18.hook_mlp_out | 131072 | expected_average_only_in |
l19m_32x Load this SAE |
jumprelu | llama3.1-8b/19-llamascope-mlp-131k | blocks.19.hook_mlp_out | 131072 | expected_average_only_in |
l20m_32x Load this SAE |
jumprelu | llama3.1-8b/20-llamascope-mlp-131k | blocks.20.hook_mlp_out | 131072 | expected_average_only_in |
l21m_32x Load this SAE |
jumprelu | llama3.1-8b/21-llamascope-mlp-131k | blocks.21.hook_mlp_out | 131072 | expected_average_only_in |
l22m_32x Load this SAE |
jumprelu | llama3.1-8b/22-llamascope-mlp-131k | blocks.22.hook_mlp_out | 131072 | expected_average_only_in |
l23m_32x Load this SAE |
jumprelu | llama3.1-8b/23-llamascope-mlp-131k | blocks.23.hook_mlp_out | 131072 | expected_average_only_in |
l24m_32x Load this SAE |
jumprelu | llama3.1-8b/24-llamascope-mlp-131k | blocks.24.hook_mlp_out | 131072 | expected_average_only_in |
l25m_32x Load this SAE |
jumprelu | llama3.1-8b/25-llamascope-mlp-131k | blocks.25.hook_mlp_out | 131072 | expected_average_only_in |
l26m_32x Load this SAE |
jumprelu | llama3.1-8b/26-llamascope-mlp-131k | blocks.26.hook_mlp_out | 131072 | expected_average_only_in |
l27m_32x Load this SAE |
jumprelu | llama3.1-8b/27-llamascope-mlp-131k | blocks.27.hook_mlp_out | 131072 | expected_average_only_in |
l28m_32x Load this SAE |
jumprelu | llama3.1-8b/28-llamascope-mlp-131k | blocks.28.hook_mlp_out | 131072 | expected_average_only_in |
l29m_32x Load this SAE |
jumprelu | llama3.1-8b/29-llamascope-mlp-131k | blocks.29.hook_mlp_out | 131072 | expected_average_only_in |
l30m_32x Load this SAE |
jumprelu | llama3.1-8b/30-llamascope-mlp-131k | blocks.30.hook_mlp_out | 131072 | expected_average_only_in |
l31m_32x Load this SAE |
jumprelu | llama3.1-8b/31-llamascope-mlp-131k | blocks.31.hook_mlp_out | 131072 | expected_average_only_in |
llama_scope_lxm_8x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-8x
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0m_8x Load this SAE |
jumprelu | llama3.1-8b/0-llamascope-mlp-32k | blocks.0.hook_mlp_out | 32768 | expected_average_only_in |
l1m_8x Load this SAE |
jumprelu | llama3.1-8b/1-llamascope-mlp-32k | blocks.1.hook_mlp_out | 32768 | expected_average_only_in |
l2m_8x Load this SAE |
jumprelu | llama3.1-8b/2-llamascope-mlp-32k | blocks.2.hook_mlp_out | 32768 | expected_average_only_in |
l3m_8x Load this SAE |
jumprelu | llama3.1-8b/3-llamascope-mlp-32k | blocks.3.hook_mlp_out | 32768 | expected_average_only_in |
l4m_8x Load this SAE |
jumprelu | llama3.1-8b/4-llamascope-mlp-32k | blocks.4.hook_mlp_out | 32768 | expected_average_only_in |
l5m_8x Load this SAE |
jumprelu | llama3.1-8b/5-llamascope-mlp-32k | blocks.5.hook_mlp_out | 32768 | expected_average_only_in |
l6m_8x Load this SAE |
jumprelu | llama3.1-8b/6-llamascope-mlp-32k | blocks.6.hook_mlp_out | 32768 | expected_average_only_in |
l7m_8x Load this SAE |
jumprelu | llama3.1-8b/7-llamascope-mlp-32k | blocks.7.hook_mlp_out | 32768 | expected_average_only_in |
l8m_8x Load this SAE |
jumprelu | llama3.1-8b/8-llamascope-mlp-32k | blocks.8.hook_mlp_out | 32768 | expected_average_only_in |
l9m_8x Load this SAE |
jumprelu | llama3.1-8b/9-llamascope-mlp-32k | blocks.9.hook_mlp_out | 32768 | expected_average_only_in |
l10m_8x Load this SAE |
jumprelu | llama3.1-8b/10-llamascope-mlp-32k | blocks.10.hook_mlp_out | 32768 | expected_average_only_in |
l11m_8x Load this SAE |
jumprelu | llama3.1-8b/11-llamascope-mlp-32k | blocks.11.hook_mlp_out | 32768 | expected_average_only_in |
l12m_8x Load this SAE |
jumprelu | llama3.1-8b/12-llamascope-mlp-32k | blocks.12.hook_mlp_out | 32768 | expected_average_only_in |
l13m_8x Load this SAE |
jumprelu | llama3.1-8b/13-llamascope-mlp-32k | blocks.13.hook_mlp_out | 32768 | expected_average_only_in |
l14m_8x Load this SAE |
jumprelu | llama3.1-8b/14-llamascope-mlp-32k | blocks.14.hook_mlp_out | 32768 | expected_average_only_in |
l15m_8x Load this SAE |
jumprelu | llama3.1-8b/15-llamascope-mlp-32k | blocks.15.hook_mlp_out | 32768 | expected_average_only_in |
l16m_8x Load this SAE |
jumprelu | llama3.1-8b/16-llamascope-mlp-32k | blocks.16.hook_mlp_out | 32768 | expected_average_only_in |
l17m_8x Load this SAE |
jumprelu | llama3.1-8b/17-llamascope-mlp-32k | blocks.17.hook_mlp_out | 32768 | expected_average_only_in |
l18m_8x Load this SAE |
jumprelu | llama3.1-8b/18-llamascope-mlp-32k | blocks.18.hook_mlp_out | 32768 | expected_average_only_in |
l19m_8x Load this SAE |
jumprelu | llama3.1-8b/19-llamascope-mlp-32k | blocks.19.hook_mlp_out | 32768 | expected_average_only_in |
l20m_8x Load this SAE |
jumprelu | llama3.1-8b/20-llamascope-mlp-32k | blocks.20.hook_mlp_out | 32768 | expected_average_only_in |
l21m_8x Load this SAE |
jumprelu | llama3.1-8b/21-llamascope-mlp-32k | blocks.21.hook_mlp_out | 32768 | expected_average_only_in |
l22m_8x Load this SAE |
jumprelu | llama3.1-8b/22-llamascope-mlp-32k | blocks.22.hook_mlp_out | 32768 | expected_average_only_in |
l23m_8x Load this SAE |
jumprelu | llama3.1-8b/23-llamascope-mlp-32k | blocks.23.hook_mlp_out | 32768 | expected_average_only_in |
l24m_8x Load this SAE |
jumprelu | llama3.1-8b/24-llamascope-mlp-32k | blocks.24.hook_mlp_out | 32768 | expected_average_only_in |
l25m_8x Load this SAE |
jumprelu | llama3.1-8b/25-llamascope-mlp-32k | blocks.25.hook_mlp_out | 32768 | expected_average_only_in |
l26m_8x Load this SAE |
jumprelu | llama3.1-8b/26-llamascope-mlp-32k | blocks.26.hook_mlp_out | 32768 | expected_average_only_in |
l27m_8x Load this SAE |
jumprelu | llama3.1-8b/27-llamascope-mlp-32k | blocks.27.hook_mlp_out | 32768 | expected_average_only_in |
l28m_8x Load this SAE |
jumprelu | llama3.1-8b/28-llamascope-mlp-32k | blocks.28.hook_mlp_out | 32768 | expected_average_only_in |
l29m_8x Load this SAE |
jumprelu | llama3.1-8b/29-llamascope-mlp-32k | blocks.29.hook_mlp_out | 32768 | expected_average_only_in |
l30m_8x Load this SAE |
jumprelu | llama3.1-8b/30-llamascope-mlp-32k | blocks.30.hook_mlp_out | 32768 | expected_average_only_in |
l31m_8x Load this SAE |
jumprelu | llama3.1-8b/31-llamascope-mlp-32k | blocks.31.hook_mlp_out | 32768 | expected_average_only_in |
llama_scope_lxr_32x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-32x
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0r_32x Load this SAE |
jumprelu | llama3.1-8b/0-llamascope-res-131k | blocks.0.hook_resid_post | 131072 | expected_average_only_in |
l1r_32x Load this SAE |
jumprelu | llama3.1-8b/1-llamascope-res-131k | blocks.1.hook_resid_post | 131072 | expected_average_only_in |
l2r_32x Load this SAE |
jumprelu | llama3.1-8b/2-llamascope-res-131k | blocks.2.hook_resid_post | 131072 | expected_average_only_in |
l3r_32x Load this SAE |
jumprelu | llama3.1-8b/3-llamascope-res-131k | blocks.3.hook_resid_post | 131072 | expected_average_only_in |
l4r_32x Load this SAE |
jumprelu | llama3.1-8b/4-llamascope-res-131k | blocks.4.hook_resid_post | 131072 | expected_average_only_in |
l5r_32x Load this SAE |
jumprelu | llama3.1-8b/5-llamascope-res-131k | blocks.5.hook_resid_post | 131072 | expected_average_only_in |
l6r_32x Load this SAE |
jumprelu | llama3.1-8b/6-llamascope-res-131k | blocks.6.hook_resid_post | 131072 | expected_average_only_in |
l7r_32x Load this SAE |
jumprelu | llama3.1-8b/7-llamascope-res-131k | blocks.7.hook_resid_post | 131072 | expected_average_only_in |
l8r_32x Load this SAE |
jumprelu | llama3.1-8b/8-llamascope-res-131k | blocks.8.hook_resid_post | 131072 | expected_average_only_in |
l9r_32x Load this SAE |
jumprelu | llama3.1-8b/9-llamascope-res-131k | blocks.9.hook_resid_post | 131072 | expected_average_only_in |
l10r_32x Load this SAE |
jumprelu | llama3.1-8b/10-llamascope-res-131k | blocks.10.hook_resid_post | 131072 | expected_average_only_in |
l11r_32x Load this SAE |
jumprelu | llama3.1-8b/11-llamascope-res-131k | blocks.11.hook_resid_post | 131072 | expected_average_only_in |
l12r_32x Load this SAE |
jumprelu | llama3.1-8b/12-llamascope-res-131k | blocks.12.hook_resid_post | 131072 | expected_average_only_in |
l13r_32x Load this SAE |
jumprelu | llama3.1-8b/13-llamascope-res-131k | blocks.13.hook_resid_post | 131072 | expected_average_only_in |
l14r_32x Load this SAE |
jumprelu | llama3.1-8b/14-llamascope-res-131k | blocks.14.hook_resid_post | 131072 | expected_average_only_in |
l15r_32x Load this SAE |
jumprelu | llama3.1-8b/15-llamascope-res-131k | blocks.15.hook_resid_post | 131072 | expected_average_only_in |
l16r_32x Load this SAE |
jumprelu | llama3.1-8b/16-llamascope-res-131k | blocks.16.hook_resid_post | 131072 | expected_average_only_in |
l17r_32x Load this SAE |
jumprelu | llama3.1-8b/17-llamascope-res-131k | blocks.17.hook_resid_post | 131072 | expected_average_only_in |
l18r_32x Load this SAE |
jumprelu | llama3.1-8b/18-llamascope-res-131k | blocks.18.hook_resid_post | 131072 | expected_average_only_in |
l19r_32x Load this SAE |
jumprelu | llama3.1-8b/19-llamascope-res-131k | blocks.19.hook_resid_post | 131072 | expected_average_only_in |
l20r_32x Load this SAE |
jumprelu | llama3.1-8b/20-llamascope-res-131k | blocks.20.hook_resid_post | 131072 | expected_average_only_in |
l21r_32x Load this SAE |
jumprelu | llama3.1-8b/21-llamascope-res-131k | blocks.21.hook_resid_post | 131072 | expected_average_only_in |
l22r_32x Load this SAE |
jumprelu | llama3.1-8b/22-llamascope-res-131k | blocks.22.hook_resid_post | 131072 | expected_average_only_in |
l23r_32x Load this SAE |
jumprelu | llama3.1-8b/23-llamascope-res-131k | blocks.23.hook_resid_post | 131072 | expected_average_only_in |
l24r_32x Load this SAE |
jumprelu | llama3.1-8b/24-llamascope-res-131k | blocks.24.hook_resid_post | 131072 | expected_average_only_in |
l25r_32x Load this SAE |
jumprelu | llama3.1-8b/25-llamascope-res-131k | blocks.25.hook_resid_post | 131072 | expected_average_only_in |
l26r_32x Load this SAE |
jumprelu | llama3.1-8b/26-llamascope-res-131k | blocks.26.hook_resid_post | 131072 | expected_average_only_in |
l27r_32x Load this SAE |
jumprelu | llama3.1-8b/27-llamascope-res-131k | blocks.27.hook_resid_post | 131072 | expected_average_only_in |
l28r_32x Load this SAE |
jumprelu | llama3.1-8b/28-llamascope-res-131k | blocks.28.hook_resid_post | 131072 | expected_average_only_in |
l29r_32x Load this SAE |
jumprelu | llama3.1-8b/29-llamascope-res-131k | blocks.29.hook_resid_post | 131072 | expected_average_only_in |
l30r_32x Load this SAE |
jumprelu | llama3.1-8b/30-llamascope-res-131k | blocks.30.hook_resid_post | 131072 | expected_average_only_in |
l31r_32x Load this SAE |
jumprelu | llama3.1-8b/31-llamascope-res-131k | blocks.31.hook_resid_post | 131072 | expected_average_only_in |
llama_scope_lxr_8x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-8x
- model: meta-llama/Llama-3.1-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0r_8x Load this SAE |
jumprelu | llama3.1-8b/0-llamascope-res-32k | blocks.0.hook_resid_post | 32768 | expected_average_only_in |
l1r_8x Load this SAE |
jumprelu | llama3.1-8b/1-llamascope-res-32k | blocks.1.hook_resid_post | 32768 | expected_average_only_in |
l2r_8x Load this SAE |
jumprelu | llama3.1-8b/2-llamascope-res-32k | blocks.2.hook_resid_post | 32768 | expected_average_only_in |
l3r_8x Load this SAE |
jumprelu | llama3.1-8b/3-llamascope-res-32k | blocks.3.hook_resid_post | 32768 | expected_average_only_in |
l4r_8x Load this SAE |
jumprelu | llama3.1-8b/4-llamascope-res-32k | blocks.4.hook_resid_post | 32768 | expected_average_only_in |
l5r_8x Load this SAE |
jumprelu | llama3.1-8b/5-llamascope-res-32k | blocks.5.hook_resid_post | 32768 | expected_average_only_in |
l6r_8x Load this SAE |
jumprelu | llama3.1-8b/6-llamascope-res-32k | blocks.6.hook_resid_post | 32768 | expected_average_only_in |
l7r_8x Load this SAE |
jumprelu | llama3.1-8b/7-llamascope-res-32k | blocks.7.hook_resid_post | 32768 | expected_average_only_in |
l8r_8x Load this SAE |
jumprelu | llama3.1-8b/8-llamascope-res-32k | blocks.8.hook_resid_post | 32768 | expected_average_only_in |
l9r_8x Load this SAE |
jumprelu | llama3.1-8b/9-llamascope-res-32k | blocks.9.hook_resid_post | 32768 | expected_average_only_in |
l10r_8x Load this SAE |
jumprelu | llama3.1-8b/10-llamascope-res-32k | blocks.10.hook_resid_post | 32768 | expected_average_only_in |
l11r_8x Load this SAE |
jumprelu | llama3.1-8b/11-llamascope-res-32k | blocks.11.hook_resid_post | 32768 | expected_average_only_in |
l12r_8x Load this SAE |
jumprelu | llama3.1-8b/12-llamascope-res-32k | blocks.12.hook_resid_post | 32768 | expected_average_only_in |
l13r_8x Load this SAE |
jumprelu | llama3.1-8b/13-llamascope-res-32k | blocks.13.hook_resid_post | 32768 | expected_average_only_in |
l14r_8x Load this SAE |
jumprelu | llama3.1-8b/14-llamascope-res-32k | blocks.14.hook_resid_post | 32768 | expected_average_only_in |
l15r_8x Load this SAE |
jumprelu | llama3.1-8b/15-llamascope-res-32k | blocks.15.hook_resid_post | 32768 | expected_average_only_in |
l16r_8x Load this SAE |
jumprelu | llama3.1-8b/16-llamascope-res-32k | blocks.16.hook_resid_post | 32768 | expected_average_only_in |
l17r_8x Load this SAE |
jumprelu | llama3.1-8b/17-llamascope-res-32k | blocks.17.hook_resid_post | 32768 | expected_average_only_in |
l18r_8x Load this SAE |
jumprelu | llama3.1-8b/18-llamascope-res-32k | blocks.18.hook_resid_post | 32768 | expected_average_only_in |
l19r_8x Load this SAE |
jumprelu | llama3.1-8b/19-llamascope-res-32k | blocks.19.hook_resid_post | 32768 | expected_average_only_in |
l20r_8x Load this SAE |
jumprelu | llama3.1-8b/20-llamascope-res-32k | blocks.20.hook_resid_post | 32768 | expected_average_only_in |
l21r_8x Load this SAE |
jumprelu | llama3.1-8b/21-llamascope-res-32k | blocks.21.hook_resid_post | 32768 | expected_average_only_in |
l22r_8x Load this SAE |
jumprelu | llama3.1-8b/22-llamascope-res-32k | blocks.22.hook_resid_post | 32768 | expected_average_only_in |
l23r_8x Load this SAE |
jumprelu | llama3.1-8b/23-llamascope-res-32k | blocks.23.hook_resid_post | 32768 | expected_average_only_in |
l24r_8x Load this SAE |
jumprelu | llama3.1-8b/24-llamascope-res-32k | blocks.24.hook_resid_post | 32768 | expected_average_only_in |
l25r_8x Load this SAE |
jumprelu | llama3.1-8b/25-llamascope-res-32k | blocks.25.hook_resid_post | 32768 | expected_average_only_in |
l26r_8x Load this SAE |
jumprelu | llama3.1-8b/26-llamascope-res-32k | blocks.26.hook_resid_post | 32768 | expected_average_only_in |
l27r_8x Load this SAE |
jumprelu | llama3.1-8b/27-llamascope-res-32k | blocks.27.hook_resid_post | 32768 | expected_average_only_in |
l28r_8x Load this SAE |
jumprelu | llama3.1-8b/28-llamascope-res-32k | blocks.28.hook_resid_post | 32768 | expected_average_only_in |
l29r_8x Load this SAE |
jumprelu | llama3.1-8b/29-llamascope-res-32k | blocks.29.hook_resid_post | 32768 | expected_average_only_in |
l30r_8x Load this SAE |
jumprelu | llama3.1-8b/30-llamascope-res-32k | blocks.30.hook_resid_post | 32768 | expected_average_only_in |
l31r_8x Load this SAE |
jumprelu | llama3.1-8b/31-llamascope-res-32k | blocks.31.hook_resid_post | 32768 | expected_average_only_in |
llama_scope_r1_distill
- Huggingface Repo: fnlp/Llama-Scope-R1-Distill
- model: deepseek-ai/DeepSeek-R1-Distill-Llama-8B
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
l0r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/0-llamascope-slimpj-res-32k | blocks.0.hook_resid_post | 32768 | expected_average_only_in |
l1r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/1-llamascope-slimpj-res-32k | blocks.1.hook_resid_post | 32768 | expected_average_only_in |
l2r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/2-llamascope-slimpj-res-32k | blocks.2.hook_resid_post | 32768 | expected_average_only_in |
l3r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/3-llamascope-slimpj-res-32k | blocks.3.hook_resid_post | 32768 | expected_average_only_in |
l4r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/4-llamascope-slimpj-res-32k | blocks.4.hook_resid_post | 32768 | expected_average_only_in |
l5r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/5-llamascope-slimpj-res-32k | blocks.5.hook_resid_post | 32768 | expected_average_only_in |
l6r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/6-llamascope-slimpj-res-32k | blocks.6.hook_resid_post | 32768 | expected_average_only_in |
l7r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/7-llamascope-slimpj-res-32k | blocks.7.hook_resid_post | 32768 | expected_average_only_in |
l8r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/8-llamascope-slimpj-res-32k | blocks.8.hook_resid_post | 32768 | expected_average_only_in |
l9r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/9-llamascope-slimpj-res-32k | blocks.9.hook_resid_post | 32768 | expected_average_only_in |
l10r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/10-llamascope-slimpj-res-32k | blocks.10.hook_resid_post | 32768 | expected_average_only_in |
l11r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/11-llamascope-slimpj-res-32k | blocks.11.hook_resid_post | 32768 | expected_average_only_in |
l12r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/12-llamascope-slimpj-res-32k | blocks.12.hook_resid_post | 32768 | expected_average_only_in |
l13r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/13-llamascope-slimpj-res-32k | blocks.13.hook_resid_post | 32768 | expected_average_only_in |
l14r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/14-llamascope-slimpj-res-32k | blocks.14.hook_resid_post | 32768 | expected_average_only_in |
l15r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/15-llamascope-slimpj-res-32k | blocks.15.hook_resid_post | 32768 | expected_average_only_in |
l16r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/16-llamascope-slimpj-res-32k | blocks.16.hook_resid_post | 32768 | expected_average_only_in |
l17r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/17-llamascope-slimpj-res-32k | blocks.17.hook_resid_post | 32768 | expected_average_only_in |
l18r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/18-llamascope-slimpj-res-32k | blocks.18.hook_resid_post | 32768 | expected_average_only_in |
l19r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/19-llamascope-slimpj-res-32k | blocks.19.hook_resid_post | 32768 | expected_average_only_in |
l20r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/20-llamascope-slimpj-res-32k | blocks.20.hook_resid_post | 32768 | expected_average_only_in |
l21r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/21-llamascope-slimpj-res-32k | blocks.21.hook_resid_post | 32768 | expected_average_only_in |
l22r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/22-llamascope-slimpj-res-32k | blocks.22.hook_resid_post | 32768 | expected_average_only_in |
l23r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/23-llamascope-slimpj-res-32k | blocks.23.hook_resid_post | 32768 | expected_average_only_in |
l24r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/24-llamascope-slimpj-res-32k | blocks.24.hook_resid_post | 32768 | expected_average_only_in |
l25r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/25-llamascope-slimpj-res-32k | blocks.25.hook_resid_post | 32768 | expected_average_only_in |
l26r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/26-llamascope-slimpj-res-32k | blocks.26.hook_resid_post | 32768 | expected_average_only_in |
l27r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/27-llamascope-slimpj-res-32k | blocks.27.hook_resid_post | 32768 | expected_average_only_in |
l28r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/28-llamascope-slimpj-res-32k | blocks.28.hook_resid_post | 32768 | expected_average_only_in |
l29r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/29-llamascope-slimpj-res-32k | blocks.29.hook_resid_post | 32768 | expected_average_only_in |
l30r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/30-llamascope-slimpj-res-32k | blocks.30.hook_resid_post | 32768 | expected_average_only_in |
l31r_800m_slimpajama Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/31-llamascope-slimpj-res-32k | blocks.31.hook_resid_post | 32768 | expected_average_only_in |
l0r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/0-llamascope-slimpj-openr1-res-32k | blocks.0.hook_resid_post | 32768 | expected_average_only_in |
l1r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/1-llamascope-slimpj-openr1-res-32k | blocks.1.hook_resid_post | 32768 | expected_average_only_in |
l2r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/2-llamascope-slimpj-openr1-res-32k | blocks.2.hook_resid_post | 32768 | expected_average_only_in |
l3r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/3-llamascope-slimpj-openr1-res-32k | blocks.3.hook_resid_post | 32768 | expected_average_only_in |
l4r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/4-llamascope-slimpj-openr1-res-32k | blocks.4.hook_resid_post | 32768 | expected_average_only_in |
l5r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/5-llamascope-slimpj-openr1-res-32k | blocks.5.hook_resid_post | 32768 | expected_average_only_in |
l6r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/6-llamascope-slimpj-openr1-res-32k | blocks.6.hook_resid_post | 32768 | expected_average_only_in |
l7r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/7-llamascope-slimpj-openr1-res-32k | blocks.7.hook_resid_post | 32768 | expected_average_only_in |
l8r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/8-llamascope-slimpj-openr1-res-32k | blocks.8.hook_resid_post | 32768 | expected_average_only_in |
l9r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/9-llamascope-slimpj-openr1-res-32k | blocks.9.hook_resid_post | 32768 | expected_average_only_in |
l10r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/10-llamascope-slimpj-openr1-res-32k | blocks.10.hook_resid_post | 32768 | expected_average_only_in |
l11r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/11-llamascope-slimpj-openr1-res-32k | blocks.11.hook_resid_post | 32768 | expected_average_only_in |
l12r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/12-llamascope-slimpj-openr1-res-32k | blocks.12.hook_resid_post | 32768 | expected_average_only_in |
l13r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/13-llamascope-slimpj-openr1-res-32k | blocks.13.hook_resid_post | 32768 | expected_average_only_in |
l14r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/14-llamascope-slimpj-openr1-res-32k | blocks.14.hook_resid_post | 32768 | expected_average_only_in |
l15r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/15-llamascope-slimpj-openr1-res-32k | blocks.15.hook_resid_post | 32768 | expected_average_only_in |
l16r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/16-llamascope-slimpj-openr1-res-32k | blocks.16.hook_resid_post | 32768 | expected_average_only_in |
l17r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/17-llamascope-slimpj-openr1-res-32k | blocks.17.hook_resid_post | 32768 | expected_average_only_in |
l18r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/18-llamascope-slimpj-openr1-res-32k | blocks.18.hook_resid_post | 32768 | expected_average_only_in |
l19r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/19-llamascope-slimpj-openr1-res-32k | blocks.19.hook_resid_post | 32768 | expected_average_only_in |
l20r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/20-llamascope-slimpj-openr1-res-32k | blocks.20.hook_resid_post | 32768 | expected_average_only_in |
l21r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/21-llamascope-slimpj-openr1-res-32k | blocks.21.hook_resid_post | 32768 | expected_average_only_in |
l22r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/22-llamascope-slimpj-openr1-res-32k | blocks.22.hook_resid_post | 32768 | expected_average_only_in |
l23r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/23-llamascope-slimpj-openr1-res-32k | blocks.23.hook_resid_post | 32768 | expected_average_only_in |
l24r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/24-llamascope-slimpj-openr1-res-32k | blocks.24.hook_resid_post | 32768 | expected_average_only_in |
l25r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/25-llamascope-slimpj-openr1-res-32k | blocks.25.hook_resid_post | 32768 | expected_average_only_in |
l26r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/26-llamascope-slimpj-openr1-res-32k | blocks.26.hook_resid_post | 32768 | expected_average_only_in |
l27r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/27-llamascope-slimpj-openr1-res-32k | blocks.27.hook_resid_post | 32768 | expected_average_only_in |
l28r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/28-llamascope-slimpj-openr1-res-32k | blocks.28.hook_resid_post | 32768 | expected_average_only_in |
l29r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/29-llamascope-slimpj-openr1-res-32k | blocks.29.hook_resid_post | 32768 | expected_average_only_in |
l30r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/30-llamascope-slimpj-openr1-res-32k | blocks.30.hook_resid_post | 32768 | expected_average_only_in |
l31r_400m_slimpajama_400m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/31-llamascope-slimpj-openr1-res-32k | blocks.31.hook_resid_post | 32768 | expected_average_only_in |
l0r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/0-llamascope-openr1-res-32k | blocks.0.hook_resid_post | 32768 | expected_average_only_in |
l1r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/1-llamascope-openr1-res-32k | blocks.1.hook_resid_post | 32768 | expected_average_only_in |
l2r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/2-llamascope-openr1-res-32k | blocks.2.hook_resid_post | 32768 | expected_average_only_in |
l3r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/3-llamascope-openr1-res-32k | blocks.3.hook_resid_post | 32768 | expected_average_only_in |
l4r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/4-llamascope-openr1-res-32k | blocks.4.hook_resid_post | 32768 | expected_average_only_in |
l5r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/5-llamascope-openr1-res-32k | blocks.5.hook_resid_post | 32768 | expected_average_only_in |
l6r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/6-llamascope-openr1-res-32k | blocks.6.hook_resid_post | 32768 | expected_average_only_in |
l7r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/7-llamascope-openr1-res-32k | blocks.7.hook_resid_post | 32768 | expected_average_only_in |
l8r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/8-llamascope-openr1-res-32k | blocks.8.hook_resid_post | 32768 | expected_average_only_in |
l9r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/9-llamascope-openr1-res-32k | blocks.9.hook_resid_post | 32768 | expected_average_only_in |
l10r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/10-llamascope-openr1-res-32k | blocks.10.hook_resid_post | 32768 | expected_average_only_in |
l11r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/11-llamascope-openr1-res-32k | blocks.11.hook_resid_post | 32768 | expected_average_only_in |
l12r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/12-llamascope-openr1-res-32k | blocks.12.hook_resid_post | 32768 | expected_average_only_in |
l13r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/13-llamascope-openr1-res-32k | blocks.13.hook_resid_post | 32768 | expected_average_only_in |
l14r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/14-llamascope-openr1-res-32k | blocks.14.hook_resid_post | 32768 | expected_average_only_in |
l15r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/15-llamascope-openr1-res-32k | blocks.15.hook_resid_post | 32768 | expected_average_only_in |
l16r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/16-llamascope-openr1-res-32k | blocks.16.hook_resid_post | 32768 | expected_average_only_in |
l17r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/17-llamascope-openr1-res-32k | blocks.17.hook_resid_post | 32768 | expected_average_only_in |
l18r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/18-llamascope-openr1-res-32k | blocks.18.hook_resid_post | 32768 | expected_average_only_in |
l19r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/19-llamascope-openr1-res-32k | blocks.19.hook_resid_post | 32768 | expected_average_only_in |
l20r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/20-llamascope-openr1-res-32k | blocks.20.hook_resid_post | 32768 | expected_average_only_in |
l21r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/21-llamascope-openr1-res-32k | blocks.21.hook_resid_post | 32768 | expected_average_only_in |
l22r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/22-llamascope-openr1-res-32k | blocks.22.hook_resid_post | 32768 | expected_average_only_in |
l23r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/23-llamascope-openr1-res-32k | blocks.23.hook_resid_post | 32768 | expected_average_only_in |
l24r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/24-llamascope-openr1-res-32k | blocks.24.hook_resid_post | 32768 | expected_average_only_in |
l25r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/25-llamascope-openr1-res-32k | blocks.25.hook_resid_post | 32768 | expected_average_only_in |
l26r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/26-llamascope-openr1-res-32k | blocks.26.hook_resid_post | 32768 | expected_average_only_in |
l27r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/27-llamascope-openr1-res-32k | blocks.27.hook_resid_post | 32768 | expected_average_only_in |
l28r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/28-llamascope-openr1-res-32k | blocks.28.hook_resid_post | 32768 | expected_average_only_in |
l29r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/29-llamascope-openr1-res-32k | blocks.29.hook_resid_post | 32768 | expected_average_only_in |
l30r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/30-llamascope-openr1-res-32k | blocks.30.hook_resid_post | 32768 | expected_average_only_in |
l31r_800m_openr1_math Load this SAE |
jumprelu | deepseek-r1-distill-llama-8b/31-llamascope-openr1-res-32k | blocks.31.hook_resid_post | 32768 | expected_average_only_in |
mistral-7b-res-wg
- Huggingface Repo: JoshEngels/Mistral-7B-Residual-Stream-SAEs
- model: mistral-7b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.8.hook_resid_pre Load this SAE |
standard | blocks.8.hook_resid_pre | 65536 | constant_norm_rescale | |
blocks.16.hook_resid_pre Load this SAE |
standard | blocks.16.hook_resid_pre | 65536 | constant_norm_rescale | |
blocks.24.hook_resid_pre Load this SAE |
standard | blocks.24.hook_resid_pre | 65536 | constant_norm_rescale |
pythia-70m-deduped-att-sm
- Huggingface Repo: ctigges/pythia-70m-deduped__att-sm_processed
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_attn_out Load this SAE |
standard | pythia-70m-deduped/0-att-sm | blocks.0.hook_attn_out | 32768 | none |
blocks.1.hook_attn_out Load this SAE |
standard | pythia-70m-deduped/1-att-sm | blocks.1.hook_attn_out | 32768 | none |
blocks.2.hook_attn_out Load this SAE |
standard | pythia-70m-deduped/2-att-sm | blocks.2.hook_attn_out | 32768 | none |
blocks.3.hook_attn_out Load this SAE |
standard | pythia-70m-deduped/3-att-sm | blocks.3.hook_attn_out | 32768 | none |
blocks.4.hook_attn_out Load this SAE |
standard | pythia-70m-deduped/4-att-sm | blocks.4.hook_attn_out | 32768 | none |
blocks.5.hook_attn_out Load this SAE |
standard | pythia-70m-deduped/5-att-sm | blocks.5.hook_attn_out | 32768 | none |
pythia-70m-deduped-mlp-sm
- Huggingface Repo: ctigges/pythia-70m-deduped__mlp-sm_processed
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
standard | pythia-70m-deduped/0-mlp-sm | blocks.0.hook_mlp_out | 32768 | none |
blocks.1.hook_mlp_out Load this SAE |
standard | pythia-70m-deduped/1-mlp-sm | blocks.1.hook_mlp_out | 32768 | none |
blocks.2.hook_mlp_out Load this SAE |
standard | pythia-70m-deduped/2-mlp-sm | blocks.2.hook_mlp_out | 32768 | none |
blocks.3.hook_mlp_out Load this SAE |
standard | pythia-70m-deduped/3-mlp-sm | blocks.3.hook_mlp_out | 32768 | none |
blocks.4.hook_mlp_out Load this SAE |
standard | pythia-70m-deduped/4-mlp-sm | blocks.4.hook_mlp_out | 32768 | none |
blocks.5.hook_mlp_out Load this SAE |
standard | pythia-70m-deduped/5-mlp-sm | blocks.5.hook_mlp_out | 32768 | none |
pythia-70m-deduped-res-sm
- Huggingface Repo: ctigges/pythia-70m-deduped__res-sm_processed
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_pre Load this SAE |
standard | pythia-70m-deduped/e-att-sm | blocks.0.hook_resid_pre | 32768 | none |
blocks.0.hook_resid_post Load this SAE |
standard | pythia-70m-deduped/0-res-sm | blocks.0.hook_resid_post | 32768 | none |
blocks.1.hook_resid_post Load this SAE |
standard | pythia-70m-deduped/1-res-sm | blocks.1.hook_resid_post | 32768 | none |
blocks.2.hook_resid_post Load this SAE |
standard | pythia-70m-deduped/2-res-sm | blocks.2.hook_resid_post | 32768 | none |
blocks.3.hook_resid_post Load this SAE |
standard | pythia-70m-deduped/3-res-sm | blocks.3.hook_resid_post | 32768 | none |
blocks.4.hook_resid_post Load this SAE |
standard | pythia-70m-deduped/4-res-sm | blocks.4.hook_resid_post | 32768 | none |
blocks.5.hook_resid_post Load this SAE |
standard | pythia-70m-deduped/5-res-sm | blocks.5.hook_resid_post | 32768 | none |
sae_bench_gemma-2-2b_topk_width-2pow12_date-1109
- Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow12_date-1109
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_308 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_3088 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_30881 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_97 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_976 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_9765 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_308 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_3088 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_30881 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_97 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_976 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_9765 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_308 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_3088 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_30881 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_97 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_976 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_9765 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_308 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_3088 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_30881 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_97 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_976 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_9765 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_308 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_3088 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_30881 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_97 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_976 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_9765 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_308 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_3088 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_30881 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_97 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_976 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_9765 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_308 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_3088 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_30881 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_97 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_976 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_9765 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_308 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_3088 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_30881 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_97 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_976 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_9765 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_308 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_3088 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_30881 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_97 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_976 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_9765 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_308 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_3088 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_30881 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_97 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_976 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_9765 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_308 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_3088 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_30881 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_97 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_976 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_9765 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_308 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_3088 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_30881 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_97 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_976 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_9765 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_308 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_3088 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_30881 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_97 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_976 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_9765 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_308 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_3088 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_30881 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_97 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_976 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_9765 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_308 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_3088 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_30881 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_97 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_976 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_9765 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_308 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_3088 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_30881 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_97 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_976 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_9765 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_308 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_3088 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_30881 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_97 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_976 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_9765 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_308 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_3088 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_30881 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_97 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_976 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_9765 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_9765 | blocks.5.hook_resid_post | 4096 | none |
sae_bench_gemma-2-2b_topk_width-2pow14_date-1109
- Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-1109
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_146 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_1464 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_14648 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_463 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_4632 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_46322 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_146 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_1464 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_14648 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_463 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_4632 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_46322 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_146 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_1464 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_14648 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_463 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_4632 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_46322 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_146 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_1464 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_14648 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_463 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_4632 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_46322 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_146 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_1464 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_14648 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_463 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_4632 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_46322 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_146 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_1464 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_14648 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_463 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_4632 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_46322 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_146 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_1464 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_14648 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_463 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_4632 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_46322 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_146 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_1464 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_14648 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_463 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_4632 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_46322 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_146 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_1464 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_14648 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_463 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_4632 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_46322 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_146 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_1464 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_14648 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_463 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_4632 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_46322 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_146 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_1464 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_14648 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_463 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_4632 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_46322 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_146 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_1464 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_14648 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_463 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_4632 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_46322 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_146 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_1464 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_14648 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_463 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_4632 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_46322 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_146 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_1464 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_14648 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_463 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_4632 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_46322 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_146 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_1464 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_14648 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_463 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_4632 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_46322 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_146 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_1464 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_14648 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_463 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_4632 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_46322 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_146 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_1464 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_14648 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_463 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_4632 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_46322 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_146 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_1464 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_14648 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_463 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_4632 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_46322 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_46322 | blocks.5.hook_resid_post | 16384 | none |
sae_bench_gemma-2-2b_topk_width-2pow16_date-1109
- Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-1109
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.19.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.5.hook_resid_post__trainer_0 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_1 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_2 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_3 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_4 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_5 Load this SAE |
topk | gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_final | blocks.5.hook_resid_post | 65536 | none |
sae_bench_gemma-2-2b_vanilla_width-2pow12_date-1109
- Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow12_date-1109
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_308 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_3088 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_30881 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_97 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_976 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_0_step_9765 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_308 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_3088 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_30881 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_97 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_976 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_1_step_9765 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_308 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_3088 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_30881 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_97 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_976 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_2_step_9765 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_308 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_3088 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_30881 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_97 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_976 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_3_step_9765 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_308 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_3088 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_30881 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_97 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_976 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_4_step_9765 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_final | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_0 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_308 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_308 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_3088 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_3088 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_30881 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_30881 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_97 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_97 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_976 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_976 | blocks.12.hook_resid_post | 4096 | none |
blocks.12.hook_resid_post__trainer_5_step_9765 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_9765 | blocks.12.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_308 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_3088 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_30881 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_97 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_976 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_0_step_9765 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_308 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_3088 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_30881 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_97 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_976 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_1_step_9765 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_308 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_3088 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_30881 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_97 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_976 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_2_step_9765 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_308 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_3088 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_30881 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_97 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_976 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_3_step_9765 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_308 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_3088 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_30881 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_97 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_976 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_4_step_9765 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_final | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_0 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_308 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_308 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_3088 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_3088 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_30881 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_30881 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_97 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_97 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_976 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_976 | blocks.19.hook_resid_post | 4096 | none |
blocks.19.hook_resid_post__trainer_5_step_9765 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_9765 | blocks.19.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_308 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_3088 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_30881 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_97 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_976 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_0_step_9765 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_308 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_3088 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_30881 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_97 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_976 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_1_step_9765 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_308 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_3088 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_30881 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_97 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_976 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_2_step_9765 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_308 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_3088 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_30881 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_97 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_976 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_3_step_9765 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_308 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_3088 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_30881 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_97 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_976 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_4_step_9765 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_9765 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_final | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_0 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_308 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_308 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_3088 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_3088 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_30881 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_30881 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_97 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_97 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_976 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_976 | blocks.5.hook_resid_post | 4096 | none |
blocks.5.hook_resid_post__trainer_5_step_9765 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_9765 | blocks.5.hook_resid_post | 4096 | none |
sae_bench_gemma-2-2b_vanilla_width-2pow14_date-1109
- Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-1109
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_146 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_1464 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_14648 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_463 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_4632 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_0_step_46322 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_146 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_1464 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_14648 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_463 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_4632 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_1_step_46322 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_146 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_1464 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_14648 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_463 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_4632 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_2_step_46322 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_146 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_1464 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_14648 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_463 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_4632 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_3_step_46322 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_146 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_1464 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_14648 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_463 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_4632 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_4_step_46322 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_final | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_0 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_146 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_146 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_1464 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_1464 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_14648 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_14648 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_463 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_463 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_4632 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_4632 | blocks.12.hook_resid_post | 16384 | none |
blocks.12.hook_resid_post__trainer_5_step_46322 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_46322 | blocks.12.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_146 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_1464 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_14648 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_463 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_4632 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_0_step_46322 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_146 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_1464 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_14648 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_463 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_4632 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_1_step_46322 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_146 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_1464 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_14648 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_463 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_4632 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_2_step_46322 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_146 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_1464 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_14648 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_463 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_4632 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_3_step_46322 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_146 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_1464 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_14648 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_463 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_4632 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_4_step_46322 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_final | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_0 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_146 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_146 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_1464 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_1464 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_14648 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_14648 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_463 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_463 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_4632 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_4632 | blocks.19.hook_resid_post | 16384 | none |
blocks.19.hook_resid_post__trainer_5_step_46322 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_46322 | blocks.19.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_146 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_1464 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_14648 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_463 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_4632 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_0_step_46322 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_146 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_1464 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_14648 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_463 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_4632 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_1_step_46322 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_146 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_1464 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_14648 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_463 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_4632 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_2_step_46322 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_146 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_1464 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_14648 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_463 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_4632 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_3_step_46322 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_146 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_1464 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_14648 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_463 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_4632 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_4_step_46322 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_46322 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_final | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_0 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_146 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_146 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_1464 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_1464 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_14648 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_14648 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_463 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_463 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_4632 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_4632 | blocks.5.hook_resid_post | 16384 | none |
blocks.5.hook_resid_post__trainer_5_step_46322 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_46322 | blocks.5.hook_resid_post | 16384 | none |
sae_bench_gemma-2-2b_vanilla_width-2pow16_date-1109
- Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-1109
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.12.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.12.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_final | blocks.12.hook_resid_post | 65536 | none |
blocks.19.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.19.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_final | blocks.19.hook_resid_post | 64512 | none |
blocks.5.hook_resid_post__trainer_0 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_1 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_2 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_3 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_4 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_final | blocks.5.hook_resid_post | 65536 | none |
blocks.5.hook_resid_post__trainer_5 Load this SAE |
standard | gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_final | blocks.5.hook_resid_post | 65536 | none |
sae_bench_pythia70m_sweep_gated_ctx128_0730
- Huggingface Repo: canrager/lm_sae
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.3.hook_resid_post__trainer_0 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_0_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_1 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_1_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_10 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_10_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_12 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_12_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_13 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_13_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_14 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_14_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_15 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_15_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_16 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_16_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_17 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_17_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_18 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_18_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_19 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_19_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_2 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_2_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_3 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_3_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_4 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_4_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_5 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_5_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_6 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_6_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_7 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_7_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_8 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_8_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_9 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_9_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_11 Load this SAE |
gated | pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_11_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_0 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_0_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_1 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_1_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_10 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_10_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_11 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_11_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_12 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_12_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_13 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_13_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_14 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_14_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_15 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_15_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_16 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_16_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_17 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_17_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_18 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_18_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_19 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_19_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_2 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_2_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_3 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_3_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_4 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_4_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_5 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_5_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_6 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_6_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_9 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_9_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_8 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_8_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_7 Load this SAE |
gated | pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_7_step_final | blocks.4.hook_resid_post | 16384 | none |
sae_bench_pythia70m_sweep_panneal_ctx128_0730
- Huggingface Repo: canrager/lm_sae
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.3.hook_resid_post__trainer_16 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_16_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_17 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_17_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_18 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_18_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_19 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_19_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_2 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_2_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_20 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_20_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_21 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_21_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_22 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_22_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_15 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_15_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_23 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_23_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_25 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_25_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_26 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_26_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_27 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_27_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_3 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_3_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_4 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_4_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_5 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_5_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_6 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_6_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_7 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_7_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_24 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_24_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_14 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_14_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_13 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_13_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_12 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_12_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_0 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_0_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_1 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_1_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_10 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_10_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_11 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_11_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_8 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_8_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_9 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_9_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_17 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_17_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_18 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_18_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_19 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_19_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_16 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_16_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_15 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_15_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_14 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_14_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_13 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_13_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_12 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_12_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_11 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_11_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_10 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_10_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_1 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_1_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_0 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_0_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_2 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_2_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_20 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_20_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_22 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_22_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_9 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_9_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_8 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_8_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_7 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_7_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_6 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_6_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_5 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_5_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_4 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_4_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_27 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_27_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_26 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_26_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_25 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_25_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_3 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_3_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_24 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_24_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_21 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_21_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_23 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_23_step_final | blocks.4.hook_resid_post | 16384 | none |
sae_bench_pythia70m_sweep_standard_ctx128_0712
- Huggingface Repo: canrager/lm_sae
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.3.hook_resid_post__trainer_10 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_10_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_11 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_11_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_8 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_8_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_7 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_7_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_6 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_6_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_5 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_5_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_4 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_4_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_3 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_3_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_2 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_2_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_19 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_19_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_18 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_18_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_17 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_17_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_16 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_16_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_15 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_15_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_14 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_14_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_0 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_0_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_1 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_1_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_13 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_13_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_12 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_12_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_9 Load this SAE |
standard | pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_9_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_0 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_0_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_11 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_11_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_10 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_10_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_1 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_1_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_13 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_13_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_14 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_14_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_16 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_16_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_17 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_17_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_18 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_18_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_2 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_2_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_20 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_20_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_21 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_21_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_12 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_12_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_22 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_22_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_3 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_3_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_4 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_4_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_5 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_5_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_6 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_6_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_7 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_7_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_8 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_8_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_9 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_9_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_23 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_23_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_15 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_15_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_19 Load this SAE |
standard | pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_19_step_final | blocks.4.hook_resid_post | 16384 | none |
sae_bench_pythia70m_sweep_topk_ctx128_0730
- Huggingface Repo: canrager/lm_sae
- model: pythia-70m-deduped
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.3.hook_resid_post__trainer_0 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_0_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_1 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_1_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_10 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_10_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_11 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_11_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_12 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_12_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_13 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_13_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_14 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_14_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_22 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_22_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_19 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_19_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_2 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_2_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_20 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_20_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_21 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_21_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_16 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_16_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_23 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_23_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_18 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_18_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_3 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_3_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_5 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_5_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_6 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_6_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_7 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_7_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_8 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_8_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_9 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_9_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_15 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_15_step_final | blocks.3.hook_resid_post | 16384 | none |
blocks.3.hook_resid_post__trainer_4 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_4_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.3.hook_resid_post__trainer_17 Load this SAE |
topk | pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_17_step_final | blocks.3.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_13 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_13_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_14 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_14_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_15 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_15_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_16 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_16_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_17 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_17_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_18 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_18_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_19 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_19_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_2 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_2_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_20 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_20_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_21 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_21_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_22 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_22_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_23 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_23_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_3 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_3_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_4 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_4_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_5 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_5_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_6 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_6_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_7 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_7_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_12 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_12_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_11 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_11_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_10 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_10_step_final | blocks.4.hook_resid_post | 16384 | none |
blocks.4.hook_resid_post__trainer_1 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_1_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_0 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_0_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_9 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_9_step_final | blocks.4.hook_resid_post | 4096 | none |
blocks.4.hook_resid_post__trainer_8 Load this SAE |
topk | pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_8_step_final | blocks.4.hook_resid_post | 4096 | none |
gemma-2-2b-res-matryoshka-dc
- Huggingface Repo: chanind/gemma-2-2b-batch-topk-matryoshka-saes-w-32k-l0-40
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
jumprelu | blocks.0.hook_resid_post | 32768 | none | |
blocks.1.hook_resid_post Load this SAE |
jumprelu | blocks.1.hook_resid_post | 32768 | none | |
blocks.2.hook_resid_post Load this SAE |
jumprelu | blocks.2.hook_resid_post | 32768 | none | |
blocks.3.hook_resid_post Load this SAE |
jumprelu | blocks.3.hook_resid_post | 32768 | none | |
blocks.4.hook_resid_post Load this SAE |
jumprelu | blocks.4.hook_resid_post | 32768 | none | |
blocks.5.hook_resid_post Load this SAE |
jumprelu | blocks.5.hook_resid_post | 32768 | none | |
blocks.6.hook_resid_post Load this SAE |
jumprelu | blocks.6.hook_resid_post | 32768 | none | |
blocks.7.hook_resid_post Load this SAE |
jumprelu | blocks.7.hook_resid_post | 32768 | none | |
blocks.8.hook_resid_post Load this SAE |
jumprelu | blocks.8.hook_resid_post | 32768 | none | |
blocks.9.hook_resid_post Load this SAE |
jumprelu | blocks.9.hook_resid_post | 32768 | none | |
blocks.10.hook_resid_post Load this SAE |
jumprelu | blocks.10.hook_resid_post | 32768 | none | |
blocks.11.hook_resid_post Load this SAE |
jumprelu | blocks.11.hook_resid_post | 32768 | none | |
blocks.12.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/12-res-matryoshka-dc | blocks.12.hook_resid_post | 32768 | none |
blocks.13.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/13-res-matryoshka-dc | blocks.13.hook_resid_post | 32768 | none |
blocks.14.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/14-res-matryoshka-dc | blocks.14.hook_resid_post | 32768 | none |
blocks.15.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/15-res-matryoshka-dc | blocks.15.hook_resid_post | 32768 | none |
blocks.16.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/16-res-matryoshka-dc | blocks.16.hook_resid_post | 32768 | none |
blocks.17.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/17-res-matryoshka-dc | blocks.17.hook_resid_post | 32768 | none |
blocks.18.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/18-res-matryoshka-dc | blocks.18.hook_resid_post | 32768 | none |
blocks.19.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/19-res-matryoshka-dc | blocks.19.hook_resid_post | 32768 | none |
blocks.20.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/20-res-matryoshka-dc | blocks.20.hook_resid_post | 32768 | none |
blocks.21.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/21-res-matryoshka-dc | blocks.21.hook_resid_post | 32768 | none |
blocks.22.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/22-res-matryoshka-dc | blocks.22.hook_resid_post | 32768 | none |
blocks.23.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/23-res-matryoshka-dc | blocks.23.hook_resid_post | 32768 | none |
blocks.24.hook_resid_post Load this SAE |
jumprelu | gemma-2-2b/24-res-matryoshka-dc | blocks.24.hook_resid_post | 32768 | none |
gemma-2-2b-res-snap-matryoshka-dc
- Huggingface Repo: chanind/gemma-2-2b-batch-topk-matryoshka-saes-w-32k-l0-40
- model: gemma-2-2b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
jumprelu | blocks.0.hook_resid_post | 32768 | none | |
blocks.1.hook_resid_post Load this SAE |
jumprelu | blocks.1.hook_resid_post | 32768 | none | |
blocks.2.hook_resid_post Load this SAE |
jumprelu | blocks.2.hook_resid_post | 32768 | none | |
blocks.3.hook_resid_post Load this SAE |
jumprelu | blocks.3.hook_resid_post | 32768 | none | |
blocks.4.hook_resid_post Load this SAE |
jumprelu | blocks.4.hook_resid_post | 32768 | none | |
blocks.5.hook_resid_post Load this SAE |
jumprelu | blocks.5.hook_resid_post | 32768 | none | |
blocks.6.hook_resid_post Load this SAE |
jumprelu | blocks.6.hook_resid_post | 32768 | none | |
blocks.7.hook_resid_post Load this SAE |
jumprelu | blocks.7.hook_resid_post | 32768 | none | |
blocks.8.hook_resid_post Load this SAE |
jumprelu | blocks.8.hook_resid_post | 32768 | none | |
blocks.9.hook_resid_post Load this SAE |
jumprelu | blocks.9.hook_resid_post | 32768 | none | |
blocks.10.hook_resid_post Load this SAE |
jumprelu | blocks.10.hook_resid_post | 32768 | none | |
blocks.11.hook_resid_post Load this SAE |
jumprelu | blocks.11.hook_resid_post | 32768 | none | |
blocks.12.hook_resid_post Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
blocks.13.hook_resid_post Load this SAE |
jumprelu | blocks.13.hook_resid_post | 32768 | none | |
blocks.14.hook_resid_post Load this SAE |
jumprelu | blocks.14.hook_resid_post | 32768 | none | |
blocks.15.hook_resid_post Load this SAE |
jumprelu | blocks.15.hook_resid_post | 32768 | none | |
blocks.16.hook_resid_post Load this SAE |
jumprelu | blocks.16.hook_resid_post | 32768 | none | |
blocks.17.hook_resid_post Load this SAE |
jumprelu | blocks.17.hook_resid_post | 32768 | none | |
blocks.18.hook_resid_post Load this SAE |
jumprelu | blocks.18.hook_resid_post | 32768 | none | |
blocks.19.hook_resid_post Load this SAE |
jumprelu | blocks.19.hook_resid_post | 32768 | none | |
blocks.20.hook_resid_post Load this SAE |
jumprelu | blocks.20.hook_resid_post | 32768 | none | |
blocks.21.hook_resid_post Load this SAE |
jumprelu | blocks.21.hook_resid_post | 32768 | none | |
blocks.22.hook_resid_post Load this SAE |
jumprelu | blocks.22.hook_resid_post | 32768 | none | |
blocks.23.hook_resid_post Load this SAE |
jumprelu | blocks.23.hook_resid_post | 32768 | none | |
blocks.24.hook_resid_post Load this SAE |
jumprelu | blocks.24.hook_resid_post | 32768 | none |
gemma-2-9b-res-matryoshka-dc
- Huggingface Repo: chanind/gemma-2-9b-batch-topk-matryoshka-saes-w-32k-l0-60
- model: gemma-2-9b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
jumprelu | blocks.0.hook_resid_post | 32768 | none | |
blocks.1.hook_resid_post Load this SAE |
jumprelu | blocks.1.hook_resid_post | 32768 | none | |
blocks.2.hook_resid_post Load this SAE |
jumprelu | blocks.2.hook_resid_post | 32768 | none | |
blocks.3.hook_resid_post Load this SAE |
jumprelu | blocks.3.hook_resid_post | 32768 | none | |
blocks.4.hook_resid_post Load this SAE |
jumprelu | blocks.4.hook_resid_post | 32768 | none | |
blocks.5.hook_resid_post Load this SAE |
jumprelu | blocks.5.hook_resid_post | 32768 | none | |
blocks.6.hook_resid_post Load this SAE |
jumprelu | blocks.6.hook_resid_post | 32768 | none | |
blocks.7.hook_resid_post Load this SAE |
jumprelu | blocks.7.hook_resid_post | 32768 | none | |
blocks.8.hook_resid_post Load this SAE |
jumprelu | blocks.8.hook_resid_post | 32768 | none | |
blocks.9.hook_resid_post Load this SAE |
jumprelu | blocks.9.hook_resid_post | 32768 | none | |
blocks.10.hook_resid_post Load this SAE |
jumprelu | blocks.10.hook_resid_post | 32768 | none | |
blocks.11.hook_resid_post Load this SAE |
jumprelu | blocks.11.hook_resid_post | 32768 | none | |
blocks.12.hook_resid_post Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
blocks.13.hook_resid_post Load this SAE |
jumprelu | blocks.13.hook_resid_post | 32768 | none | |
blocks.14.hook_resid_post Load this SAE |
jumprelu | blocks.14.hook_resid_post | 32768 | none | |
blocks.15.hook_resid_post Load this SAE |
jumprelu | blocks.15.hook_resid_post | 32768 | none | |
blocks.16.hook_resid_post Load this SAE |
jumprelu | blocks.16.hook_resid_post | 32768 | none | |
blocks.17.hook_resid_post Load this SAE |
jumprelu | blocks.17.hook_resid_post | 32768 | none | |
blocks.18.hook_resid_post Load this SAE |
jumprelu | blocks.18.hook_resid_post | 32768 | none | |
blocks.19.hook_resid_post Load this SAE |
jumprelu | blocks.19.hook_resid_post | 32768 | none | |
blocks.20.hook_resid_post Load this SAE |
jumprelu | gemma-2-9b/20-res-matryoshka-dc | blocks.20.hook_resid_post | 32768 | none |
blocks.21.hook_resid_post Load this SAE |
jumprelu | blocks.21.hook_resid_post | 32768 | none | |
blocks.22.hook_resid_post Load this SAE |
jumprelu | blocks.22.hook_resid_post | 32768 | none | |
blocks.23.hook_resid_post Load this SAE |
jumprelu | blocks.23.hook_resid_post | 32768 | none | |
blocks.24.hook_resid_post Load this SAE |
jumprelu | blocks.24.hook_resid_post | 32768 | none | |
blocks.25.hook_resid_post Load this SAE |
jumprelu | blocks.25.hook_resid_post | 32768 | none | |
blocks.26.hook_resid_post Load this SAE |
jumprelu | blocks.26.hook_resid_post | 32768 | none | |
blocks.27.hook_resid_post Load this SAE |
jumprelu | blocks.27.hook_resid_post | 32768 | none | |
blocks.28.hook_resid_post Load this SAE |
jumprelu | blocks.28.hook_resid_post | 32768 | none | |
blocks.29.hook_resid_post Load this SAE |
jumprelu | blocks.29.hook_resid_post | 32768 | none | |
blocks.30.hook_resid_post Load this SAE |
jumprelu | blocks.30.hook_resid_post | 32768 | none | |
blocks.31.hook_resid_post Load this SAE |
jumprelu | blocks.31.hook_resid_post | 32768 | none | |
blocks.32.hook_resid_post Load this SAE |
jumprelu | blocks.32.hook_resid_post | 32768 | none | |
blocks.33.hook_resid_post Load this SAE |
jumprelu | blocks.33.hook_resid_post | 32768 | none | |
blocks.34.hook_resid_post Load this SAE |
jumprelu | blocks.34.hook_resid_post | 32768 | none | |
blocks.35.hook_resid_post Load this SAE |
jumprelu | blocks.35.hook_resid_post | 32768 | none | |
blocks.36.hook_resid_post Load this SAE |
jumprelu | blocks.36.hook_resid_post | 32768 | none | |
blocks.37.hook_resid_post Load this SAE |
jumprelu | blocks.37.hook_resid_post | 32768 | none | |
blocks.38.hook_resid_post Load this SAE |
jumprelu | blocks.38.hook_resid_post | 32768 | none | |
blocks.39.hook_resid_post Load this SAE |
jumprelu | blocks.39.hook_resid_post | 32768 | none | |
blocks.40.hook_resid_post Load this SAE |
jumprelu | blocks.40.hook_resid_post | 32768 | none |
gemma-3-1b-res-matryoshka-dc
- Huggingface Repo: chanind/gemma-3-1b-batch-topk-matryoshka-saes-w-32k-l0-40
- model: gemma-3-1b
- Additional Links:
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
jumprelu | blocks.0.hook_resid_post | 32768 | none | |
blocks.1.hook_resid_post Load this SAE |
jumprelu | blocks.1.hook_resid_post | 32768 | none | |
blocks.2.hook_resid_post Load this SAE |
jumprelu | blocks.2.hook_resid_post | 32768 | none | |
blocks.3.hook_resid_post Load this SAE |
jumprelu | blocks.3.hook_resid_post | 32768 | none | |
blocks.4.hook_resid_post Load this SAE |
jumprelu | blocks.4.hook_resid_post | 32768 | none | |
blocks.5.hook_resid_post Load this SAE |
jumprelu | blocks.5.hook_resid_post | 32768 | none | |
blocks.6.hook_resid_post Load this SAE |
jumprelu | blocks.6.hook_resid_post | 32768 | none | |
blocks.7.hook_resid_post Load this SAE |
jumprelu | blocks.7.hook_resid_post | 32768 | none | |
blocks.8.hook_resid_post Load this SAE |
jumprelu | blocks.8.hook_resid_post | 32768 | none | |
blocks.9.hook_resid_post Load this SAE |
jumprelu | blocks.9.hook_resid_post | 32768 | none | |
blocks.10.hook_resid_post Load this SAE |
jumprelu | blocks.10.hook_resid_post | 32768 | none | |
blocks.11.hook_resid_post Load this SAE |
jumprelu | blocks.11.hook_resid_post | 32768 | none | |
blocks.12.hook_resid_post Load this SAE |
jumprelu | blocks.12.hook_resid_post | 32768 | none | |
blocks.13.hook_resid_post Load this SAE |
jumprelu | blocks.13.hook_resid_post | 32768 | none | |
blocks.14.hook_resid_post Load this SAE |
jumprelu | blocks.14.hook_resid_post | 32768 | none | |
blocks.15.hook_resid_post Load this SAE |
jumprelu | blocks.15.hook_resid_post | 32768 | none | |
blocks.16.hook_resid_post Load this SAE |
jumprelu | blocks.16.hook_resid_post | 32768 | none | |
blocks.17.hook_resid_post Load this SAE |
jumprelu | blocks.17.hook_resid_post | 32768 | none | |
blocks.18.hook_resid_post Load this SAE |
jumprelu | blocks.18.hook_resid_post | 32768 | none | |
blocks.19.hook_resid_post Load this SAE |
jumprelu | blocks.19.hook_resid_post | 32768 | none | |
blocks.20.hook_resid_post Load this SAE |
jumprelu | blocks.20.hook_resid_post | 32768 | none | |
blocks.21.hook_resid_post Load this SAE |
jumprelu | blocks.21.hook_resid_post | 32768 | none | |
blocks.22.hook_resid_post Load this SAE |
jumprelu | blocks.22.hook_resid_post | 32768 | none | |
blocks.23.hook_resid_post Load this SAE |
jumprelu | blocks.23.hook_resid_post | 32768 | none | |
blocks.24.hook_resid_post Load this SAE |
jumprelu | blocks.24.hook_resid_post | 32768 | none |
gemma-scope-2b-pt-transcoders
- Huggingface Repo: google/gemma-scope-2b-pt-transcoders
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0/width_16k/average_l0_76 Load this SAE |
jumprelu_transcoder | gemma-2-2b/0-gemmascope-transcoder-16k | blocks.0.ln2.hook_normalized | 16384 | none |
layer_1/width_16k/average_l0_65 Load this SAE |
jumprelu_transcoder | gemma-2-2b/1-gemmascope-transcoder-16k | blocks.1.ln2.hook_normalized | 16384 | none |
layer_2/width_16k/average_l0_49 Load this SAE |
jumprelu_transcoder | gemma-2-2b/2-gemmascope-transcoder-16k | blocks.2.ln2.hook_normalized | 16384 | none |
layer_3/width_16k/average_l0_54 Load this SAE |
jumprelu_transcoder | gemma-2-2b/3-gemmascope-transcoder-16k | blocks.3.ln2.hook_normalized | 16384 | none |
layer_4/width_16k/average_l0_88 Load this SAE |
jumprelu_transcoder | gemma-2-2b/4-gemmascope-transcoder-16k | blocks.4.ln2.hook_normalized | 16384 | none |
layer_5/width_16k/average_l0_87 Load this SAE |
jumprelu_transcoder | gemma-2-2b/5-gemmascope-transcoder-16k | blocks.5.ln2.hook_normalized | 16384 | none |
layer_6/width_16k/average_l0_95 Load this SAE |
jumprelu_transcoder | gemma-2-2b/6-gemmascope-transcoder-16k | blocks.6.ln2.hook_normalized | 16384 | none |
layer_7/width_16k/average_l0_70 Load this SAE |
jumprelu_transcoder | gemma-2-2b/7-gemmascope-transcoder-16k | blocks.7.ln2.hook_normalized | 16384 | none |
layer_8/width_16k/average_l0_52 Load this SAE |
jumprelu_transcoder | gemma-2-2b/8-gemmascope-transcoder-16k | blocks.8.ln2.hook_normalized | 16384 | none |
layer_9/width_16k/average_l0_72 Load this SAE |
jumprelu_transcoder | gemma-2-2b/9-gemmascope-transcoder-16k | blocks.9.ln2.hook_normalized | 16384 | none |
layer_10/width_16k/average_l0_88 Load this SAE |
jumprelu_transcoder | gemma-2-2b/10-gemmascope-transcoder-16k | blocks.10.ln2.hook_normalized | 16384 | none |
layer_11/width_16k/average_l0_5 Load this SAE |
jumprelu_transcoder | gemma-2-2b/11-gemmascope-transcoder-16k | blocks.11.ln2.hook_normalized | 16384 | none |
layer_12/width_16k/average_l0_6 Load this SAE |
jumprelu_transcoder | gemma-2-2b/12-gemmascope-transcoder-16k | blocks.12.ln2.hook_normalized | 16384 | none |
layer_13/width_16k/average_l0_8 Load this SAE |
jumprelu_transcoder | gemma-2-2b/13-gemmascope-transcoder-16k | blocks.13.ln2.hook_normalized | 16384 | none |
layer_14/width_16k/average_l0_8 Load this SAE |
jumprelu_transcoder | gemma-2-2b/14-gemmascope-transcoder-16k | blocks.14.ln2.hook_normalized | 16384 | none |
layer_15/width_16k/average_l0_8 Load this SAE |
jumprelu_transcoder | gemma-2-2b/15-gemmascope-transcoder-16k | blocks.15.ln2.hook_normalized | 16384 | none |
layer_16/width_16k/average_l0_10 Load this SAE |
jumprelu_transcoder | gemma-2-2b/16-gemmascope-transcoder-16k | blocks.16.ln2.hook_normalized | 16384 | none |
layer_17/width_16k/average_l0_12 Load this SAE |
jumprelu_transcoder | gemma-2-2b/17-gemmascope-transcoder-16k | blocks.17.ln2.hook_normalized | 16384 | none |
layer_18/width_16k/average_l0_13 Load this SAE |
jumprelu_transcoder | gemma-2-2b/18-gemmascope-transcoder-16k | blocks.18.ln2.hook_normalized | 16384 | none |
layer_19/width_16k/average_l0_12 Load this SAE |
jumprelu_transcoder | gemma-2-2b/19-gemmascope-transcoder-16k | blocks.19.ln2.hook_normalized | 16384 | none |
layer_20/width_16k/average_l0_11 Load this SAE |
jumprelu_transcoder | gemma-2-2b/20-gemmascope-transcoder-16k | blocks.20.ln2.hook_normalized | 16384 | none |
layer_21/width_16k/average_l0_13 Load this SAE |
jumprelu_transcoder | gemma-2-2b/21-gemmascope-transcoder-16k | blocks.21.ln2.hook_normalized | 16384 | none |
layer_22/width_16k/average_l0_15 Load this SAE |
jumprelu_transcoder | gemma-2-2b/22-gemmascope-transcoder-16k | blocks.22.ln2.hook_normalized | 16384 | none |
layer_23/width_16k/average_l0_25 Load this SAE |
jumprelu_transcoder | gemma-2-2b/23-gemmascope-transcoder-16k | blocks.23.ln2.hook_normalized | 16384 | none |
layer_24/width_16k/average_l0_37 Load this SAE |
jumprelu_transcoder | gemma-2-2b/24-gemmascope-transcoder-16k | blocks.24.ln2.hook_normalized | 16384 | none |
layer_25/width_16k/average_l0_41 Load this SAE |
jumprelu_transcoder | gemma-2-2b/25-gemmascope-transcoder-16k | blocks.25.ln2.hook_normalized | 16384 | none |
mwhanna-qwen3-4b-transcoders
- Huggingface Repo: mwhanna/qwen3-4b-transcoders
- model: qwen3-4b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | qwen3-4b/0-transcoder-hp | blocks.0.mlp.hook_in | 163840 | none |
layer_1 Load this SAE |
transcoder | qwen3-4b/1-transcoder-hp | blocks.1.mlp.hook_in | 163840 | none |
layer_2 Load this SAE |
transcoder | qwen3-4b/2-transcoder-hp | blocks.2.mlp.hook_in | 163840 | none |
layer_3 Load this SAE |
transcoder | qwen3-4b/3-transcoder-hp | blocks.3.mlp.hook_in | 163840 | none |
layer_4 Load this SAE |
transcoder | qwen3-4b/4-transcoder-hp | blocks.4.mlp.hook_in | 163840 | none |
layer_5 Load this SAE |
transcoder | qwen3-4b/5-transcoder-hp | blocks.5.mlp.hook_in | 163840 | none |
layer_6 Load this SAE |
transcoder | qwen3-4b/6-transcoder-hp | blocks.6.mlp.hook_in | 163840 | none |
layer_7 Load this SAE |
transcoder | qwen3-4b/7-transcoder-hp | blocks.7.mlp.hook_in | 163840 | none |
layer_8 Load this SAE |
transcoder | qwen3-4b/8-transcoder-hp | blocks.8.mlp.hook_in | 163840 | none |
layer_9 Load this SAE |
transcoder | qwen3-4b/9-transcoder-hp | blocks.9.mlp.hook_in | 163840 | none |
layer_10 Load this SAE |
transcoder | qwen3-4b/10-transcoder-hp | blocks.10.mlp.hook_in | 163840 | none |
layer_11 Load this SAE |
transcoder | qwen3-4b/11-transcoder-hp | blocks.11.mlp.hook_in | 163840 | none |
layer_12 Load this SAE |
transcoder | qwen3-4b/12-transcoder-hp | blocks.12.mlp.hook_in | 163840 | none |
layer_13 Load this SAE |
transcoder | qwen3-4b/13-transcoder-hp | blocks.13.mlp.hook_in | 163840 | none |
layer_14 Load this SAE |
transcoder | qwen3-4b/14-transcoder-hp | blocks.14.mlp.hook_in | 163840 | none |
layer_15 Load this SAE |
transcoder | qwen3-4b/15-transcoder-hp | blocks.15.mlp.hook_in | 163840 | none |
layer_16 Load this SAE |
transcoder | qwen3-4b/16-transcoder-hp | blocks.16.mlp.hook_in | 163840 | none |
layer_17 Load this SAE |
transcoder | qwen3-4b/17-transcoder-hp | blocks.17.mlp.hook_in | 163840 | none |
layer_18 Load this SAE |
transcoder | qwen3-4b/18-transcoder-hp | blocks.18.mlp.hook_in | 163840 | none |
layer_19 Load this SAE |
transcoder | qwen3-4b/19-transcoder-hp | blocks.19.mlp.hook_in | 163840 | none |
layer_20 Load this SAE |
transcoder | qwen3-4b/20-transcoder-hp | blocks.20.mlp.hook_in | 163840 | none |
layer_21 Load this SAE |
transcoder | qwen3-4b/21-transcoder-hp | blocks.21.mlp.hook_in | 163840 | none |
layer_22 Load this SAE |
transcoder | qwen3-4b/22-transcoder-hp | blocks.22.mlp.hook_in | 163840 | none |
layer_23 Load this SAE |
transcoder | qwen3-4b/23-transcoder-hp | blocks.23.mlp.hook_in | 163840 | none |
layer_24 Load this SAE |
transcoder | qwen3-4b/24-transcoder-hp | blocks.24.mlp.hook_in | 163840 | none |
layer_25 Load this SAE |
transcoder | qwen3-4b/25-transcoder-hp | blocks.25.mlp.hook_in | 163840 | none |
layer_26 Load this SAE |
transcoder | qwen3-4b/26-transcoder-hp | blocks.26.mlp.hook_in | 163840 | none |
layer_27 Load this SAE |
transcoder | qwen3-4b/27-transcoder-hp | blocks.27.mlp.hook_in | 163840 | none |
layer_28 Load this SAE |
transcoder | qwen3-4b/28-transcoder-hp | blocks.28.mlp.hook_in | 163840 | none |
layer_29 Load this SAE |
transcoder | qwen3-4b/29-transcoder-hp | blocks.29.mlp.hook_in | 163840 | none |
layer_30 Load this SAE |
transcoder | qwen3-4b/30-transcoder-hp | blocks.30.mlp.hook_in | 163840 | none |
layer_31 Load this SAE |
transcoder | qwen3-4b/31-transcoder-hp | blocks.31.mlp.hook_in | 163840 | none |
layer_32 Load this SAE |
transcoder | qwen3-4b/32-transcoder-hp | blocks.32.mlp.hook_in | 163840 | none |
layer_33 Load this SAE |
transcoder | qwen3-4b/33-transcoder-hp | blocks.33.mlp.hook_in | 163840 | none |
layer_34 Load this SAE |
transcoder | qwen3-4b/34-transcoder-hp | blocks.34.mlp.hook_in | 163840 | none |
layer_35 Load this SAE |
transcoder | qwen3-4b/35-transcoder-hp | blocks.35.mlp.hook_in | 163840 | none |
mwhanna-qwen3-8b-transcoders
- Huggingface Repo: mwhanna/qwen3-8b-transcoders
- model: qwen3-8b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | qwen3-8b/0-transcoder-hp | blocks.0.mlp.hook_in | 163840 | none |
layer_1 Load this SAE |
transcoder | qwen3-8b/1-transcoder-hp | blocks.1.mlp.hook_in | 163840 | none |
layer_2 Load this SAE |
transcoder | qwen3-8b/2-transcoder-hp | blocks.2.mlp.hook_in | 163840 | none |
layer_3 Load this SAE |
transcoder | qwen3-8b/3-transcoder-hp | blocks.3.mlp.hook_in | 163840 | none |
layer_4 Load this SAE |
transcoder | qwen3-8b/4-transcoder-hp | blocks.4.mlp.hook_in | 163840 | none |
layer_5 Load this SAE |
transcoder | qwen3-8b/5-transcoder-hp | blocks.5.mlp.hook_in | 163840 | none |
layer_6 Load this SAE |
transcoder | qwen3-8b/6-transcoder-hp | blocks.6.mlp.hook_in | 163840 | none |
layer_7 Load this SAE |
transcoder | qwen3-8b/7-transcoder-hp | blocks.7.mlp.hook_in | 163840 | none |
layer_8 Load this SAE |
transcoder | qwen3-8b/8-transcoder-hp | blocks.8.mlp.hook_in | 163840 | none |
layer_9 Load this SAE |
transcoder | qwen3-8b/9-transcoder-hp | blocks.9.mlp.hook_in | 163840 | none |
layer_10 Load this SAE |
transcoder | qwen3-8b/10-transcoder-hp | blocks.10.mlp.hook_in | 163840 | none |
layer_11 Load this SAE |
transcoder | qwen3-8b/11-transcoder-hp | blocks.11.mlp.hook_in | 163840 | none |
layer_12 Load this SAE |
transcoder | qwen3-8b/12-transcoder-hp | blocks.12.mlp.hook_in | 163840 | none |
layer_13 Load this SAE |
transcoder | qwen3-8b/13-transcoder-hp | blocks.13.mlp.hook_in | 163840 | none |
layer_14 Load this SAE |
transcoder | qwen3-8b/14-transcoder-hp | blocks.14.mlp.hook_in | 163840 | none |
layer_15 Load this SAE |
transcoder | qwen3-8b/15-transcoder-hp | blocks.15.mlp.hook_in | 163840 | none |
layer_16 Load this SAE |
transcoder | qwen3-8b/16-transcoder-hp | blocks.16.mlp.hook_in | 163840 | none |
layer_17 Load this SAE |
transcoder | qwen3-8b/17-transcoder-hp | blocks.17.mlp.hook_in | 163840 | none |
layer_18 Load this SAE |
transcoder | qwen3-8b/18-transcoder-hp | blocks.18.mlp.hook_in | 163840 | none |
layer_19 Load this SAE |
transcoder | qwen3-8b/19-transcoder-hp | blocks.19.mlp.hook_in | 163840 | none |
layer_20 Load this SAE |
transcoder | qwen3-8b/20-transcoder-hp | blocks.20.mlp.hook_in | 163840 | none |
layer_21 Load this SAE |
transcoder | qwen3-8b/21-transcoder-hp | blocks.21.mlp.hook_in | 163840 | none |
layer_22 Load this SAE |
transcoder | qwen3-8b/22-transcoder-hp | blocks.22.mlp.hook_in | 163840 | none |
layer_23 Load this SAE |
transcoder | qwen3-8b/23-transcoder-hp | blocks.23.mlp.hook_in | 163840 | none |
layer_24 Load this SAE |
transcoder | qwen3-8b/24-transcoder-hp | blocks.24.mlp.hook_in | 163840 | none |
layer_25 Load this SAE |
transcoder | qwen3-8b/25-transcoder-hp | blocks.25.mlp.hook_in | 163840 | none |
layer_26 Load this SAE |
transcoder | qwen3-8b/26-transcoder-hp | blocks.26.mlp.hook_in | 163840 | none |
layer_27 Load this SAE |
transcoder | qwen3-8b/27-transcoder-hp | blocks.27.mlp.hook_in | 163840 | none |
layer_28 Load this SAE |
transcoder | qwen3-8b/28-transcoder-hp | blocks.28.mlp.hook_in | 163840 | none |
layer_29 Load this SAE |
transcoder | qwen3-8b/29-transcoder-hp | blocks.29.mlp.hook_in | 163840 | none |
layer_30 Load this SAE |
transcoder | qwen3-8b/30-transcoder-hp | blocks.30.mlp.hook_in | 163840 | none |
layer_31 Load this SAE |
transcoder | qwen3-8b/31-transcoder-hp | blocks.31.mlp.hook_in | 163840 | none |
layer_32 Load this SAE |
transcoder | qwen3-8b/32-transcoder-hp | blocks.32.mlp.hook_in | 163840 | none |
layer_33 Load this SAE |
transcoder | qwen3-8b/33-transcoder-hp | blocks.33.mlp.hook_in | 163840 | none |
layer_34 Load this SAE |
transcoder | qwen3-8b/34-transcoder-hp | blocks.34.mlp.hook_in | 163840 | none |
layer_35 Load this SAE |
transcoder | qwen3-8b/35-transcoder-hp | blocks.35.mlp.hook_in | 163840 | none |
mwhanna-qwen3-14b-transcoders
- Huggingface Repo: mwhanna/qwen3-14b-transcoders
- model: qwen3-14b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | qwen3-14b/0-transcoder-hp | blocks.0.mlp.hook_in | 163840 | none |
layer_1 Load this SAE |
transcoder | qwen3-14b/1-transcoder-hp | blocks.1.mlp.hook_in | 163840 | none |
layer_2 Load this SAE |
transcoder | qwen3-14b/2-transcoder-hp | blocks.2.mlp.hook_in | 163840 | none |
layer_3 Load this SAE |
transcoder | qwen3-14b/3-transcoder-hp | blocks.3.mlp.hook_in | 163840 | none |
layer_4 Load this SAE |
transcoder | qwen3-14b/4-transcoder-hp | blocks.4.mlp.hook_in | 163840 | none |
layer_5 Load this SAE |
transcoder | qwen3-14b/5-transcoder-hp | blocks.5.mlp.hook_in | 163840 | none |
layer_6 Load this SAE |
transcoder | qwen3-14b/6-transcoder-hp | blocks.6.mlp.hook_in | 163840 | none |
layer_7 Load this SAE |
transcoder | qwen3-14b/7-transcoder-hp | blocks.7.mlp.hook_in | 163840 | none |
layer_8 Load this SAE |
transcoder | qwen3-14b/8-transcoder-hp | blocks.8.mlp.hook_in | 163840 | none |
layer_9 Load this SAE |
transcoder | qwen3-14b/9-transcoder-hp | blocks.9.mlp.hook_in | 163840 | none |
layer_10 Load this SAE |
transcoder | qwen3-14b/10-transcoder-hp | blocks.10.mlp.hook_in | 163840 | none |
layer_11 Load this SAE |
transcoder | qwen3-14b/11-transcoder-hp | blocks.11.mlp.hook_in | 163840 | none |
layer_12 Load this SAE |
transcoder | qwen3-14b/12-transcoder-hp | blocks.12.mlp.hook_in | 163840 | none |
layer_13 Load this SAE |
transcoder | qwen3-14b/13-transcoder-hp | blocks.13.mlp.hook_in | 163840 | none |
layer_14 Load this SAE |
transcoder | qwen3-14b/14-transcoder-hp | blocks.14.mlp.hook_in | 163840 | none |
layer_15 Load this SAE |
transcoder | qwen3-14b/15-transcoder-hp | blocks.15.mlp.hook_in | 163840 | none |
layer_16 Load this SAE |
transcoder | qwen3-14b/16-transcoder-hp | blocks.16.mlp.hook_in | 163840 | none |
layer_17 Load this SAE |
transcoder | qwen3-14b/17-transcoder-hp | blocks.17.mlp.hook_in | 163840 | none |
layer_18 Load this SAE |
transcoder | qwen3-14b/18-transcoder-hp | blocks.18.mlp.hook_in | 163840 | none |
layer_19 Load this SAE |
transcoder | qwen3-14b/19-transcoder-hp | blocks.19.mlp.hook_in | 163840 | none |
layer_20 Load this SAE |
transcoder | qwen3-14b/20-transcoder-hp | blocks.20.mlp.hook_in | 163840 | none |
layer_21 Load this SAE |
transcoder | qwen3-14b/21-transcoder-hp | blocks.21.mlp.hook_in | 163840 | none |
layer_22 Load this SAE |
transcoder | qwen3-14b/22-transcoder-hp | blocks.22.mlp.hook_in | 163840 | none |
layer_23 Load this SAE |
transcoder | qwen3-14b/23-transcoder-hp | blocks.23.mlp.hook_in | 163840 | none |
layer_24 Load this SAE |
transcoder | qwen3-14b/24-transcoder-hp | blocks.24.mlp.hook_in | 163840 | none |
layer_25 Load this SAE |
transcoder | qwen3-14b/25-transcoder-hp | blocks.25.mlp.hook_in | 163840 | none |
layer_26 Load this SAE |
transcoder | qwen3-14b/26-transcoder-hp | blocks.26.mlp.hook_in | 163840 | none |
layer_27 Load this SAE |
transcoder | qwen3-14b/27-transcoder-hp | blocks.27.mlp.hook_in | 163840 | none |
layer_28 Load this SAE |
transcoder | qwen3-14b/28-transcoder-hp | blocks.28.mlp.hook_in | 163840 | none |
layer_29 Load this SAE |
transcoder | qwen3-14b/29-transcoder-hp | blocks.29.mlp.hook_in | 163840 | none |
layer_30 Load this SAE |
transcoder | qwen3-14b/30-transcoder-hp | blocks.30.mlp.hook_in | 163840 | none |
layer_31 Load this SAE |
transcoder | qwen3-14b/31-transcoder-hp | blocks.31.mlp.hook_in | 163840 | none |
layer_32 Load this SAE |
transcoder | qwen3-14b/32-transcoder-hp | blocks.32.mlp.hook_in | 163840 | none |
layer_33 Load this SAE |
transcoder | qwen3-14b/33-transcoder-hp | blocks.33.mlp.hook_in | 163840 | none |
layer_34 Load this SAE |
transcoder | qwen3-14b/34-transcoder-hp | blocks.34.mlp.hook_in | 163840 | none |
layer_35 Load this SAE |
transcoder | qwen3-14b/35-transcoder-hp | blocks.35.mlp.hook_in | 163840 | none |
layer_36 Load this SAE |
transcoder | qwen3-14b/36-transcoder-hp | blocks.36.mlp.hook_in | 163840 | none |
layer_37 Load this SAE |
transcoder | qwen3-14b/37-transcoder-hp | blocks.37.mlp.hook_in | 163840 | none |
layer_38 Load this SAE |
transcoder | qwen3-14b/38-transcoder-hp | blocks.38.mlp.hook_in | 163840 | none |
layer_39 Load this SAE |
transcoder | qwen3-14b/39-transcoder-hp | blocks.39.mlp.hook_in | 163840 | none |
mwhanna-qwen3-14b-transcoders-lowl0
- Huggingface Repo: mwhanna/qwen3-14b-transcoders-lowl0
- model: qwen3-14b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | qwen3-14b/0-transcoder-hp-lowl0 | blocks.0.mlp.hook_in | 163840 | none |
layer_1 Load this SAE |
transcoder | qwen3-14b/1-transcoder-hp-lowl0 | blocks.1.mlp.hook_in | 163840 | none |
layer_2 Load this SAE |
transcoder | qwen3-14b/2-transcoder-hp-lowl0 | blocks.2.mlp.hook_in | 163840 | none |
layer_3 Load this SAE |
transcoder | qwen3-14b/3-transcoder-hp-lowl0 | blocks.3.mlp.hook_in | 163840 | none |
layer_4 Load this SAE |
transcoder | qwen3-14b/4-transcoder-hp-lowl0 | blocks.4.mlp.hook_in | 163840 | none |
layer_5 Load this SAE |
transcoder | qwen3-14b/5-transcoder-hp-lowl0 | blocks.5.mlp.hook_in | 163840 | none |
layer_6 Load this SAE |
transcoder | qwen3-14b/6-transcoder-hp-lowl0 | blocks.6.mlp.hook_in | 163840 | none |
layer_7 Load this SAE |
transcoder | qwen3-14b/7-transcoder-hp-lowl0 | blocks.7.mlp.hook_in | 163840 | none |
layer_8 Load this SAE |
transcoder | qwen3-14b/8-transcoder-hp-lowl0 | blocks.8.mlp.hook_in | 163840 | none |
layer_9 Load this SAE |
transcoder | qwen3-14b/9-transcoder-hp-lowl0 | blocks.9.mlp.hook_in | 163840 | none |
layer_10 Load this SAE |
transcoder | qwen3-14b/10-transcoder-hp-lowl0 | blocks.10.mlp.hook_in | 163840 | none |
layer_11 Load this SAE |
transcoder | qwen3-14b/11-transcoder-hp-lowl0 | blocks.11.mlp.hook_in | 163840 | none |
layer_12 Load this SAE |
transcoder | qwen3-14b/12-transcoder-hp-lowl0 | blocks.12.mlp.hook_in | 163840 | none |
layer_13 Load this SAE |
transcoder | qwen3-14b/13-transcoder-hp-lowl0 | blocks.13.mlp.hook_in | 163840 | none |
layer_14 Load this SAE |
transcoder | qwen3-14b/14-transcoder-hp-lowl0 | blocks.14.mlp.hook_in | 163840 | none |
layer_15 Load this SAE |
transcoder | qwen3-14b/15-transcoder-hp-lowl0 | blocks.15.mlp.hook_in | 163840 | none |
layer_16 Load this SAE |
transcoder | qwen3-14b/16-transcoder-hp-lowl0 | blocks.16.mlp.hook_in | 163840 | none |
layer_17 Load this SAE |
transcoder | qwen3-14b/17-transcoder-hp-lowl0 | blocks.17.mlp.hook_in | 163840 | none |
layer_18 Load this SAE |
transcoder | qwen3-14b/18-transcoder-hp-lowl0 | blocks.18.mlp.hook_in | 163840 | none |
layer_19 Load this SAE |
transcoder | qwen3-14b/19-transcoder-hp-lowl0 | blocks.19.mlp.hook_in | 163840 | none |
layer_20 Load this SAE |
transcoder | qwen3-14b/20-transcoder-hp-lowl0 | blocks.20.mlp.hook_in | 163840 | none |
layer_21 Load this SAE |
transcoder | qwen3-14b/21-transcoder-hp-lowl0 | blocks.21.mlp.hook_in | 163840 | none |
layer_22 Load this SAE |
transcoder | qwen3-14b/22-transcoder-hp-lowl0 | blocks.22.mlp.hook_in | 163840 | none |
layer_23 Load this SAE |
transcoder | qwen3-14b/23-transcoder-hp-lowl0 | blocks.23.mlp.hook_in | 163840 | none |
layer_24 Load this SAE |
transcoder | qwen3-14b/24-transcoder-hp-lowl0 | blocks.24.mlp.hook_in | 163840 | none |
layer_25 Load this SAE |
transcoder | qwen3-14b/25-transcoder-hp-lowl0 | blocks.25.mlp.hook_in | 163840 | none |
layer_26 Load this SAE |
transcoder | qwen3-14b/26-transcoder-hp-lowl0 | blocks.26.mlp.hook_in | 163840 | none |
layer_27 Load this SAE |
transcoder | qwen3-14b/27-transcoder-hp-lowl0 | blocks.27.mlp.hook_in | 163840 | none |
layer_28 Load this SAE |
transcoder | qwen3-14b/28-transcoder-hp-lowl0 | blocks.28.mlp.hook_in | 163840 | none |
layer_29 Load this SAE |
transcoder | qwen3-14b/29-transcoder-hp-lowl0 | blocks.29.mlp.hook_in | 163840 | none |
layer_30 Load this SAE |
transcoder | qwen3-14b/30-transcoder-hp-lowl0 | blocks.30.mlp.hook_in | 163840 | none |
layer_31 Load this SAE |
transcoder | qwen3-14b/31-transcoder-hp-lowl0 | blocks.31.mlp.hook_in | 163840 | none |
layer_32 Load this SAE |
transcoder | qwen3-14b/32-transcoder-hp-lowl0 | blocks.32.mlp.hook_in | 163840 | none |
layer_33 Load this SAE |
transcoder | qwen3-14b/33-transcoder-hp-lowl0 | blocks.33.mlp.hook_in | 163840 | none |
layer_34 Load this SAE |
transcoder | qwen3-14b/34-transcoder-hp-lowl0 | blocks.34.mlp.hook_in | 163840 | none |
layer_35 Load this SAE |
transcoder | qwen3-14b/35-transcoder-hp-lowl0 | blocks.35.mlp.hook_in | 163840 | none |
layer_36 Load this SAE |
transcoder | qwen3-14b/36-transcoder-hp-lowl0 | blocks.36.mlp.hook_in | 163840 | none |
layer_37 Load this SAE |
transcoder | qwen3-14b/37-transcoder-hp-lowl0 | blocks.37.mlp.hook_in | 163840 | none |
layer_38 Load this SAE |
transcoder | qwen3-14b/38-transcoder-hp-lowl0 | blocks.38.mlp.hook_in | 163840 | none |
layer_39 Load this SAE |
transcoder | qwen3-14b/39-transcoder-hp-lowl0 | blocks.39.mlp.hook_in | 163840 | none |
mwhanna-qwen3-1.7b-transcoders-lowl0
- Huggingface Repo: mwhanna/qwen3-1.7b-transcoders-lowl0
- model: qwen3-1.7b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | qwen3-1.7b/0-transcoder-hp-lowl0 | blocks.0.mlp.hook_in | 163840 | none |
layer_1 Load this SAE |
transcoder | qwen3-1.7b/1-transcoder-hp-lowl0 | blocks.1.mlp.hook_in | 163840 | none |
layer_2 Load this SAE |
transcoder | qwen3-1.7b/2-transcoder-hp-lowl0 | blocks.2.mlp.hook_in | 163840 | none |
layer_3 Load this SAE |
transcoder | qwen3-1.7b/3-transcoder-hp-lowl0 | blocks.3.mlp.hook_in | 163840 | none |
layer_4 Load this SAE |
transcoder | qwen3-1.7b/4-transcoder-hp-lowl0 | blocks.4.mlp.hook_in | 163840 | none |
layer_5 Load this SAE |
transcoder | qwen3-1.7b/5-transcoder-hp-lowl0 | blocks.5.mlp.hook_in | 163840 | none |
layer_6 Load this SAE |
transcoder | qwen3-1.7b/6-transcoder-hp-lowl0 | blocks.6.mlp.hook_in | 163840 | none |
layer_7 Load this SAE |
transcoder | qwen3-1.7b/7-transcoder-hp-lowl0 | blocks.7.mlp.hook_in | 163840 | none |
layer_8 Load this SAE |
transcoder | qwen3-1.7b/8-transcoder-hp-lowl0 | blocks.8.mlp.hook_in | 163840 | none |
layer_9 Load this SAE |
transcoder | qwen3-1.7b/9-transcoder-hp-lowl0 | blocks.9.mlp.hook_in | 163840 | none |
layer_10 Load this SAE |
transcoder | qwen3-1.7b/10-transcoder-hp-lowl0 | blocks.10.mlp.hook_in | 163840 | none |
layer_11 Load this SAE |
transcoder | qwen3-1.7b/11-transcoder-hp-lowl0 | blocks.11.mlp.hook_in | 163840 | none |
layer_12 Load this SAE |
transcoder | qwen3-1.7b/12-transcoder-hp-lowl0 | blocks.12.mlp.hook_in | 163840 | none |
layer_13 Load this SAE |
transcoder | qwen3-1.7b/13-transcoder-hp-lowl0 | blocks.13.mlp.hook_in | 163840 | none |
layer_14 Load this SAE |
transcoder | qwen3-1.7b/14-transcoder-hp-lowl0 | blocks.14.mlp.hook_in | 163840 | none |
layer_15 Load this SAE |
transcoder | qwen3-1.7b/15-transcoder-hp-lowl0 | blocks.15.mlp.hook_in | 163840 | none |
layer_16 Load this SAE |
transcoder | qwen3-1.7b/16-transcoder-hp-lowl0 | blocks.16.mlp.hook_in | 163840 | none |
layer_17 Load this SAE |
transcoder | qwen3-1.7b/17-transcoder-hp-lowl0 | blocks.17.mlp.hook_in | 163840 | none |
layer_18 Load this SAE |
transcoder | qwen3-1.7b/18-transcoder-hp-lowl0 | blocks.18.mlp.hook_in | 163840 | none |
layer_19 Load this SAE |
transcoder | qwen3-1.7b/19-transcoder-hp-lowl0 | blocks.19.mlp.hook_in | 163840 | none |
layer_20 Load this SAE |
transcoder | qwen3-1.7b/20-transcoder-hp-lowl0 | blocks.20.mlp.hook_in | 163840 | none |
layer_21 Load this SAE |
transcoder | qwen3-1.7b/21-transcoder-hp-lowl0 | blocks.21.mlp.hook_in | 163840 | none |
layer_22 Load this SAE |
transcoder | qwen3-1.7b/22-transcoder-hp-lowl0 | blocks.22.mlp.hook_in | 163840 | none |
layer_23 Load this SAE |
transcoder | qwen3-1.7b/23-transcoder-hp-lowl0 | blocks.23.mlp.hook_in | 163840 | none |
layer_24 Load this SAE |
transcoder | qwen3-1.7b/24-transcoder-hp-lowl0 | blocks.24.mlp.hook_in | 163840 | none |
layer_25 Load this SAE |
transcoder | qwen3-1.7b/25-transcoder-hp-lowl0 | blocks.25.mlp.hook_in | 163840 | none |
layer_26 Load this SAE |
transcoder | qwen3-1.7b/26-transcoder-hp-lowl0 | blocks.26.mlp.hook_in | 163840 | none |
layer_27 Load this SAE |
transcoder | qwen3-1.7b/27-transcoder-hp-lowl0 | blocks.27.mlp.hook_in | 163840 | none |
mwhanna-qwen3-0.6b-transcoders-lowl0
- Huggingface Repo: mwhanna/qwen3-0.6b-transcoders-lowl0
- model: qwen3-0.6b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | qwen3-0.6b/0-transcoder-hp-lowl0 | blocks.0.mlp.hook_in | 163840 | none |
layer_1 Load this SAE |
transcoder | qwen3-0.6b/1-transcoder-hp-lowl0 | blocks.1.mlp.hook_in | 163840 | none |
layer_2 Load this SAE |
transcoder | qwen3-0.6b/2-transcoder-hp-lowl0 | blocks.2.mlp.hook_in | 163840 | none |
layer_3 Load this SAE |
transcoder | qwen3-0.6b/3-transcoder-hp-lowl0 | blocks.3.mlp.hook_in | 163840 | none |
layer_4 Load this SAE |
transcoder | qwen3-0.6b/4-transcoder-hp-lowl0 | blocks.4.mlp.hook_in | 163840 | none |
layer_5 Load this SAE |
transcoder | qwen3-0.6b/5-transcoder-hp-lowl0 | blocks.5.mlp.hook_in | 163840 | none |
layer_6 Load this SAE |
transcoder | qwen3-0.6b/6-transcoder-hp-lowl0 | blocks.6.mlp.hook_in | 163840 | none |
layer_7 Load this SAE |
transcoder | qwen3-0.6b/7-transcoder-hp-lowl0 | blocks.7.mlp.hook_in | 163840 | none |
layer_8 Load this SAE |
transcoder | qwen3-0.6b/8-transcoder-hp-lowl0 | blocks.8.mlp.hook_in | 163840 | none |
layer_9 Load this SAE |
transcoder | qwen3-0.6b/9-transcoder-hp-lowl0 | blocks.9.mlp.hook_in | 163840 | none |
layer_10 Load this SAE |
transcoder | qwen3-0.6b/10-transcoder-hp-lowl0 | blocks.10.mlp.hook_in | 163840 | none |
layer_11 Load this SAE |
transcoder | qwen3-0.6b/11-transcoder-hp-lowl0 | blocks.11.mlp.hook_in | 163840 | none |
layer_12 Load this SAE |
transcoder | qwen3-0.6b/12-transcoder-hp-lowl0 | blocks.12.mlp.hook_in | 163840 | none |
layer_13 Load this SAE |
transcoder | qwen3-0.6b/13-transcoder-hp-lowl0 | blocks.13.mlp.hook_in | 163840 | none |
layer_14 Load this SAE |
transcoder | qwen3-0.6b/14-transcoder-hp-lowl0 | blocks.14.mlp.hook_in | 163840 | none |
layer_15 Load this SAE |
transcoder | qwen3-0.6b/15-transcoder-hp-lowl0 | blocks.15.mlp.hook_in | 163840 | none |
layer_16 Load this SAE |
transcoder | qwen3-0.6b/16-transcoder-hp-lowl0 | blocks.16.mlp.hook_in | 163840 | none |
layer_17 Load this SAE |
transcoder | qwen3-0.6b/17-transcoder-hp-lowl0 | blocks.17.mlp.hook_in | 163840 | none |
layer_18 Load this SAE |
transcoder | qwen3-0.6b/18-transcoder-hp-lowl0 | blocks.18.mlp.hook_in | 163840 | none |
layer_19 Load this SAE |
transcoder | qwen3-0.6b/19-transcoder-hp-lowl0 | blocks.19.mlp.hook_in | 163840 | none |
layer_20 Load this SAE |
transcoder | qwen3-0.6b/20-transcoder-hp-lowl0 | blocks.20.mlp.hook_in | 163840 | none |
layer_21 Load this SAE |
transcoder | qwen3-0.6b/21-transcoder-hp-lowl0 | blocks.21.mlp.hook_in | 163840 | none |
layer_22 Load this SAE |
transcoder | qwen3-0.6b/22-transcoder-hp-lowl0 | blocks.22.mlp.hook_in | 163840 | none |
layer_23 Load this SAE |
transcoder | qwen3-0.6b/23-transcoder-hp-lowl0 | blocks.23.mlp.hook_in | 163840 | none |
layer_24 Load this SAE |
transcoder | qwen3-0.6b/24-transcoder-hp-lowl0 | blocks.24.mlp.hook_in | 163840 | none |
layer_25 Load this SAE |
transcoder | qwen3-0.6b/25-transcoder-hp-lowl0 | blocks.25.mlp.hook_in | 163840 | none |
layer_26 Load this SAE |
transcoder | qwen3-0.6b/26-transcoder-hp-lowl0 | blocks.26.mlp.hook_in | 163840 | none |
layer_27 Load this SAE |
transcoder | qwen3-0.6b/27-transcoder-hp-lowl0 | blocks.27.mlp.hook_in | 163840 | none |
mntss-gemma-2-2b-2.5m-clt-as-per-layer
- Huggingface Repo: mntss/clt-gemma-2-2b-2.5M
- model: gemma-2-2b
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_0 Load this SAE |
transcoder | gemma-2-2b/0-clt-hp | blocks.0.hook_resid_mid | 98304 | none |
layer_1 Load this SAE |
transcoder | gemma-2-2b/1-clt-hp | blocks.1.hook_resid_mid | 98304 | none |
layer_2 Load this SAE |
transcoder | gemma-2-2b/2-clt-hp | blocks.2.hook_resid_mid | 98304 | none |
layer_3 Load this SAE |
transcoder | gemma-2-2b/3-clt-hp | blocks.3.hook_resid_mid | 98304 | none |
layer_4 Load this SAE |
transcoder | gemma-2-2b/4-clt-hp | blocks.4.hook_resid_mid | 98304 | none |
layer_5 Load this SAE |
transcoder | gemma-2-2b/5-clt-hp | blocks.5.hook_resid_mid | 98304 | none |
layer_6 Load this SAE |
transcoder | gemma-2-2b/6-clt-hp | blocks.6.hook_resid_mid | 98304 | none |
layer_7 Load this SAE |
transcoder | gemma-2-2b/7-clt-hp | blocks.7.hook_resid_mid | 98304 | none |
layer_8 Load this SAE |
transcoder | gemma-2-2b/8-clt-hp | blocks.8.hook_resid_mid | 98304 | none |
layer_9 Load this SAE |
transcoder | gemma-2-2b/9-clt-hp | blocks.9.hook_resid_mid | 98304 | none |
layer_10 Load this SAE |
transcoder | gemma-2-2b/10-clt-hp | blocks.10.hook_resid_mid | 98304 | none |
layer_11 Load this SAE |
transcoder | gemma-2-2b/11-clt-hp | blocks.11.hook_resid_mid | 98304 | none |
layer_12 Load this SAE |
transcoder | gemma-2-2b/12-clt-hp | blocks.12.hook_resid_mid | 98304 | none |
layer_13 Load this SAE |
transcoder | gemma-2-2b/13-clt-hp | blocks.13.hook_resid_mid | 98304 | none |
layer_14 Load this SAE |
transcoder | gemma-2-2b/14-clt-hp | blocks.14.hook_resid_mid | 98304 | none |
layer_15 Load this SAE |
transcoder | gemma-2-2b/15-clt-hp | blocks.15.hook_resid_mid | 98304 | none |
layer_16 Load this SAE |
transcoder | gemma-2-2b/16-clt-hp | blocks.16.hook_resid_mid | 98304 | none |
layer_17 Load this SAE |
transcoder | gemma-2-2b/17-clt-hp | blocks.17.hook_resid_mid | 98304 | none |
layer_18 Load this SAE |
transcoder | gemma-2-2b/18-clt-hp | blocks.18.hook_resid_mid | 98304 | none |
layer_19 Load this SAE |
transcoder | gemma-2-2b/19-clt-hp | blocks.19.hook_resid_mid | 98304 | none |
layer_20 Load this SAE |
transcoder | gemma-2-2b/20-clt-hp | blocks.20.hook_resid_mid | 98304 | none |
layer_21 Load this SAE |
transcoder | gemma-2-2b/21-clt-hp | blocks.21.hook_resid_mid | 98304 | none |
layer_22 Load this SAE |
transcoder | gemma-2-2b/22-clt-hp | blocks.22.hook_resid_mid | 98304 | none |
layer_23 Load this SAE |
transcoder | gemma-2-2b/23-clt-hp | blocks.23.hook_resid_mid | 98304 | none |
layer_24 Load this SAE |
transcoder | gemma-2-2b/24-clt-hp | blocks.24.hook_resid_mid | 98304 | none |
layer_25 Load this SAE |
transcoder | gemma-2-2b/25-clt-hp | blocks.25.hook_resid_mid | 98304 | none |
llama-3.1-8b-instruct-andyrdt
- Huggingface Repo: andyrdt/saes-llama-3.1-8b-instruct
- model: meta-llama/Llama-3.1-8B-Instruct
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
resid_post_layer_3_trainer_1 Load this SAE |
standard | llama3.1-8b-it/3-resid-post-aa | blocks.3.hook_resid_post | 131072 | none |
resid_post_layer_7_trainer_1 Load this SAE |
standard | llama3.1-8b-it/7-resid-post-aa | blocks.7.hook_resid_post | 131072 | none |
resid_post_layer_11_trainer_1 Load this SAE |
standard | llama3.1-8b-it/11-resid-post-aa | blocks.11.hook_resid_post | 131072 | none |
resid_post_layer_15_trainer_1 Load this SAE |
standard | llama3.1-8b-it/15-resid-post-aa | blocks.15.hook_resid_post | 131072 | none |
resid_post_layer_19_trainer_1 Load this SAE |
standard | llama3.1-8b-it/19-resid-post-aa | blocks.19.hook_resid_post | 131072 | none |
resid_post_layer_23_trainer_1 Load this SAE |
standard | llama3.1-8b-it/23-resid-post-aa | blocks.23.hook_resid_post | 131072 | none |
resid_post_layer_27_trainer_1 Load this SAE |
standard | llama3.1-8b-it/27-resid-post-aa | blocks.27.hook_resid_post | 131072 | none |
qwen2.5-7b-instruct-andyrdt
- Huggingface Repo: andyrdt/saes-qwen2.5-7b-instruct
- model: Qwen/Qwen2.5-7B-Instruct
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
resid_post_layer_3_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/3-resid-post-aa | blocks.3.hook_resid_post | 131072 | none |
resid_post_layer_7_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/7-resid-post-aa | blocks.7.hook_resid_post | 131072 | none |
resid_post_layer_11_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/11-resid-post-aa | blocks.11.hook_resid_post | 131072 | none |
resid_post_layer_15_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/15-resid-post-aa | blocks.15.hook_resid_post | 131072 | none |
resid_post_layer_19_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/19-resid-post-aa | blocks.19.hook_resid_post | 131072 | none |
resid_post_layer_23_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/23-resid-post-aa | blocks.23.hook_resid_post | 131072 | none |
resid_post_layer_27_trainer_1 Load this SAE |
standard | qwen2.5-7b-it/27-resid-post-aa | blocks.27.hook_resid_post | 131072 | none |
goodfire-llama-3.3-70b-instruct
- Huggingface Repo: Goodfire/Llama-3.3-70B-Instruct-SAE-l50
- model: meta-llama/Llama-3.3-70B-Instruct
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_50 Load this SAE |
standard | blocks.50.hook_resid_post | 65536 | none |
goodfire-llama-3.1-8b-instruct
- Huggingface Repo: Goodfire/Llama-3.1-8B-Instruct-SAE-l19
- model: meta-llama/Llama-3.1-8B-Instruct
| id | architecture | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|---|
layer_19 Load this SAE |
standard | blocks.19.hook_resid_post | 65536 | none |
×