Skip to content

pythia-70m-deduped

This page lists all pretrained SAEs available for pythia-70m-deduped.

pythia-70m-deduped-att-sm

  • Huggingface Repo: ctigges/pythia-70m-deduped__att-sm_processed
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.0.hook_attn_out
Load this SAE
pythia-70m-deduped/0-att-sm blocks.0.hook_attn_out 32768 none
blocks.1.hook_attn_out
Load this SAE
pythia-70m-deduped/1-att-sm blocks.1.hook_attn_out 32768 none
blocks.2.hook_attn_out
Load this SAE
pythia-70m-deduped/2-att-sm blocks.2.hook_attn_out 32768 none
blocks.3.hook_attn_out
Load this SAE
pythia-70m-deduped/3-att-sm blocks.3.hook_attn_out 32768 none
blocks.4.hook_attn_out
Load this SAE
pythia-70m-deduped/4-att-sm blocks.4.hook_attn_out 32768 none
blocks.5.hook_attn_out
Load this SAE
pythia-70m-deduped/5-att-sm blocks.5.hook_attn_out 32768 none

pythia-70m-deduped-mlp-sm

  • Huggingface Repo: ctigges/pythia-70m-deduped__mlp-sm_processed
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.0.hook_mlp_out
Load this SAE
pythia-70m-deduped/0-mlp-sm blocks.0.hook_mlp_out 32768 none
blocks.1.hook_mlp_out
Load this SAE
pythia-70m-deduped/1-mlp-sm blocks.1.hook_mlp_out 32768 none
blocks.2.hook_mlp_out
Load this SAE
pythia-70m-deduped/2-mlp-sm blocks.2.hook_mlp_out 32768 none
blocks.3.hook_mlp_out
Load this SAE
pythia-70m-deduped/3-mlp-sm blocks.3.hook_mlp_out 32768 none
blocks.4.hook_mlp_out
Load this SAE
pythia-70m-deduped/4-mlp-sm blocks.4.hook_mlp_out 32768 none
blocks.5.hook_mlp_out
Load this SAE
pythia-70m-deduped/5-mlp-sm blocks.5.hook_mlp_out 32768 none

pythia-70m-deduped-res-sm

  • Huggingface Repo: ctigges/pythia-70m-deduped__res-sm_processed
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.0.hook_resid_pre
Load this SAE
pythia-70m-deduped/e-att-sm blocks.0.hook_resid_pre 32768 none
blocks.0.hook_resid_post
Load this SAE
pythia-70m-deduped/0-res-sm blocks.0.hook_resid_post 32768 none
blocks.1.hook_resid_post
Load this SAE
pythia-70m-deduped/1-res-sm blocks.1.hook_resid_post 32768 none
blocks.2.hook_resid_post
Load this SAE
pythia-70m-deduped/2-res-sm blocks.2.hook_resid_post 32768 none
blocks.3.hook_resid_post
Load this SAE
pythia-70m-deduped/3-res-sm blocks.3.hook_resid_post 32768 none
blocks.4.hook_resid_post
Load this SAE
pythia-70m-deduped/4-res-sm blocks.4.hook_resid_post 32768 none
blocks.5.hook_resid_post
Load this SAE
pythia-70m-deduped/5-res-sm blocks.5.hook_resid_post 32768 none

sae_bench_pythia70m_sweep_gated_ctx128_0730

  • Huggingface Repo: canrager/lm_sae
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.3.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_0_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_1_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_10_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_12_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_13_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_14_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_15_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_16_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_17_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_18_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_19_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_2_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_3_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_4_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_5_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_6_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_7_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_8_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_9_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_11_step_final blocks.3.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_10_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_11_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_14_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_15_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_18_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_19_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_2_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_3_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_6_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_7_step_final blocks.4.hook_resid_post 16384 none

sae_bench_pythia70m_sweep_panneal_ctx128_0730

  • Huggingface Repo: canrager/lm_sae
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.3.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_16_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_17_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_18_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_19_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_2_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_20
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_20_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_21
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_21_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_22
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_22_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_15_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_23
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_23_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_25
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_25_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_26
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_26_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_27
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_27_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_3_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_4_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_5_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_6_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_7_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_24
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_24_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_14_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_13_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_12_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_0_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_1_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_10_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_11_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_8_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_9_step_final blocks.3.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_18_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_19_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_15_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_14_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_11_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_10_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_2_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_20
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_20_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_22
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_22_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_7_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_6_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_27
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_27_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_26
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_26_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_25
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_25_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_3_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_24
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_24_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_21
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_21_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_23
Load this SAE
pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_23_step_final blocks.4.hook_resid_post 16384 none

sae_bench_pythia70m_sweep_standard_ctx128_0712

  • Huggingface Repo: canrager/lm_sae
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.3.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_10_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_11_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_8_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_7_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_6_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_5_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_4_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_3_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_2_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_19_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_18_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_17_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_16_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_15_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_14_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_0_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_1_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_13_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_12_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_9_step_final blocks.3.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_11_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_10_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_14_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_18_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_2_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_20
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_20_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_21
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_21_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_22
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_22_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_3_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_6_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_7_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_23
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_23_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_15_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_19_step_final blocks.4.hook_resid_post 16384 none

sae_bench_pythia70m_sweep_topk_ctx128_0730

  • Huggingface Repo: canrager/lm_sae
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.3.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_0_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_1_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_10_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_11_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_12_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_13_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_14_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_22
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_22_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_19_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_2_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_20
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_20_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_21
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_21_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_16_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_23
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_23_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_18_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_3_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_5_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_6_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_7_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_8_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_9_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_15_step_final blocks.3.hook_resid_post 16384 none
blocks.3.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_4_step_final blocks.3.hook_resid_post 4096 none
blocks.3.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_17_step_final blocks.3.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_13
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_14
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_14_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_15
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_15_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_16
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_17
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_18
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_18_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_19
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_19_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_2
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_2_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_20
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_20_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_21
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_21_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_22
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_22_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_23
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_23_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_3
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_3_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_4
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_5
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_6
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_6_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_7
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_7_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_12
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_11
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_11_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_10
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_10_step_final blocks.4.hook_resid_post 16384 none
blocks.4.hook_resid_post__trainer_1
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_0
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_9
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4096 none
blocks.4.hook_resid_post__trainer_8
Load this SAE
pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4096 none
×