Skip to content

gemma-2-2b

This page lists all pretrained SAEs available for gemma-2-2b.

gemma-2-2b-res-matryoshka-dc

  • Huggingface Repo: chanind/gemma-2-2b-batch-topk-matryoshka-saes-w-32k-l0-40
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.0.hook_resid_post
Load this SAE
blocks.0.hook_resid_post 32768 none
blocks.1.hook_resid_post
Load this SAE
blocks.1.hook_resid_post 32768 none
blocks.2.hook_resid_post
Load this SAE
blocks.2.hook_resid_post 32768 none
blocks.3.hook_resid_post
Load this SAE
blocks.3.hook_resid_post 32768 none
blocks.4.hook_resid_post
Load this SAE
blocks.4.hook_resid_post 32768 none
blocks.5.hook_resid_post
Load this SAE
blocks.5.hook_resid_post 32768 none
blocks.6.hook_resid_post
Load this SAE
blocks.6.hook_resid_post 32768 none
blocks.7.hook_resid_post
Load this SAE
blocks.7.hook_resid_post 32768 none
blocks.8.hook_resid_post
Load this SAE
blocks.8.hook_resid_post 32768 none
blocks.9.hook_resid_post
Load this SAE
blocks.9.hook_resid_post 32768 none
blocks.10.hook_resid_post
Load this SAE
blocks.10.hook_resid_post 32768 none
blocks.11.hook_resid_post
Load this SAE
blocks.11.hook_resid_post 32768 none
blocks.12.hook_resid_post
Load this SAE
gemma-2-2b/12-res-matryoshka-dc blocks.12.hook_resid_post 32768 none
blocks.13.hook_resid_post
Load this SAE
gemma-2-2b/13-res-matryoshka-dc blocks.13.hook_resid_post 32768 none
blocks.14.hook_resid_post
Load this SAE
gemma-2-2b/14-res-matryoshka-dc blocks.14.hook_resid_post 32768 none
blocks.15.hook_resid_post
Load this SAE
gemma-2-2b/15-res-matryoshka-dc blocks.15.hook_resid_post 32768 none
blocks.16.hook_resid_post
Load this SAE
gemma-2-2b/16-res-matryoshka-dc blocks.16.hook_resid_post 32768 none
blocks.17.hook_resid_post
Load this SAE
gemma-2-2b/17-res-matryoshka-dc blocks.17.hook_resid_post 32768 none
blocks.18.hook_resid_post
Load this SAE
gemma-2-2b/18-res-matryoshka-dc blocks.18.hook_resid_post 32768 none
blocks.19.hook_resid_post
Load this SAE
gemma-2-2b/19-res-matryoshka-dc blocks.19.hook_resid_post 32768 none
blocks.20.hook_resid_post
Load this SAE
gemma-2-2b/20-res-matryoshka-dc blocks.20.hook_resid_post 32768 none
blocks.21.hook_resid_post
Load this SAE
gemma-2-2b/21-res-matryoshka-dc blocks.21.hook_resid_post 32768 none
blocks.22.hook_resid_post
Load this SAE
gemma-2-2b/22-res-matryoshka-dc blocks.22.hook_resid_post 32768 none
blocks.23.hook_resid_post
Load this SAE
gemma-2-2b/23-res-matryoshka-dc blocks.23.hook_resid_post 32768 none
blocks.24.hook_resid_post
Load this SAE
gemma-2-2b/24-res-matryoshka-dc blocks.24.hook_resid_post 32768 none

gemma-2-2b-res-snap-matryoshka-dc

  • Huggingface Repo: chanind/gemma-2-2b-batch-topk-matryoshka-saes-w-32k-l0-40
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.0.hook_resid_post
Load this SAE
blocks.0.hook_resid_post 32768 none
blocks.1.hook_resid_post
Load this SAE
blocks.1.hook_resid_post 32768 none
blocks.2.hook_resid_post
Load this SAE
blocks.2.hook_resid_post 32768 none
blocks.3.hook_resid_post
Load this SAE
blocks.3.hook_resid_post 32768 none
blocks.4.hook_resid_post
Load this SAE
blocks.4.hook_resid_post 32768 none
blocks.5.hook_resid_post
Load this SAE
blocks.5.hook_resid_post 32768 none
blocks.6.hook_resid_post
Load this SAE
blocks.6.hook_resid_post 32768 none
blocks.7.hook_resid_post
Load this SAE
blocks.7.hook_resid_post 32768 none
blocks.8.hook_resid_post
Load this SAE
blocks.8.hook_resid_post 32768 none
blocks.9.hook_resid_post
Load this SAE
blocks.9.hook_resid_post 32768 none
blocks.10.hook_resid_post
Load this SAE
blocks.10.hook_resid_post 32768 none
blocks.11.hook_resid_post
Load this SAE
blocks.11.hook_resid_post 32768 none
blocks.12.hook_resid_post
Load this SAE
blocks.12.hook_resid_post 32768 none
blocks.13.hook_resid_post
Load this SAE
blocks.13.hook_resid_post 32768 none
blocks.14.hook_resid_post
Load this SAE
blocks.14.hook_resid_post 32768 none
blocks.15.hook_resid_post
Load this SAE
blocks.15.hook_resid_post 32768 none
blocks.16.hook_resid_post
Load this SAE
blocks.16.hook_resid_post 32768 none
blocks.17.hook_resid_post
Load this SAE
blocks.17.hook_resid_post 32768 none
blocks.18.hook_resid_post
Load this SAE
blocks.18.hook_resid_post 32768 none
blocks.19.hook_resid_post
Load this SAE
blocks.19.hook_resid_post 32768 none
blocks.20.hook_resid_post
Load this SAE
blocks.20.hook_resid_post 32768 none
blocks.21.hook_resid_post
Load this SAE
blocks.21.hook_resid_post 32768 none
blocks.22.hook_resid_post
Load this SAE
blocks.22.hook_resid_post 32768 none
blocks.23.hook_resid_post
Load this SAE
blocks.23.hook_resid_post 32768 none
blocks.24.hook_resid_post
Load this SAE
blocks.24.hook_resid_post 32768 none

gemma-scope-2b-pt-att

  • Huggingface Repo: google/gemma-scope-2b-pt-att
id neuronpedia hook_name d_sae normalize_activations
layer_0/width_16k/average_l0_104
Load this SAE
blocks.0.attn.hook_z 16384 none
layer_0/width_16k/average_l0_12
Load this SAE
blocks.0.attn.hook_z 16384 none
layer_0/width_16k/average_l0_18
Load this SAE
blocks.0.attn.hook_z 16384 none
layer_0/width_16k/average_l0_30
Load this SAE
blocks.0.attn.hook_z 16384 none
layer_0/width_16k/average_l0_57
Load this SAE
blocks.0.attn.hook_z 16384 none
layer_1/width_16k/average_l0_146
Load this SAE
blocks.1.attn.hook_z 16384 none
layer_1/width_16k/average_l0_20
Load this SAE
blocks.1.attn.hook_z 16384 none
layer_1/width_16k/average_l0_251
Load this SAE
blocks.1.attn.hook_z 16384 none
layer_1/width_16k/average_l0_40
Load this SAE
blocks.1.attn.hook_z 16384 none
layer_1/width_16k/average_l0_79
Load this SAE
blocks.1.attn.hook_z 16384 none
layer_2/width_16k/average_l0_174
Load this SAE
blocks.2.attn.hook_z 16384 none
layer_2/width_16k/average_l0_19
Load this SAE
blocks.2.attn.hook_z 16384 none
layer_2/width_16k/average_l0_297
Load this SAE
blocks.2.attn.hook_z 16384 none
layer_2/width_16k/average_l0_43
Load this SAE
blocks.2.attn.hook_z 16384 none
layer_2/width_16k/average_l0_93
Load this SAE
blocks.2.attn.hook_z 16384 none
layer_3/width_16k/average_l0_117
Load this SAE
blocks.3.attn.hook_z 16384 none
layer_3/width_16k/average_l0_219
Load this SAE
blocks.3.attn.hook_z 16384 none
layer_3/width_16k/average_l0_24
Load this SAE
blocks.3.attn.hook_z 16384 none
layer_3/width_16k/average_l0_386
Load this SAE
blocks.3.attn.hook_z 16384 none
layer_3/width_16k/average_l0_55
Load this SAE
blocks.3.attn.hook_z 16384 none
layer_4/width_16k/average_l0_116
Load this SAE
blocks.4.attn.hook_z 16384 none
layer_4/width_16k/average_l0_249
Load this SAE
blocks.4.attn.hook_z 16384 none
layer_4/width_16k/average_l0_26
Load this SAE
blocks.4.attn.hook_z 16384 none
layer_4/width_16k/average_l0_454
Load this SAE
blocks.4.attn.hook_z 16384 none
layer_4/width_16k/average_l0_53
Load this SAE
blocks.4.attn.hook_z 16384 none
layer_5/width_16k/average_l0_135
Load this SAE
blocks.5.attn.hook_z 16384 none
layer_5/width_16k/average_l0_268
Load this SAE
blocks.5.attn.hook_z 16384 none
layer_5/width_16k/average_l0_30
Load this SAE
blocks.5.attn.hook_z 16384 none
layer_5/width_16k/average_l0_449
Load this SAE
blocks.5.attn.hook_z 16384 none
layer_5/width_16k/average_l0_59
Load this SAE
blocks.5.attn.hook_z 16384 none
layer_6/width_16k/average_l0_143
Load this SAE
blocks.6.attn.hook_z 16384 none
layer_6/width_16k/average_l0_292
Load this SAE
blocks.6.attn.hook_z 16384 none
layer_6/width_16k/average_l0_30
Load this SAE
blocks.6.attn.hook_z 16384 none
layer_6/width_16k/average_l0_479
Load this SAE
blocks.6.attn.hook_z 16384 none
layer_6/width_16k/average_l0_61
Load this SAE
blocks.6.attn.hook_z 16384 none
layer_7/width_16k/average_l0_184
Load this SAE
blocks.7.attn.hook_z 16384 none
layer_7/width_16k/average_l0_331
Load this SAE
blocks.7.attn.hook_z 16384 none
layer_7/width_16k/average_l0_46
Load this SAE
blocks.7.attn.hook_z 16384 none
layer_7/width_16k/average_l0_537
Load this SAE
blocks.7.attn.hook_z 16384 none
layer_7/width_16k/average_l0_99
Load this SAE
blocks.7.attn.hook_z 16384 none
layer_8/width_16k/average_l0_129
Load this SAE
blocks.8.attn.hook_z 16384 none
layer_8/width_16k/average_l0_282
Load this SAE
blocks.8.attn.hook_z 16384 none
layer_8/width_16k/average_l0_32
Load this SAE
blocks.8.attn.hook_z 16384 none
layer_8/width_16k/average_l0_482
Load this SAE
blocks.8.attn.hook_z 16384 none
layer_8/width_16k/average_l0_64
Load this SAE
blocks.8.attn.hook_z 16384 none
layer_9/width_16k/average_l0_127
Load this SAE
blocks.9.attn.hook_z 16384 none
layer_9/width_16k/average_l0_270
Load this SAE
blocks.9.attn.hook_z 16384 none
layer_9/width_16k/average_l0_34
Load this SAE
blocks.9.attn.hook_z 16384 none
layer_9/width_16k/average_l0_499
Load this SAE
blocks.9.attn.hook_z 16384 none
layer_9/width_16k/average_l0_64
Load this SAE
blocks.9.attn.hook_z 16384 none
layer_10/width_16k/average_l0_148
Load this SAE
blocks.10.attn.hook_z 16384 none
layer_10/width_16k/average_l0_307
Load this SAE
blocks.10.attn.hook_z 16384 none
layer_10/width_16k/average_l0_36
Load this SAE
blocks.10.attn.hook_z 16384 none
layer_10/width_16k/average_l0_541
Load this SAE
blocks.10.attn.hook_z 16384 none
layer_10/width_16k/average_l0_70
Load this SAE
blocks.10.attn.hook_z 16384 none
layer_11/width_16k/average_l0_170
Load this SAE
blocks.11.attn.hook_z 16384 none
layer_11/width_16k/average_l0_350
Load this SAE
blocks.11.attn.hook_z 16384 none
layer_11/width_16k/average_l0_41
Load this SAE
blocks.11.attn.hook_z 16384 none
layer_11/width_16k/average_l0_593
Load this SAE
blocks.11.attn.hook_z 16384 none
layer_11/width_16k/average_l0_80
Load this SAE
blocks.11.attn.hook_z 16384 none
layer_12/width_16k/average_l0_184
Load this SAE
blocks.12.attn.hook_z 16384 none
layer_12/width_16k/average_l0_328
Load this SAE
blocks.12.attn.hook_z 16384 none
layer_12/width_16k/average_l0_41
Load this SAE
blocks.12.attn.hook_z 16384 none
layer_12/width_16k/average_l0_514
Load this SAE
blocks.12.attn.hook_z 16384 none
layer_12/width_16k/average_l0_85
Load this SAE
blocks.12.attn.hook_z 16384 none
layer_13/width_16k/average_l0_203
Load this SAE
blocks.13.attn.hook_z 16384 none
layer_13/width_16k/average_l0_372
Load this SAE
blocks.13.attn.hook_z 16384 none
layer_13/width_16k/average_l0_43
Load this SAE
blocks.13.attn.hook_z 16384 none
layer_13/width_16k/average_l0_570
Load this SAE
blocks.13.attn.hook_z 16384 none
layer_13/width_16k/average_l0_92
Load this SAE
blocks.13.attn.hook_z 16384 none
layer_14/width_16k/average_l0_161
Load this SAE
blocks.14.attn.hook_z 16384 none
layer_14/width_16k/average_l0_298
Load this SAE
blocks.14.attn.hook_z 16384 none
layer_14/width_16k/average_l0_37
Load this SAE
blocks.14.attn.hook_z 16384 none
layer_14/width_16k/average_l0_468
Load this SAE
blocks.14.attn.hook_z 16384 none
layer_14/width_16k/average_l0_71
Load this SAE
blocks.14.attn.hook_z 16384 none
layer_15/width_16k/average_l0_195
Load this SAE
blocks.15.attn.hook_z 16384 none
layer_15/width_16k/average_l0_342
Load this SAE
blocks.15.attn.hook_z 16384 none
layer_15/width_16k/average_l0_44
Load this SAE
blocks.15.attn.hook_z 16384 none
layer_15/width_16k/average_l0_535
Load this SAE
blocks.15.attn.hook_z 16384 none
layer_15/width_16k/average_l0_98
Load this SAE
blocks.15.attn.hook_z 16384 none
layer_16/width_16k/average_l0_144
Load this SAE
blocks.16.attn.hook_z 16384 none
layer_16/width_16k/average_l0_293
Load this SAE
blocks.16.attn.hook_z 16384 none
layer_16/width_16k/average_l0_37
Load this SAE
blocks.16.attn.hook_z 16384 none
layer_16/width_16k/average_l0_527
Load this SAE
blocks.16.attn.hook_z 16384 none
layer_16/width_16k/average_l0_71
Load this SAE
blocks.16.attn.hook_z 16384 none
layer_17/width_16k/average_l0_176
Load this SAE
blocks.17.attn.hook_z 16384 none
layer_17/width_16k/average_l0_316
Load this SAE
blocks.17.attn.hook_z 16384 none
layer_17/width_16k/average_l0_38
Load this SAE
blocks.17.attn.hook_z 16384 none
layer_17/width_16k/average_l0_509
Load this SAE
blocks.17.attn.hook_z 16384 none
layer_17/width_16k/average_l0_79
Load this SAE
blocks.17.attn.hook_z 16384 none
layer_18/width_16k/average_l0_144
Load this SAE
blocks.18.attn.hook_z 16384 none
layer_18/width_16k/average_l0_292
Load this SAE
blocks.18.attn.hook_z 16384 none
layer_18/width_16k/average_l0_34
Load this SAE
blocks.18.attn.hook_z 16384 none
layer_18/width_16k/average_l0_491
Load this SAE
blocks.18.attn.hook_z 16384 none
layer_18/width_16k/average_l0_72
Load this SAE
blocks.18.attn.hook_z 16384 none
layer_19/width_16k/average_l0_122
Load this SAE
blocks.19.attn.hook_z 16384 none
layer_19/width_16k/average_l0_249
Load this SAE
blocks.19.attn.hook_z 16384 none
layer_19/width_16k/average_l0_28
Load this SAE
blocks.19.attn.hook_z 16384 none
layer_19/width_16k/average_l0_423
Load this SAE
blocks.19.attn.hook_z 16384 none
layer_19/width_16k/average_l0_56
Load this SAE
blocks.19.attn.hook_z 16384 none
layer_20/width_16k/average_l0_141
Load this SAE
blocks.20.attn.hook_z 16384 none
layer_20/width_16k/average_l0_274
Load this SAE
blocks.20.attn.hook_z 16384 none
layer_20/width_16k/average_l0_31
Load this SAE
blocks.20.attn.hook_z 16384 none
layer_20/width_16k/average_l0_446
Load this SAE
blocks.20.attn.hook_z 16384 none
layer_20/width_16k/average_l0_62
Load this SAE
blocks.20.attn.hook_z 16384 none
layer_21/width_16k/average_l0_142
Load this SAE
blocks.21.attn.hook_z 16384 none
layer_21/width_16k/average_l0_301
Load this SAE
blocks.21.attn.hook_z 16384 none
layer_21/width_16k/average_l0_32
Load this SAE
blocks.21.attn.hook_z 16384 none
layer_21/width_16k/average_l0_505
Load this SAE
blocks.21.attn.hook_z 16384 none
layer_21/width_16k/average_l0_65
Load this SAE
blocks.21.attn.hook_z 16384 none
layer_22/width_16k/average_l0_106
Load this SAE
blocks.22.attn.hook_z 16384 none
layer_22/width_16k/average_l0_215
Load this SAE
blocks.22.attn.hook_z 16384 none
layer_22/width_16k/average_l0_22
Load this SAE
blocks.22.attn.hook_z 16384 none
layer_22/width_16k/average_l0_373
Load this SAE
blocks.22.attn.hook_z 16384 none
layer_22/width_16k/average_l0_47
Load this SAE
blocks.22.attn.hook_z 16384 none
layer_23/width_16k/average_l0_161
Load this SAE
blocks.23.attn.hook_z 16384 none
layer_23/width_16k/average_l0_30
Load this SAE
blocks.23.attn.hook_z 16384 none
layer_23/width_16k/average_l0_300
Load this SAE
blocks.23.attn.hook_z 16384 none
layer_23/width_16k/average_l0_474
Load this SAE
blocks.23.attn.hook_z 16384 none
layer_23/width_16k/average_l0_73
Load this SAE
blocks.23.attn.hook_z 16384 none
layer_24/width_16k/average_l0_212
Load this SAE
blocks.24.attn.hook_z 16384 none
layer_24/width_16k/average_l0_372
Load this SAE
blocks.24.attn.hook_z 16384 none
layer_24/width_16k/average_l0_39
Load this SAE
blocks.24.attn.hook_z 16384 none
layer_24/width_16k/average_l0_558
Load this SAE
blocks.24.attn.hook_z 16384 none
layer_24/width_16k/average_l0_96
Load this SAE
blocks.24.attn.hook_z 16384 none
layer_25/width_16k/average_l0_177
Load this SAE
blocks.25.attn.hook_z 16384 none
layer_25/width_16k/average_l0_313
Load this SAE
blocks.25.attn.hook_z 16384 none
layer_25/width_16k/average_l0_35
Load this SAE
blocks.25.attn.hook_z 16384 none
layer_25/width_16k/average_l0_492
Load this SAE
blocks.25.attn.hook_z 16384 none
layer_25/width_16k/average_l0_77
Load this SAE
blocks.25.attn.hook_z 16384 none
layer_0/width_65k/average_l0_10
Load this SAE
blocks.0.attn.hook_z 65536 none
layer_0/width_65k/average_l0_16
Load this SAE
blocks.0.attn.hook_z 65536 none
layer_0/width_65k/average_l0_24
Load this SAE
blocks.0.attn.hook_z 65536 none
layer_0/width_65k/average_l0_43
Load this SAE
blocks.0.attn.hook_z 65536 none
layer_0/width_65k/average_l0_75
Load this SAE
blocks.0.attn.hook_z 65536 none
layer_1/width_65k/average_l0_15
Load this SAE
blocks.1.attn.hook_z 65536 none
layer_1/width_65k/average_l0_181
Load this SAE
blocks.1.attn.hook_z 65536 none
layer_1/width_65k/average_l0_28
Load this SAE
blocks.1.attn.hook_z 65536 none
layer_1/width_65k/average_l0_55
Load this SAE
blocks.1.attn.hook_z 65536 none
layer_1/width_65k/average_l0_98
Load this SAE
blocks.1.attn.hook_z 65536 none
layer_2/width_65k/average_l0_125
Load this SAE
blocks.2.attn.hook_z 65536 none
layer_2/width_65k/average_l0_14
Load this SAE
blocks.2.attn.hook_z 65536 none
layer_2/width_65k/average_l0_228
Load this SAE
blocks.2.attn.hook_z 65536 none
layer_2/width_65k/average_l0_28
Load this SAE
blocks.2.attn.hook_z 65536 none
layer_2/width_65k/average_l0_59
Load this SAE
blocks.2.attn.hook_z 65536 none
layer_3/width_65k/average_l0_174
Load this SAE
blocks.3.attn.hook_z 65536 none
layer_3/width_65k/average_l0_19
Load this SAE
blocks.3.attn.hook_z 65536 none
layer_3/width_65k/average_l0_320
Load this SAE
blocks.3.attn.hook_z 65536 none
layer_3/width_65k/average_l0_39
Load this SAE
blocks.3.attn.hook_z 65536 none
layer_3/width_65k/average_l0_83
Load this SAE
blocks.3.attn.hook_z 65536 none
layer_4/width_65k/average_l0_188
Load this SAE
blocks.4.attn.hook_z 65536 none
layer_4/width_65k/average_l0_22
Load this SAE
blocks.4.attn.hook_z 65536 none
layer_4/width_65k/average_l0_382
Load this SAE
blocks.4.attn.hook_z 65536 none
layer_4/width_65k/average_l0_43
Load this SAE
blocks.4.attn.hook_z 65536 none
layer_4/width_65k/average_l0_87
Load this SAE
blocks.4.attn.hook_z 65536 none
layer_5/width_65k/average_l0_227
Load this SAE
blocks.5.attn.hook_z 65536 none
layer_5/width_65k/average_l0_28
Load this SAE
blocks.5.attn.hook_z 65536 none
layer_5/width_65k/average_l0_400
Load this SAE
blocks.5.attn.hook_z 65536 none
layer_5/width_65k/average_l0_51
Load this SAE
blocks.5.attn.hook_z 65536 none
layer_5/width_65k/average_l0_99
Load this SAE
blocks.5.attn.hook_z 65536 none
layer_6/width_65k/average_l0_112
Load this SAE
blocks.6.attn.hook_z 65536 none
layer_6/width_65k/average_l0_261
Load this SAE
blocks.6.attn.hook_z 65536 none
layer_6/width_65k/average_l0_30
Load this SAE
blocks.6.attn.hook_z 65536 none
layer_6/width_65k/average_l0_449
Load this SAE
blocks.6.attn.hook_z 65536 none
layer_6/width_65k/average_l0_55
Load this SAE
blocks.6.attn.hook_z 65536 none
layer_7/width_65k/average_l0_176
Load this SAE
blocks.7.attn.hook_z 65536 none
layer_7/width_65k/average_l0_311
Load this SAE
blocks.7.attn.hook_z 65536 none
layer_7/width_65k/average_l0_519
Load this SAE
blocks.7.attn.hook_z 65536 none
layer_7/width_65k/average_l0_52
Load this SAE
blocks.7.attn.hook_z 65536 none
layer_7/width_65k/average_l0_96
Load this SAE
blocks.7.attn.hook_z 65536 none
layer_8/width_65k/average_l0_112
Load this SAE
blocks.8.attn.hook_z 65536 none
layer_8/width_65k/average_l0_246
Load this SAE
blocks.8.attn.hook_z 65536 none
layer_8/width_65k/average_l0_35
Load this SAE
blocks.8.attn.hook_z 65536 none
layer_8/width_65k/average_l0_454
Load this SAE
blocks.8.attn.hook_z 65536 none
layer_8/width_65k/average_l0_56
Load this SAE
blocks.8.attn.hook_z 65536 none
layer_9/width_65k/average_l0_107
Load this SAE
blocks.9.attn.hook_z 65536 none
layer_9/width_65k/average_l0_231
Load this SAE
blocks.9.attn.hook_z 65536 none
layer_9/width_65k/average_l0_31
Load this SAE
blocks.9.attn.hook_z 65536 none
layer_9/width_65k/average_l0_454
Load this SAE
blocks.9.attn.hook_z 65536 none
layer_9/width_65k/average_l0_57
Load this SAE
blocks.9.attn.hook_z 65536 none
layer_10/width_65k/average_l0_134
Load this SAE
blocks.10.attn.hook_z 65536 none
layer_10/width_65k/average_l0_292
Load this SAE
blocks.10.attn.hook_z 65536 none
layer_10/width_65k/average_l0_35
Load this SAE
blocks.10.attn.hook_z 65536 none
layer_10/width_65k/average_l0_521
Load this SAE
blocks.10.attn.hook_z 65536 none
layer_10/width_65k/average_l0_67
Load this SAE
blocks.10.attn.hook_z 65536 none
layer_11/width_65k/average_l0_154
Load this SAE
blocks.11.attn.hook_z 65536 none
layer_11/width_65k/average_l0_330
Load this SAE
blocks.11.attn.hook_z 65536 none
layer_11/width_65k/average_l0_41
Load this SAE
blocks.11.attn.hook_z 65536 none
layer_11/width_65k/average_l0_576
Load this SAE
blocks.11.attn.hook_z 65536 none
layer_11/width_65k/average_l0_75
Load this SAE
blocks.11.attn.hook_z 65536 none
layer_12/width_65k/average_l0_172
Load this SAE
blocks.12.attn.hook_z 65536 none
layer_12/width_65k/average_l0_320
Load this SAE
blocks.12.attn.hook_z 65536 none
layer_12/width_65k/average_l0_39
Load this SAE
blocks.12.attn.hook_z 65536 none
layer_12/width_65k/average_l0_503
Load this SAE
blocks.12.attn.hook_z 65536 none
layer_12/width_65k/average_l0_79
Load this SAE
blocks.12.attn.hook_z 65536 none
layer_13/width_65k/average_l0_191
Load this SAE
blocks.13.attn.hook_z 65536 none
layer_13/width_65k/average_l0_363
Load this SAE
blocks.13.attn.hook_z 65536 none
layer_13/width_65k/average_l0_41
Load this SAE
blocks.13.attn.hook_z 65536 none
layer_13/width_65k/average_l0_556
Load this SAE
blocks.13.attn.hook_z 65536 none
layer_13/width_65k/average_l0_87
Load this SAE
blocks.13.attn.hook_z 65536 none
layer_14/width_65k/average_l0_138
Load this SAE
blocks.14.attn.hook_z 65536 none
layer_14/width_65k/average_l0_283
Load this SAE
blocks.14.attn.hook_z 65536 none
layer_14/width_65k/average_l0_37
Load this SAE
blocks.14.attn.hook_z 65536 none
layer_14/width_65k/average_l0_453
Load this SAE
blocks.14.attn.hook_z 65536 none
layer_14/width_65k/average_l0_66
Load this SAE
blocks.14.attn.hook_z 65536 none
layer_15/width_65k/average_l0_182
Load this SAE
blocks.15.attn.hook_z 65536 none
layer_15/width_65k/average_l0_327
Load this SAE
blocks.15.attn.hook_z 65536 none
layer_15/width_65k/average_l0_42
Load this SAE
blocks.15.attn.hook_z 65536 none
layer_15/width_65k/average_l0_517
Load this SAE
blocks.15.attn.hook_z 65536 none
layer_15/width_65k/average_l0_90
Load this SAE
blocks.15.attn.hook_z 65536 none
layer_16/width_65k/average_l0_129
Load this SAE
blocks.16.attn.hook_z 65536 none
layer_16/width_65k/average_l0_260
Load this SAE
blocks.16.attn.hook_z 65536 none
layer_16/width_65k/average_l0_35
Load this SAE
blocks.16.attn.hook_z 65536 none
layer_16/width_65k/average_l0_502
Load this SAE
blocks.16.attn.hook_z 65536 none
layer_16/width_65k/average_l0_64
Load this SAE
blocks.16.attn.hook_z 65536 none
layer_17/width_65k/average_l0_157
Load this SAE
blocks.17.attn.hook_z 65536 none
layer_17/width_65k/average_l0_293
Load this SAE
blocks.17.attn.hook_z 65536 none
layer_17/width_65k/average_l0_35
Load this SAE
blocks.17.attn.hook_z 65536 none
layer_17/width_65k/average_l0_489
Load this SAE
blocks.17.attn.hook_z 65536 none
layer_17/width_65k/average_l0_70
Load this SAE
blocks.17.attn.hook_z 65536 none
layer_18/width_65k/average_l0_123
Load this SAE
blocks.18.attn.hook_z 65536 none
layer_18/width_65k/average_l0_255
Load this SAE
blocks.18.attn.hook_z 65536 none
layer_18/width_65k/average_l0_29
Load this SAE
blocks.18.attn.hook_z 65536 none
layer_18/width_65k/average_l0_466
Load this SAE
blocks.18.attn.hook_z 65536 none
layer_18/width_65k/average_l0_58
Load this SAE
blocks.18.attn.hook_z 65536 none
layer_19/width_65k/average_l0_106
Load this SAE
blocks.19.attn.hook_z 65536 none
layer_19/width_65k/average_l0_220
Load this SAE
blocks.19.attn.hook_z 65536 none
layer_19/width_65k/average_l0_26
Load this SAE
blocks.19.attn.hook_z 65536 none
layer_19/width_65k/average_l0_411
Load this SAE
blocks.19.attn.hook_z 65536 none
layer_19/width_65k/average_l0_49
Load this SAE
blocks.19.attn.hook_z 65536 none
layer_20/width_65k/average_l0_102
Load this SAE
blocks.20.attn.hook_z 65536 none
layer_20/width_65k/average_l0_242
Load this SAE
blocks.20.attn.hook_z 65536 none
layer_20/width_65k/average_l0_26
Load this SAE
blocks.20.attn.hook_z 65536 none
layer_20/width_65k/average_l0_419
Load this SAE
blocks.20.attn.hook_z 65536 none
layer_20/width_65k/average_l0_49
Load this SAE
blocks.20.attn.hook_z 65536 none
layer_21/width_65k/average_l0_118
Load this SAE
blocks.21.attn.hook_z 65536 none
layer_21/width_65k/average_l0_266
Load this SAE
blocks.21.attn.hook_z 65536 none
layer_21/width_65k/average_l0_29
Load this SAE
blocks.21.attn.hook_z 65536 none
layer_21/width_65k/average_l0_474
Load this SAE
blocks.21.attn.hook_z 65536 none
layer_21/width_65k/average_l0_56
Load this SAE
blocks.21.attn.hook_z 65536 none
layer_22/width_65k/average_l0_112
Load this SAE
blocks.22.attn.hook_z 65536 none
layer_22/width_65k/average_l0_196
Load this SAE
blocks.22.attn.hook_z 65536 none
layer_22/width_65k/average_l0_20
Load this SAE
blocks.22.attn.hook_z 65536 none
layer_22/width_65k/average_l0_361
Load this SAE
blocks.22.attn.hook_z 65536 none
layer_22/width_65k/average_l0_37
Load this SAE
blocks.22.attn.hook_z 65536 none
layer_23/width_65k/average_l0_140
Load this SAE
blocks.23.attn.hook_z 65536 none
layer_23/width_65k/average_l0_27
Load this SAE
blocks.23.attn.hook_z 65536 none
layer_23/width_65k/average_l0_276
Load this SAE
blocks.23.attn.hook_z 65536 none
layer_23/width_65k/average_l0_457
Load this SAE
blocks.23.attn.hook_z 65536 none
layer_23/width_65k/average_l0_56
Load this SAE
blocks.23.attn.hook_z 65536 none
layer_24/width_65k/average_l0_186
Load this SAE
blocks.24.attn.hook_z 65536 none
layer_24/width_65k/average_l0_32
Load this SAE
blocks.24.attn.hook_z 65536 none
layer_24/width_65k/average_l0_347
Load this SAE
blocks.24.attn.hook_z 65536 none
layer_24/width_65k/average_l0_537
Load this SAE
blocks.24.attn.hook_z 65536 none
layer_24/width_65k/average_l0_77
Load this SAE
blocks.24.attn.hook_z 65536 none
layer_25/width_65k/average_l0_153
Load this SAE
blocks.25.attn.hook_z 65536 none
layer_25/width_65k/average_l0_290
Load this SAE
blocks.25.attn.hook_z 65536 none
layer_25/width_65k/average_l0_30
Load this SAE
blocks.25.attn.hook_z 65536 none
layer_25/width_65k/average_l0_465
Load this SAE
blocks.25.attn.hook_z 65536 none
layer_25/width_65k/average_l0_63
Load this SAE
blocks.25.attn.hook_z 65536 none

gemma-scope-2b-pt-att-canonical

  • Huggingface Repo: google/gemma-scope-2b-pt-att
id neuronpedia hook_name d_sae normalize_activations
layer_0/width_16k/canonical
Load this SAE
gemma-2-2b/0-gemmascope-att-16k blocks.0.attn.hook_z 16384 none
layer_1/width_16k/canonical
Load this SAE
gemma-2-2b/1-gemmascope-att-16k blocks.1.attn.hook_z 16384 none
layer_2/width_16k/canonical
Load this SAE
gemma-2-2b/2-gemmascope-att-16k blocks.2.attn.hook_z 16384 none
layer_3/width_16k/canonical
Load this SAE
gemma-2-2b/3-gemmascope-att-16k blocks.3.attn.hook_z 16384 none
layer_4/width_16k/canonical
Load this SAE
gemma-2-2b/4-gemmascope-att-16k blocks.4.attn.hook_z 16384 none
layer_5/width_16k/canonical
Load this SAE
gemma-2-2b/5-gemmascope-att-16k blocks.5.attn.hook_z 16384 none
layer_6/width_16k/canonical
Load this SAE
gemma-2-2b/6-gemmascope-att-16k blocks.6.attn.hook_z 16384 none
layer_7/width_16k/canonical
Load this SAE
gemma-2-2b/7-gemmascope-att-16k blocks.7.attn.hook_z 16384 none
layer_8/width_16k/canonical
Load this SAE
gemma-2-2b/8-gemmascope-att-16k blocks.8.attn.hook_z 16384 none
layer_9/width_16k/canonical
Load this SAE
gemma-2-2b/9-gemmascope-att-16k blocks.9.attn.hook_z 16384 none
layer_10/width_16k/canonical
Load this SAE
gemma-2-2b/10-gemmascope-att-16k blocks.10.attn.hook_z 16384 none
layer_11/width_16k/canonical
Load this SAE
gemma-2-2b/11-gemmascope-att-16k blocks.11.attn.hook_z 16384 none
layer_12/width_16k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-att-16k blocks.12.attn.hook_z 16384 none
layer_13/width_16k/canonical
Load this SAE
gemma-2-2b/13-gemmascope-att-16k blocks.13.attn.hook_z 16384 none
layer_14/width_16k/canonical
Load this SAE
gemma-2-2b/14-gemmascope-att-16k blocks.14.attn.hook_z 16384 none
layer_15/width_16k/canonical
Load this SAE
gemma-2-2b/15-gemmascope-att-16k blocks.15.attn.hook_z 16384 none
layer_16/width_16k/canonical
Load this SAE
gemma-2-2b/16-gemmascope-att-16k blocks.16.attn.hook_z 16384 none
layer_17/width_16k/canonical
Load this SAE
gemma-2-2b/17-gemmascope-att-16k blocks.17.attn.hook_z 16384 none
layer_18/width_16k/canonical
Load this SAE
gemma-2-2b/18-gemmascope-att-16k blocks.18.attn.hook_z 16384 none
layer_19/width_16k/canonical
Load this SAE
gemma-2-2b/19-gemmascope-att-16k blocks.19.attn.hook_z 16384 none
layer_20/width_16k/canonical
Load this SAE
gemma-2-2b/20-gemmascope-att-16k blocks.20.attn.hook_z 16384 none
layer_21/width_16k/canonical
Load this SAE
gemma-2-2b/21-gemmascope-att-16k blocks.21.attn.hook_z 16384 none
layer_22/width_16k/canonical
Load this SAE
gemma-2-2b/22-gemmascope-att-16k blocks.22.attn.hook_z 16384 none
layer_23/width_16k/canonical
Load this SAE
gemma-2-2b/23-gemmascope-att-16k blocks.23.attn.hook_z 16384 none
layer_24/width_16k/canonical
Load this SAE
gemma-2-2b/24-gemmascope-att-16k blocks.24.attn.hook_z 16384 none
layer_25/width_16k/canonical
Load this SAE
gemma-2-2b/25-gemmascope-att-16k blocks.25.attn.hook_z 16384 none
layer_0/width_65k/canonical
Load this SAE
gemma-2-2b/0-gemmascope-att-65k blocks.0.attn.hook_z 65536 none
layer_1/width_65k/canonical
Load this SAE
gemma-2-2b/1-gemmascope-att-65k blocks.1.attn.hook_z 65536 none
layer_2/width_65k/canonical
Load this SAE
gemma-2-2b/2-gemmascope-att-65k blocks.2.attn.hook_z 65536 none
layer_3/width_65k/canonical
Load this SAE
gemma-2-2b/3-gemmascope-att-65k blocks.3.attn.hook_z 65536 none
layer_4/width_65k/canonical
Load this SAE
gemma-2-2b/4-gemmascope-att-65k blocks.4.attn.hook_z 65536 none
layer_5/width_65k/canonical
Load this SAE
gemma-2-2b/5-gemmascope-att-65k blocks.5.attn.hook_z 65536 none
layer_6/width_65k/canonical
Load this SAE
gemma-2-2b/6-gemmascope-att-65k blocks.6.attn.hook_z 65536 none
layer_7/width_65k/canonical
Load this SAE
gemma-2-2b/7-gemmascope-att-65k blocks.7.attn.hook_z 65536 none
layer_8/width_65k/canonical
Load this SAE
gemma-2-2b/8-gemmascope-att-65k blocks.8.attn.hook_z 65536 none
layer_9/width_65k/canonical
Load this SAE
gemma-2-2b/9-gemmascope-att-65k blocks.9.attn.hook_z 65536 none
layer_10/width_65k/canonical
Load this SAE
gemma-2-2b/10-gemmascope-att-65k blocks.10.attn.hook_z 65536 none
layer_11/width_65k/canonical
Load this SAE
gemma-2-2b/11-gemmascope-att-65k blocks.11.attn.hook_z 65536 none
layer_12/width_65k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-att-65k blocks.12.attn.hook_z 65536 none
layer_13/width_65k/canonical
Load this SAE
gemma-2-2b/13-gemmascope-att-65k blocks.13.attn.hook_z 65536 none
layer_14/width_65k/canonical
Load this SAE
gemma-2-2b/14-gemmascope-att-65k blocks.14.attn.hook_z 65536 none
layer_15/width_65k/canonical
Load this SAE
gemma-2-2b/15-gemmascope-att-65k blocks.15.attn.hook_z 65536 none
layer_16/width_65k/canonical
Load this SAE
gemma-2-2b/16-gemmascope-att-65k blocks.16.attn.hook_z 65536 none
layer_17/width_65k/canonical
Load this SAE
gemma-2-2b/17-gemmascope-att-65k blocks.17.attn.hook_z 65536 none
layer_18/width_65k/canonical
Load this SAE
gemma-2-2b/18-gemmascope-att-65k blocks.18.attn.hook_z 65536 none
layer_19/width_65k/canonical
Load this SAE
gemma-2-2b/19-gemmascope-att-65k blocks.19.attn.hook_z 65536 none
layer_20/width_65k/canonical
Load this SAE
gemma-2-2b/20-gemmascope-att-65k blocks.20.attn.hook_z 65536 none
layer_21/width_65k/canonical
Load this SAE
gemma-2-2b/21-gemmascope-att-65k blocks.21.attn.hook_z 65536 none
layer_22/width_65k/canonical
Load this SAE
gemma-2-2b/22-gemmascope-att-65k blocks.22.attn.hook_z 65536 none
layer_23/width_65k/canonical
Load this SAE
gemma-2-2b/23-gemmascope-att-65k blocks.23.attn.hook_z 65536 none
layer_24/width_65k/canonical
Load this SAE
gemma-2-2b/24-gemmascope-att-65k blocks.24.attn.hook_z 65536 none
layer_25/width_65k/canonical
Load this SAE
gemma-2-2b/25-gemmascope-att-65k blocks.25.attn.hook_z 65536 none

gemma-scope-2b-pt-mlp

  • Huggingface Repo: google/gemma-scope-2b-pt-mlp
id neuronpedia hook_name d_sae normalize_activations
layer_0/width_16k/average_l0_119
Load this SAE
blocks.0.hook_mlp_out 16384 none
layer_0/width_16k/average_l0_16
Load this SAE
blocks.0.hook_mlp_out 16384 none
layer_0/width_16k/average_l0_30
Load this SAE
blocks.0.hook_mlp_out 16384 none
layer_0/width_16k/average_l0_60
Load this SAE
blocks.0.hook_mlp_out 16384 none
layer_0/width_16k/average_l0_9
Load this SAE
blocks.0.hook_mlp_out 16384 none
layer_1/width_16k/average_l0_105
Load this SAE
blocks.1.hook_mlp_out 16384 none
layer_1/width_16k/average_l0_12
Load this SAE
blocks.1.hook_mlp_out 16384 none
layer_1/width_16k/average_l0_239
Load this SAE
blocks.1.hook_mlp_out 16384 none
layer_1/width_16k/average_l0_24
Load this SAE
blocks.1.hook_mlp_out 16384 none
layer_1/width_16k/average_l0_50
Load this SAE
blocks.1.hook_mlp_out 16384 none
layer_2/width_16k/average_l0_19
Load this SAE
blocks.2.hook_mlp_out 16384 none
layer_2/width_16k/average_l0_213
Load this SAE
blocks.2.hook_mlp_out 16384 none
layer_2/width_16k/average_l0_41
Load this SAE
blocks.2.hook_mlp_out 16384 none
layer_2/width_16k/average_l0_434
Load this SAE
blocks.2.hook_mlp_out 16384 none
layer_2/width_16k/average_l0_95
Load this SAE
blocks.2.hook_mlp_out 16384 none
layer_3/width_16k/average_l0_195
Load this SAE
blocks.3.hook_mlp_out 16384 none
layer_3/width_16k/average_l0_21
Load this SAE
blocks.3.hook_mlp_out 16384 none
layer_3/width_16k/average_l0_377
Load this SAE
blocks.3.hook_mlp_out 16384 none
layer_3/width_16k/average_l0_44
Load this SAE
blocks.3.hook_mlp_out 16384 none
layer_3/width_16k/average_l0_95
Load this SAE
blocks.3.hook_mlp_out 16384 none
layer_4/width_16k/average_l0_18
Load this SAE
blocks.4.hook_mlp_out 16384 none
layer_4/width_16k/average_l0_198
Load this SAE
blocks.4.hook_mlp_out 16384 none
layer_4/width_16k/average_l0_38
Load this SAE
blocks.4.hook_mlp_out 16384 none
layer_4/width_16k/average_l0_433
Load this SAE
blocks.4.hook_mlp_out 16384 none
layer_4/width_16k/average_l0_85
Load this SAE
blocks.4.hook_mlp_out 16384 none
layer_5/width_16k/average_l0_114
Load this SAE
blocks.5.hook_mlp_out 16384 none
layer_5/width_16k/average_l0_23
Load this SAE
blocks.5.hook_mlp_out 16384 none
layer_5/width_16k/average_l0_269
Load this SAE
blocks.5.hook_mlp_out 16384 none
layer_5/width_16k/average_l0_48
Load this SAE
blocks.5.hook_mlp_out 16384 none
layer_5/width_16k/average_l0_575
Load this SAE
blocks.5.hook_mlp_out 16384 none
layer_6/width_16k/average_l0_133
Load this SAE
blocks.6.hook_mlp_out 16384 none
layer_6/width_16k/average_l0_25
Load this SAE
blocks.6.hook_mlp_out 16384 none
layer_6/width_16k/average_l0_328
Load this SAE
blocks.6.hook_mlp_out 16384 none
layer_6/width_16k/average_l0_55
Load this SAE
blocks.6.hook_mlp_out 16384 none
layer_6/width_16k/average_l0_699
Load this SAE
blocks.6.hook_mlp_out 16384 none
layer_7/width_16k/average_l0_146
Load this SAE
blocks.7.hook_mlp_out 16384 none
layer_7/width_16k/average_l0_28
Load this SAE
blocks.7.hook_mlp_out 16384 none
layer_7/width_16k/average_l0_355
Load this SAE
blocks.7.hook_mlp_out 16384 none
layer_7/width_16k/average_l0_60
Load this SAE
blocks.7.hook_mlp_out 16384 none
layer_7/width_16k/average_l0_731
Load this SAE
blocks.7.hook_mlp_out 16384 none
layer_8/width_16k/average_l0_136
Load this SAE
blocks.8.hook_mlp_out 16384 none
layer_8/width_16k/average_l0_27
Load this SAE
blocks.8.hook_mlp_out 16384 none
layer_8/width_16k/average_l0_351
Load this SAE
blocks.8.hook_mlp_out 16384 none
layer_8/width_16k/average_l0_56
Load this SAE
blocks.8.hook_mlp_out 16384 none
layer_8/width_16k/average_l0_739
Load this SAE
blocks.8.hook_mlp_out 16384 none
layer_9/width_16k/average_l0_216
Load this SAE
blocks.9.hook_mlp_out 16384 none
layer_9/width_16k/average_l0_38
Load this SAE
blocks.9.hook_mlp_out 16384 none
layer_9/width_16k/average_l0_482
Load this SAE
blocks.9.hook_mlp_out 16384 none
layer_9/width_16k/average_l0_861
Load this SAE
blocks.9.hook_mlp_out 16384 none
layer_9/width_16k/average_l0_88
Load this SAE
blocks.9.hook_mlp_out 16384 none
layer_10/width_16k/average_l0_110
Load this SAE
blocks.10.hook_mlp_out 16384 none
layer_10/width_16k/average_l0_266
Load this SAE
blocks.10.hook_mlp_out 16384 none
layer_10/width_16k/average_l0_45
Load this SAE
blocks.10.hook_mlp_out 16384 none
layer_10/width_16k/average_l0_568
Load this SAE
blocks.10.hook_mlp_out 16384 none
layer_10/width_16k/average_l0_908
Load this SAE
blocks.10.hook_mlp_out 16384 none
layer_11/width_16k/average_l0_234
Load this SAE
blocks.11.hook_mlp_out 16384 none
layer_11/width_16k/average_l0_42
Load this SAE
blocks.11.hook_mlp_out 16384 none
layer_11/width_16k/average_l0_499
Load this SAE
blocks.11.hook_mlp_out 16384 none
layer_11/width_16k/average_l0_847
Load this SAE
blocks.11.hook_mlp_out 16384 none
layer_11/width_16k/average_l0_98
Load this SAE
blocks.11.hook_mlp_out 16384 none
layer_12/width_16k/average_l0_108
Load this SAE
blocks.12.hook_mlp_out 16384 none
layer_12/width_16k/average_l0_262
Load this SAE
blocks.12.hook_mlp_out 16384 none
layer_12/width_16k/average_l0_44
Load this SAE
blocks.12.hook_mlp_out 16384 none
layer_12/width_16k/average_l0_548
Load this SAE
blocks.12.hook_mlp_out 16384 none
layer_12/width_16k/average_l0_879
Load this SAE
blocks.12.hook_mlp_out 16384 none
layer_13/width_16k/average_l0_112
Load this SAE
blocks.13.hook_mlp_out 16384 none
layer_13/width_16k/average_l0_267
Load this SAE
blocks.13.hook_mlp_out 16384 none
layer_13/width_16k/average_l0_47
Load this SAE
blocks.13.hook_mlp_out 16384 none
layer_13/width_16k/average_l0_553
Load this SAE
blocks.13.hook_mlp_out 16384 none
layer_13/width_16k/average_l0_892
Load this SAE
blocks.13.hook_mlp_out 16384 none
layer_14/width_16k/average_l0_246
Load this SAE
blocks.14.hook_mlp_out 16384 none
layer_14/width_16k/average_l0_41
Load this SAE
blocks.14.hook_mlp_out 16384 none
layer_14/width_16k/average_l0_536
Load this SAE
blocks.14.hook_mlp_out 16384 none
layer_14/width_16k/average_l0_894
Load this SAE
blocks.14.hook_mlp_out 16384 none
layer_14/width_16k/average_l0_97
Load this SAE
blocks.14.hook_mlp_out 16384 none
layer_15/width_16k/average_l0_207
Load this SAE
blocks.15.hook_mlp_out 16384 none
layer_15/width_16k/average_l0_35
Load this SAE
blocks.15.hook_mlp_out 16384 none
layer_15/width_16k/average_l0_492
Load this SAE
blocks.15.hook_mlp_out 16384 none
layer_15/width_16k/average_l0_80
Load this SAE
blocks.15.hook_mlp_out 16384 none
layer_15/width_16k/average_l0_879
Load this SAE
blocks.15.hook_mlp_out 16384 none
layer_16/width_16k/average_l0_185
Load this SAE
blocks.16.hook_mlp_out 16384 none
layer_16/width_16k/average_l0_33
Load this SAE
blocks.16.hook_mlp_out 16384 none
layer_16/width_16k/average_l0_452
Load this SAE
blocks.16.hook_mlp_out 16384 none
layer_16/width_16k/average_l0_72
Load this SAE
blocks.16.hook_mlp_out 16384 none
layer_16/width_16k/average_l0_847
Load this SAE
blocks.16.hook_mlp_out 16384 none
layer_17/width_16k/average_l0_179
Load this SAE
blocks.17.hook_mlp_out 16384 none
layer_17/width_16k/average_l0_31
Load this SAE
blocks.17.hook_mlp_out 16384 none
layer_17/width_16k/average_l0_453
Load this SAE
blocks.17.hook_mlp_out 16384 none
layer_17/width_16k/average_l0_68
Load this SAE
blocks.17.hook_mlp_out 16384 none
layer_17/width_16k/average_l0_853
Load this SAE
blocks.17.hook_mlp_out 16384 none
layer_18/width_16k/average_l0_106
Load this SAE
blocks.18.hook_mlp_out 16384 none
layer_18/width_16k/average_l0_24
Load this SAE
blocks.18.hook_mlp_out 16384 none
layer_18/width_16k/average_l0_292
Load this SAE
blocks.18.hook_mlp_out 16384 none
layer_18/width_16k/average_l0_47
Load this SAE
blocks.18.hook_mlp_out 16384 none
layer_18/width_16k/average_l0_672
Load this SAE
blocks.18.hook_mlp_out 16384 none
layer_19/width_16k/average_l0_109
Load this SAE
blocks.19.hook_mlp_out 16384 none
layer_19/width_16k/average_l0_25
Load this SAE
blocks.19.hook_mlp_out 16384 none
layer_19/width_16k/average_l0_295
Load this SAE
blocks.19.hook_mlp_out 16384 none
layer_19/width_16k/average_l0_50
Load this SAE
blocks.19.hook_mlp_out 16384 none
layer_19/width_16k/average_l0_673
Load this SAE
blocks.19.hook_mlp_out 16384 none
layer_20/width_16k/average_l0_109
Load this SAE
blocks.20.hook_mlp_out 16384 none
layer_20/width_16k/average_l0_24
Load this SAE
blocks.20.hook_mlp_out 16384 none
layer_20/width_16k/average_l0_289
Load this SAE
blocks.20.hook_mlp_out 16384 none
layer_20/width_16k/average_l0_49
Load this SAE
blocks.20.hook_mlp_out 16384 none
layer_20/width_16k/average_l0_658
Load this SAE
blocks.20.hook_mlp_out 16384 none
layer_21/width_16k/average_l0_113
Load this SAE
blocks.21.hook_mlp_out 16384 none
layer_21/width_16k/average_l0_23
Load this SAE
blocks.21.hook_mlp_out 16384 none
layer_21/width_16k/average_l0_279
Load this SAE
blocks.21.hook_mlp_out 16384 none
layer_21/width_16k/average_l0_48
Load this SAE
blocks.21.hook_mlp_out 16384 none
layer_21/width_16k/average_l0_633
Load this SAE
blocks.21.hook_mlp_out 16384 none
layer_22/width_16k/average_l0_121
Load this SAE
blocks.22.hook_mlp_out 16384 none
layer_22/width_16k/average_l0_24
Load this SAE
blocks.22.hook_mlp_out 16384 none
layer_22/width_16k/average_l0_290
Load this SAE
blocks.22.hook_mlp_out 16384 none
layer_22/width_16k/average_l0_51
Load this SAE
blocks.22.hook_mlp_out 16384 none
layer_22/width_16k/average_l0_624
Load this SAE
blocks.22.hook_mlp_out 16384 none
layer_23/width_16k/average_l0_128
Load this SAE
blocks.23.hook_mlp_out 16384 none
layer_23/width_16k/average_l0_27
Load this SAE
blocks.23.hook_mlp_out 16384 none
layer_23/width_16k/average_l0_287
Load this SAE
blocks.23.hook_mlp_out 16384 none
layer_23/width_16k/average_l0_57
Load this SAE
blocks.23.hook_mlp_out 16384 none
layer_23/width_16k/average_l0_627
Load this SAE
blocks.23.hook_mlp_out 16384 none
layer_24/width_16k/average_l0_158
Load this SAE
blocks.24.hook_mlp_out 16384 none
layer_24/width_16k/average_l0_19
Load this SAE
blocks.24.hook_mlp_out 16384 none
layer_24/width_16k/average_l0_35
Load this SAE
blocks.24.hook_mlp_out 16384 none
layer_24/width_16k/average_l0_357
Load this SAE
blocks.24.hook_mlp_out 16384 none
layer_24/width_16k/average_l0_73
Load this SAE
blocks.24.hook_mlp_out 16384 none
layer_25/width_16k/average_l0_126
Load this SAE
blocks.25.hook_mlp_out 16384 none
layer_25/width_16k/average_l0_15
Load this SAE
blocks.25.hook_mlp_out 16384 none
layer_25/width_16k/average_l0_277
Load this SAE
blocks.25.hook_mlp_out 16384 none
layer_25/width_16k/average_l0_29
Load this SAE
blocks.25.hook_mlp_out 16384 none
layer_25/width_16k/average_l0_59
Load this SAE
blocks.25.hook_mlp_out 16384 none
layer_0/width_65k/average_l0_12
Load this SAE
blocks.0.hook_mlp_out 65536 none
layer_0/width_65k/average_l0_21
Load this SAE
blocks.0.hook_mlp_out 65536 none
layer_0/width_65k/average_l0_39
Load this SAE
blocks.0.hook_mlp_out 65536 none
layer_0/width_65k/average_l0_7
Load this SAE
blocks.0.hook_mlp_out 65536 none
layer_0/width_65k/average_l0_72
Load this SAE
blocks.0.hook_mlp_out 65536 none
layer_1/width_65k/average_l0_11
Load this SAE
blocks.1.hook_mlp_out 65536 none
layer_1/width_65k/average_l0_127
Load this SAE
blocks.1.hook_mlp_out 65536 none
layer_1/width_65k/average_l0_20
Load this SAE
blocks.1.hook_mlp_out 65536 none
layer_1/width_65k/average_l0_37
Load this SAE
blocks.1.hook_mlp_out 65536 none
layer_1/width_65k/average_l0_67
Load this SAE
blocks.1.hook_mlp_out 65536 none
layer_2/width_65k/average_l0_134
Load this SAE
blocks.2.hook_mlp_out 65536 none
layer_2/width_65k/average_l0_16
Load this SAE
blocks.2.hook_mlp_out 65536 none
layer_2/width_65k/average_l0_265
Load this SAE
blocks.2.hook_mlp_out 65536 none
layer_2/width_65k/average_l0_31
Load this SAE
blocks.2.hook_mlp_out 65536 none
layer_2/width_65k/average_l0_60
Load this SAE
blocks.2.hook_mlp_out 65536 none
layer_3/width_65k/average_l0_144
Load this SAE
blocks.3.hook_mlp_out 65536 none
layer_3/width_65k/average_l0_18
Load this SAE
blocks.3.hook_mlp_out 65536 none
layer_3/width_65k/average_l0_279
Load this SAE
blocks.3.hook_mlp_out 65536 none
layer_3/width_65k/average_l0_33
Load this SAE
blocks.3.hook_mlp_out 65536 none
layer_3/width_65k/average_l0_68
Load this SAE
blocks.3.hook_mlp_out 65536 none
layer_4/width_65k/average_l0_138
Load this SAE
blocks.4.hook_mlp_out 65536 none
layer_4/width_65k/average_l0_17
Load this SAE
blocks.4.hook_mlp_out 65536 none
layer_4/width_65k/average_l0_299
Load this SAE
blocks.4.hook_mlp_out 65536 none
layer_4/width_65k/average_l0_32
Load this SAE
blocks.4.hook_mlp_out 65536 none
layer_4/width_65k/average_l0_66
Load this SAE
blocks.4.hook_mlp_out 65536 none
layer_5/width_65k/average_l0_186
Load this SAE
blocks.5.hook_mlp_out 65536 none
layer_5/width_65k/average_l0_22
Load this SAE
blocks.5.hook_mlp_out 65536 none
layer_5/width_65k/average_l0_407
Load this SAE
blocks.5.hook_mlp_out 65536 none
layer_5/width_65k/average_l0_43
Load this SAE
blocks.5.hook_mlp_out 65536 none
layer_5/width_65k/average_l0_86
Load this SAE
blocks.5.hook_mlp_out 65536 none
layer_6/width_65k/average_l0_101
Load this SAE
blocks.6.hook_mlp_out 65536 none
layer_6/width_65k/average_l0_224
Load this SAE
blocks.6.hook_mlp_out 65536 none
layer_6/width_65k/average_l0_24
Load this SAE
blocks.6.hook_mlp_out 65536 none
layer_6/width_65k/average_l0_47
Load this SAE
blocks.6.hook_mlp_out 65536 none
layer_6/width_65k/average_l0_515
Load this SAE
blocks.6.hook_mlp_out 65536 none
layer_7/width_65k/average_l0_115
Load this SAE
blocks.7.hook_mlp_out 65536 none
layer_7/width_65k/average_l0_266
Load this SAE
blocks.7.hook_mlp_out 65536 none
layer_7/width_65k/average_l0_28
Load this SAE
blocks.7.hook_mlp_out 65536 none
layer_7/width_65k/average_l0_56
Load this SAE
blocks.7.hook_mlp_out 65536 none
layer_7/width_65k/average_l0_571
Load this SAE
blocks.7.hook_mlp_out 65536 none
layer_8/width_65k/average_l0_110
Load this SAE
blocks.8.hook_mlp_out 65536 none
layer_8/width_65k/average_l0_256
Load this SAE
blocks.8.hook_mlp_out 65536 none
layer_8/width_65k/average_l0_31
Load this SAE
blocks.8.hook_mlp_out 65536 none
layer_8/width_65k/average_l0_547
Load this SAE
blocks.8.hook_mlp_out 65536 none
layer_8/width_65k/average_l0_55
Load this SAE
blocks.8.hook_mlp_out 65536 none
layer_9/width_65k/average_l0_168
Load this SAE
blocks.9.hook_mlp_out 65536 none
layer_9/width_65k/average_l0_38
Load this SAE
blocks.9.hook_mlp_out 65536 none
layer_9/width_65k/average_l0_387
Load this SAE
blocks.9.hook_mlp_out 65536 none
layer_9/width_65k/average_l0_745
Load this SAE
blocks.9.hook_mlp_out 65536 none
layer_9/width_65k/average_l0_77
Load this SAE
blocks.9.hook_mlp_out 65536 none
layer_10/width_65k/average_l0_218
Load this SAE
blocks.10.hook_mlp_out 65536 none
layer_10/width_65k/average_l0_43
Load this SAE
blocks.10.hook_mlp_out 65536 none
layer_10/width_65k/average_l0_474
Load this SAE
blocks.10.hook_mlp_out 65536 none
layer_10/width_65k/average_l0_851
Load this SAE
blocks.10.hook_mlp_out 65536 none
layer_10/width_65k/average_l0_95
Load this SAE
blocks.10.hook_mlp_out 65536 none
layer_11/width_65k/average_l0_200
Load this SAE
blocks.11.hook_mlp_out 65536 none
layer_11/width_65k/average_l0_41
Load this SAE
blocks.11.hook_mlp_out 65536 none
layer_11/width_65k/average_l0_436
Load this SAE
blocks.11.hook_mlp_out 65536 none
layer_11/width_65k/average_l0_771
Load this SAE
blocks.11.hook_mlp_out 65536 none
layer_11/width_65k/average_l0_88
Load this SAE
blocks.11.hook_mlp_out 65536 none
layer_12/width_65k/average_l0_222
Load this SAE
blocks.12.hook_mlp_out 65536 none
layer_12/width_65k/average_l0_44
Load this SAE
blocks.12.hook_mlp_out 65536 none
layer_12/width_65k/average_l0_482
Load this SAE
blocks.12.hook_mlp_out 65536 none
layer_12/width_65k/average_l0_848
Load this SAE
blocks.12.hook_mlp_out 65536 none
layer_12/width_65k/average_l0_96
Load this SAE
blocks.12.hook_mlp_out 65536 none
layer_13/width_65k/average_l0_228
Load this SAE
blocks.13.hook_mlp_out 65536 none
layer_13/width_65k/average_l0_44
Load this SAE
blocks.13.hook_mlp_out 65536 none
layer_13/width_65k/average_l0_480
Load this SAE
blocks.13.hook_mlp_out 65536 none
layer_13/width_65k/average_l0_841
Load this SAE
blocks.13.hook_mlp_out 65536 none
layer_13/width_65k/average_l0_98
Load this SAE
blocks.13.hook_mlp_out 65536 none
layer_14/width_65k/average_l0_204
Load this SAE
blocks.14.hook_mlp_out 65536 none
layer_14/width_65k/average_l0_39
Load this SAE
blocks.14.hook_mlp_out 65536 none
layer_14/width_65k/average_l0_463
Load this SAE
blocks.14.hook_mlp_out 65536 none
layer_14/width_65k/average_l0_816
Load this SAE
blocks.14.hook_mlp_out 65536 none
layer_14/width_65k/average_l0_89
Load this SAE
blocks.14.hook_mlp_out 65536 none
layer_15/width_65k/average_l0_164
Load this SAE
blocks.15.hook_mlp_out 65536 none
layer_15/width_65k/average_l0_35
Load this SAE
blocks.15.hook_mlp_out 65536 none
layer_15/width_65k/average_l0_405
Load this SAE
blocks.15.hook_mlp_out 65536 none
layer_15/width_65k/average_l0_72
Load this SAE
blocks.15.hook_mlp_out 65536 none
layer_15/width_65k/average_l0_754
Load this SAE
blocks.15.hook_mlp_out 65536 none
layer_16/width_65k/average_l0_142
Load this SAE
blocks.16.hook_mlp_out 65536 none
layer_16/width_65k/average_l0_32
Load this SAE
blocks.16.hook_mlp_out 65536 none
layer_16/width_65k/average_l0_348
Load this SAE
blocks.16.hook_mlp_out 65536 none
layer_16/width_65k/average_l0_66
Load this SAE
blocks.16.hook_mlp_out 65536 none
layer_16/width_65k/average_l0_695
Load this SAE
blocks.16.hook_mlp_out 65536 none
layer_17/width_65k/average_l0_136
Load this SAE
blocks.17.hook_mlp_out 65536 none
layer_17/width_65k/average_l0_30
Load this SAE
blocks.17.hook_mlp_out 65536 none
layer_17/width_65k/average_l0_342
Load this SAE
blocks.17.hook_mlp_out 65536 none
layer_17/width_65k/average_l0_61
Load this SAE
blocks.17.hook_mlp_out 65536 none
layer_17/width_65k/average_l0_666
Load this SAE
blocks.17.hook_mlp_out 65536 none
layer_18/width_65k/average_l0_191
Load this SAE
blocks.18.hook_mlp_out 65536 none
layer_18/width_65k/average_l0_24
Load this SAE
blocks.18.hook_mlp_out 65536 none
layer_18/width_65k/average_l0_44
Load this SAE
blocks.18.hook_mlp_out 65536 none
layer_18/width_65k/average_l0_491
Load this SAE
blocks.18.hook_mlp_out 65536 none
layer_18/width_65k/average_l0_88
Load this SAE
blocks.18.hook_mlp_out 65536 none
layer_19/width_65k/average_l0_192
Load this SAE
blocks.19.hook_mlp_out 65536 none
layer_19/width_65k/average_l0_25
Load this SAE
blocks.19.hook_mlp_out 65536 none
layer_19/width_65k/average_l0_45
Load this SAE
blocks.19.hook_mlp_out 65536 none
layer_19/width_65k/average_l0_470
Load this SAE
blocks.19.hook_mlp_out 65536 none
layer_19/width_65k/average_l0_88
Load this SAE
blocks.19.hook_mlp_out 65536 none
layer_20/width_65k/average_l0_189
Load this SAE
blocks.20.hook_mlp_out 65536 none
layer_20/width_65k/average_l0_23
Load this SAE
blocks.20.hook_mlp_out 65536 none
layer_20/width_65k/average_l0_44
Load this SAE
blocks.20.hook_mlp_out 65536 none
layer_20/width_65k/average_l0_446
Load this SAE
blocks.20.hook_mlp_out 65536 none
layer_20/width_65k/average_l0_88
Load this SAE
blocks.20.hook_mlp_out 65536 none
layer_21/width_65k/average_l0_192
Load this SAE
blocks.21.hook_mlp_out 65536 none
layer_21/width_65k/average_l0_23
Load this SAE
blocks.21.hook_mlp_out 65536 none
layer_21/width_65k/average_l0_42
Load this SAE
blocks.21.hook_mlp_out 65536 none
layer_21/width_65k/average_l0_472
Load this SAE
blocks.21.hook_mlp_out 65536 none
layer_21/width_65k/average_l0_86
Load this SAE
blocks.21.hook_mlp_out 65536 none
layer_22/width_65k/average_l0_203
Load this SAE
blocks.22.hook_mlp_out 65536 none
layer_22/width_65k/average_l0_23
Load this SAE
blocks.22.hook_mlp_out 65536 none
layer_22/width_65k/average_l0_46
Load this SAE
blocks.22.hook_mlp_out 65536 none
layer_22/width_65k/average_l0_487
Load this SAE
blocks.22.hook_mlp_out 65536 none
layer_22/width_65k/average_l0_92
Load this SAE
blocks.22.hook_mlp_out 65536 none
layer_23/width_65k/average_l0_102
Load this SAE
blocks.23.hook_mlp_out 65536 none
layer_23/width_65k/average_l0_218
Load this SAE
blocks.23.hook_mlp_out 65536 none
layer_23/width_65k/average_l0_25
Load this SAE
blocks.23.hook_mlp_out 65536 none
layer_23/width_65k/average_l0_49
Load this SAE
blocks.23.hook_mlp_out 65536 none
layer_23/width_65k/average_l0_497
Load this SAE
blocks.23.hook_mlp_out 65536 none
layer_24/width_65k/average_l0_128
Load this SAE
blocks.24.hook_mlp_out 65536 none
layer_24/width_65k/average_l0_18
Load this SAE
blocks.24.hook_mlp_out 65536 none
layer_24/width_65k/average_l0_268
Load this SAE
blocks.24.hook_mlp_out 65536 none
layer_24/width_65k/average_l0_32
Load this SAE
blocks.24.hook_mlp_out 65536 none
layer_24/width_65k/average_l0_62
Load this SAE
blocks.24.hook_mlp_out 65536 none
layer_25/width_65k/average_l0_107
Load this SAE
blocks.25.hook_mlp_out 65536 none
layer_25/width_65k/average_l0_14
Load this SAE
blocks.25.hook_mlp_out 65536 none
layer_25/width_65k/average_l0_215
Load this SAE
blocks.25.hook_mlp_out 65536 none
layer_25/width_65k/average_l0_26
Load this SAE
blocks.25.hook_mlp_out 65536 none
layer_25/width_65k/average_l0_52
Load this SAE
blocks.25.hook_mlp_out 65536 none

gemma-scope-2b-pt-mlp-canonical

  • Huggingface Repo: google/gemma-scope-2b-pt-mlp
id neuronpedia hook_name d_sae normalize_activations
layer_0/width_16k/canonical
Load this SAE
gemma-2-2b/0-gemmascope-mlp-16k blocks.0.hook_mlp_out 16384 none
layer_1/width_16k/canonical
Load this SAE
gemma-2-2b/1-gemmascope-mlp-16k blocks.1.hook_mlp_out 16384 none
layer_2/width_16k/canonical
Load this SAE
gemma-2-2b/2-gemmascope-mlp-16k blocks.2.hook_mlp_out 16384 none
layer_3/width_16k/canonical
Load this SAE
gemma-2-2b/3-gemmascope-mlp-16k blocks.3.hook_mlp_out 16384 none
layer_4/width_16k/canonical
Load this SAE
gemma-2-2b/4-gemmascope-mlp-16k blocks.4.hook_mlp_out 16384 none
layer_5/width_16k/canonical
Load this SAE
gemma-2-2b/5-gemmascope-mlp-16k blocks.5.hook_mlp_out 16384 none
layer_6/width_16k/canonical
Load this SAE
gemma-2-2b/6-gemmascope-mlp-16k blocks.6.hook_mlp_out 16384 none
layer_7/width_16k/canonical
Load this SAE
gemma-2-2b/7-gemmascope-mlp-16k blocks.7.hook_mlp_out 16384 none
layer_8/width_16k/canonical
Load this SAE
gemma-2-2b/8-gemmascope-mlp-16k blocks.8.hook_mlp_out 16384 none
layer_9/width_16k/canonical
Load this SAE
gemma-2-2b/9-gemmascope-mlp-16k blocks.9.hook_mlp_out 16384 none
layer_10/width_16k/canonical
Load this SAE
gemma-2-2b/10-gemmascope-mlp-16k blocks.10.hook_mlp_out 16384 none
layer_11/width_16k/canonical
Load this SAE
gemma-2-2b/11-gemmascope-mlp-16k blocks.11.hook_mlp_out 16384 none
layer_12/width_16k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-mlp-16k blocks.12.hook_mlp_out 16384 none
layer_13/width_16k/canonical
Load this SAE
gemma-2-2b/13-gemmascope-mlp-16k blocks.13.hook_mlp_out 16384 none
layer_14/width_16k/canonical
Load this SAE
gemma-2-2b/14-gemmascope-mlp-16k blocks.14.hook_mlp_out 16384 none
layer_15/width_16k/canonical
Load this SAE
gemma-2-2b/15-gemmascope-mlp-16k blocks.15.hook_mlp_out 16384 none
layer_16/width_16k/canonical
Load this SAE
gemma-2-2b/16-gemmascope-mlp-16k blocks.16.hook_mlp_out 16384 none
layer_17/width_16k/canonical
Load this SAE
gemma-2-2b/17-gemmascope-mlp-16k blocks.17.hook_mlp_out 16384 none
layer_18/width_16k/canonical
Load this SAE
gemma-2-2b/18-gemmascope-mlp-16k blocks.18.hook_mlp_out 16384 none
layer_19/width_16k/canonical
Load this SAE
gemma-2-2b/19-gemmascope-mlp-16k blocks.19.hook_mlp_out 16384 none
layer_20/width_16k/canonical
Load this SAE
gemma-2-2b/20-gemmascope-mlp-16k blocks.20.hook_mlp_out 16384 none
layer_21/width_16k/canonical
Load this SAE
gemma-2-2b/21-gemmascope-mlp-16k blocks.21.hook_mlp_out 16384 none
layer_22/width_16k/canonical
Load this SAE
gemma-2-2b/22-gemmascope-mlp-16k blocks.22.hook_mlp_out 16384 none
layer_23/width_16k/canonical
Load this SAE
gemma-2-2b/23-gemmascope-mlp-16k blocks.23.hook_mlp_out 16384 none
layer_24/width_16k/canonical
Load this SAE
gemma-2-2b/24-gemmascope-mlp-16k blocks.24.hook_mlp_out 16384 none
layer_25/width_16k/canonical
Load this SAE
gemma-2-2b/25-gemmascope-mlp-16k blocks.25.hook_mlp_out 16384 none
layer_0/width_65k/canonical
Load this SAE
gemma-2-2b/0-gemmascope-mlp-65k blocks.0.hook_mlp_out 65536 none
layer_1/width_65k/canonical
Load this SAE
gemma-2-2b/1-gemmascope-mlp-65k blocks.1.hook_mlp_out 65536 none
layer_2/width_65k/canonical
Load this SAE
gemma-2-2b/2-gemmascope-mlp-65k blocks.2.hook_mlp_out 65536 none
layer_3/width_65k/canonical
Load this SAE
gemma-2-2b/3-gemmascope-mlp-65k blocks.3.hook_mlp_out 65536 none
layer_4/width_65k/canonical
Load this SAE
gemma-2-2b/4-gemmascope-mlp-65k blocks.4.hook_mlp_out 65536 none
layer_5/width_65k/canonical
Load this SAE
gemma-2-2b/5-gemmascope-mlp-65k blocks.5.hook_mlp_out 65536 none
layer_6/width_65k/canonical
Load this SAE
gemma-2-2b/6-gemmascope-mlp-65k blocks.6.hook_mlp_out 65536 none
layer_7/width_65k/canonical
Load this SAE
gemma-2-2b/7-gemmascope-mlp-65k blocks.7.hook_mlp_out 65536 none
layer_8/width_65k/canonical
Load this SAE
gemma-2-2b/8-gemmascope-mlp-65k blocks.8.hook_mlp_out 65536 none
layer_9/width_65k/canonical
Load this SAE
gemma-2-2b/9-gemmascope-mlp-65k blocks.9.hook_mlp_out 65536 none
layer_10/width_65k/canonical
Load this SAE
gemma-2-2b/10-gemmascope-mlp-65k blocks.10.hook_mlp_out 65536 none
layer_11/width_65k/canonical
Load this SAE
gemma-2-2b/11-gemmascope-mlp-65k blocks.11.hook_mlp_out 65536 none
layer_12/width_65k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-mlp-65k blocks.12.hook_mlp_out 65536 none
layer_13/width_65k/canonical
Load this SAE
gemma-2-2b/13-gemmascope-mlp-65k blocks.13.hook_mlp_out 65536 none
layer_14/width_65k/canonical
Load this SAE
gemma-2-2b/14-gemmascope-mlp-65k blocks.14.hook_mlp_out 65536 none
layer_15/width_65k/canonical
Load this SAE
gemma-2-2b/15-gemmascope-mlp-65k blocks.15.hook_mlp_out 65536 none
layer_16/width_65k/canonical
Load this SAE
gemma-2-2b/16-gemmascope-mlp-65k blocks.16.hook_mlp_out 65536 none
layer_17/width_65k/canonical
Load this SAE
gemma-2-2b/17-gemmascope-mlp-65k blocks.17.hook_mlp_out 65536 none
layer_18/width_65k/canonical
Load this SAE
gemma-2-2b/18-gemmascope-mlp-65k blocks.18.hook_mlp_out 65536 none
layer_19/width_65k/canonical
Load this SAE
gemma-2-2b/19-gemmascope-mlp-65k blocks.19.hook_mlp_out 65536 none
layer_20/width_65k/canonical
Load this SAE
gemma-2-2b/20-gemmascope-mlp-65k blocks.20.hook_mlp_out 65536 none
layer_21/width_65k/canonical
Load this SAE
gemma-2-2b/21-gemmascope-mlp-65k blocks.21.hook_mlp_out 65536 none
layer_22/width_65k/canonical
Load this SAE
gemma-2-2b/22-gemmascope-mlp-65k blocks.22.hook_mlp_out 65536 none
layer_23/width_65k/canonical
Load this SAE
gemma-2-2b/23-gemmascope-mlp-65k blocks.23.hook_mlp_out 65536 none
layer_24/width_65k/canonical
Load this SAE
gemma-2-2b/24-gemmascope-mlp-65k blocks.24.hook_mlp_out 65536 none
layer_25/width_65k/canonical
Load this SAE
gemma-2-2b/25-gemmascope-mlp-65k blocks.25.hook_mlp_out 65536 none

gemma-scope-2b-pt-res

  • Huggingface Repo: google/gemma-scope-2b-pt-res
id neuronpedia hook_name d_sae normalize_activations
embedding/width_4k/average_l0_6
Load this SAE
hook_embed 4096 none
embedding/width_4k/average_l0_44
Load this SAE
hook_embed 4096 none
embedding/width_4k/average_l0_21
Load this SAE
hook_embed 4096 none
embedding/width_4k/average_l0_111
Load this SAE
hook_embed 4096 none
layer_0/width_16k/average_l0_105
Load this SAE
blocks.0.hook_resid_post 16384 none
layer_0/width_16k/average_l0_13
Load this SAE
blocks.0.hook_resid_post 16384 none
layer_0/width_16k/average_l0_226
Load this SAE
blocks.0.hook_resid_post 16384 none
layer_0/width_16k/average_l0_25
Load this SAE
blocks.0.hook_resid_post 16384 none
layer_0/width_16k/average_l0_46
Load this SAE
blocks.0.hook_resid_post 16384 none
layer_1/width_16k/average_l0_10
Load this SAE
blocks.1.hook_resid_post 16384 none
layer_1/width_16k/average_l0_102
Load this SAE
blocks.1.hook_resid_post 16384 none
layer_1/width_16k/average_l0_20
Load this SAE
blocks.1.hook_resid_post 16384 none
layer_1/width_16k/average_l0_250
Load this SAE
blocks.1.hook_resid_post 16384 none
layer_1/width_16k/average_l0_40
Load this SAE
blocks.1.hook_resid_post 16384 none
layer_2/width_16k/average_l0_13
Load this SAE
blocks.2.hook_resid_post 16384 none
layer_2/width_16k/average_l0_141
Load this SAE
blocks.2.hook_resid_post 16384 none
layer_2/width_16k/average_l0_142
Load this SAE
blocks.2.hook_resid_post 16384 none
layer_2/width_16k/average_l0_24
Load this SAE
blocks.2.hook_resid_post 16384 none
layer_2/width_16k/average_l0_304
Load this SAE
blocks.2.hook_resid_post 16384 none
layer_2/width_16k/average_l0_53
Load this SAE
blocks.2.hook_resid_post 16384 none
layer_3/width_16k/average_l0_14
Load this SAE
blocks.3.hook_resid_post 16384 none
layer_3/width_16k/average_l0_142
Load this SAE
blocks.3.hook_resid_post 16384 none
layer_3/width_16k/average_l0_28
Load this SAE
blocks.3.hook_resid_post 16384 none
layer_3/width_16k/average_l0_315
Load this SAE
blocks.3.hook_resid_post 16384 none
layer_3/width_16k/average_l0_59
Load this SAE
blocks.3.hook_resid_post 16384 none
layer_4/width_16k/average_l0_124
Load this SAE
blocks.4.hook_resid_post 16384 none
layer_4/width_16k/average_l0_125
Load this SAE
blocks.4.hook_resid_post 16384 none
layer_4/width_16k/average_l0_17
Load this SAE
blocks.4.hook_resid_post 16384 none
layer_4/width_16k/average_l0_281
Load this SAE
blocks.4.hook_resid_post 16384 none
layer_4/width_16k/average_l0_31
Load this SAE
blocks.4.hook_resid_post 16384 none
layer_4/width_16k/average_l0_60
Load this SAE
blocks.4.hook_resid_post 16384 none
layer_5/width_16k/average_l0_143
Load this SAE
gemma-2-2b/5-gemmascope-res-16k__l0-143 blocks.5.hook_resid_post 16384 none
layer_5/width_16k/average_l0_18
Load this SAE
gemma-2-2b/5-gemmascope-res-16k__l0-18 blocks.5.hook_resid_post 16384 none
layer_5/width_16k/average_l0_309
Load this SAE
gemma-2-2b/5-gemmascope-res-16k__l0-309 blocks.5.hook_resid_post 16384 none
layer_5/width_16k/average_l0_34
Load this SAE
gemma-2-2b/5-gemmascope-res-16k__l0-34 blocks.5.hook_resid_post 16384 none
layer_5/width_16k/average_l0_68
Load this SAE
blocks.5.hook_resid_post 16384 none
layer_6/width_16k/average_l0_144
Load this SAE
blocks.6.hook_resid_post 16384 none
layer_6/width_16k/average_l0_19
Load this SAE
blocks.6.hook_resid_post 16384 none
layer_6/width_16k/average_l0_301
Load this SAE
blocks.6.hook_resid_post 16384 none
layer_6/width_16k/average_l0_36
Load this SAE
blocks.6.hook_resid_post 16384 none
layer_6/width_16k/average_l0_70
Load this SAE
blocks.6.hook_resid_post 16384 none
layer_7/width_16k/average_l0_137
Load this SAE
blocks.7.hook_resid_post 16384 none
layer_7/width_16k/average_l0_20
Load this SAE
blocks.7.hook_resid_post 16384 none
layer_7/width_16k/average_l0_285
Load this SAE
blocks.7.hook_resid_post 16384 none
layer_7/width_16k/average_l0_36
Load this SAE
blocks.7.hook_resid_post 16384 none
layer_7/width_16k/average_l0_69
Load this SAE
blocks.7.hook_resid_post 16384 none
layer_8/width_16k/average_l0_142
Load this SAE
blocks.8.hook_resid_post 16384 none
layer_8/width_16k/average_l0_20
Load this SAE
blocks.8.hook_resid_post 16384 none
layer_8/width_16k/average_l0_301
Load this SAE
blocks.8.hook_resid_post 16384 none
layer_8/width_16k/average_l0_37
Load this SAE
blocks.8.hook_resid_post 16384 none
layer_8/width_16k/average_l0_71
Load this SAE
blocks.8.hook_resid_post 16384 none
layer_9/width_16k/average_l0_151
Load this SAE
blocks.9.hook_resid_post 16384 none
layer_9/width_16k/average_l0_21
Load this SAE
blocks.9.hook_resid_post 16384 none
layer_9/width_16k/average_l0_340
Load this SAE
blocks.9.hook_resid_post 16384 none
layer_9/width_16k/average_l0_37
Load this SAE
blocks.9.hook_resid_post 16384 none
layer_9/width_16k/average_l0_73
Load this SAE
blocks.9.hook_resid_post 16384 none
layer_10/width_16k/average_l0_166
Load this SAE
blocks.10.hook_resid_post 16384 none
layer_10/width_16k/average_l0_21
Load this SAE
blocks.10.hook_resid_post 16384 none
layer_10/width_16k/average_l0_39
Load this SAE
blocks.10.hook_resid_post 16384 none
layer_10/width_16k/average_l0_395
Load this SAE
blocks.10.hook_resid_post 16384 none
layer_10/width_16k/average_l0_77
Load this SAE
blocks.10.hook_resid_post 16384 none
layer_11/width_16k/average_l0_168
Load this SAE
blocks.11.hook_resid_post 16384 none
layer_11/width_16k/average_l0_22
Load this SAE
blocks.11.hook_resid_post 16384 none
layer_11/width_16k/average_l0_393
Load this SAE
blocks.11.hook_resid_post 16384 none
layer_11/width_16k/average_l0_41
Load this SAE
blocks.11.hook_resid_post 16384 none
layer_11/width_16k/average_l0_80
Load this SAE
blocks.11.hook_resid_post 16384 none
layer_12/width_16k/average_l0_176
Load this SAE
gemma-2-2b/12-gemmascope-res-16k__l0-176 blocks.12.hook_resid_post 16384 none
layer_12/width_16k/average_l0_22
Load this SAE
gemma-2-2b/12-gemmascope-res-16k__l0-22 blocks.12.hook_resid_post 16384 none
layer_12/width_16k/average_l0_41
Load this SAE
gemma-2-2b/12-gemmascope-res-16k__l0-41 blocks.12.hook_resid_post 16384 none
layer_12/width_16k/average_l0_445
Load this SAE
gemma-2-2b/12-gemmascope-res-16k__l0-445 blocks.12.hook_resid_post 16384 none
layer_12/width_16k/average_l0_82
Load this SAE
blocks.12.hook_resid_post 16384 none
layer_13/width_16k/average_l0_173
Load this SAE
blocks.13.hook_resid_post 16384 none
layer_13/width_16k/average_l0_23
Load this SAE
blocks.13.hook_resid_post 16384 none
layer_13/width_16k/average_l0_403
Load this SAE
blocks.13.hook_resid_post 16384 none
layer_13/width_16k/average_l0_43
Load this SAE
blocks.13.hook_resid_post 16384 none
layer_13/width_16k/average_l0_83
Load this SAE
blocks.13.hook_resid_post 16384 none
layer_13/width_16k/average_l0_84
Load this SAE
blocks.13.hook_resid_post 16384 none
layer_14/width_16k/average_l0_173
Load this SAE
blocks.14.hook_resid_post 16384 none
layer_14/width_16k/average_l0_23
Load this SAE
blocks.14.hook_resid_post 16384 none
layer_14/width_16k/average_l0_388
Load this SAE
blocks.14.hook_resid_post 16384 none
layer_14/width_16k/average_l0_43
Load this SAE
blocks.14.hook_resid_post 16384 none
layer_14/width_16k/average_l0_83
Load this SAE
blocks.14.hook_resid_post 16384 none
layer_14/width_16k/average_l0_84
Load this SAE
blocks.14.hook_resid_post 16384 none
layer_15/width_16k/average_l0_150
Load this SAE
blocks.15.hook_resid_post 16384 none
layer_15/width_16k/average_l0_23
Load this SAE
blocks.15.hook_resid_post 16384 none
layer_15/width_16k/average_l0_308
Load this SAE
blocks.15.hook_resid_post 16384 none
layer_15/width_16k/average_l0_41
Load this SAE
blocks.15.hook_resid_post 16384 none
layer_15/width_16k/average_l0_78
Load this SAE
blocks.15.hook_resid_post 16384 none
layer_16/width_16k/average_l0_154
Load this SAE
blocks.16.hook_resid_post 16384 none
layer_16/width_16k/average_l0_23
Load this SAE
blocks.16.hook_resid_post 16384 none
layer_16/width_16k/average_l0_335
Load this SAE
blocks.16.hook_resid_post 16384 none
layer_16/width_16k/average_l0_42
Load this SAE
blocks.16.hook_resid_post 16384 none
layer_16/width_16k/average_l0_78
Load this SAE
blocks.16.hook_resid_post 16384 none
layer_17/width_16k/average_l0_150
Load this SAE
blocks.17.hook_resid_post 16384 none
layer_17/width_16k/average_l0_23
Load this SAE
blocks.17.hook_resid_post 16384 none
layer_17/width_16k/average_l0_304
Load this SAE
blocks.17.hook_resid_post 16384 none
layer_17/width_16k/average_l0_42
Load this SAE
blocks.17.hook_resid_post 16384 none
layer_17/width_16k/average_l0_77
Load this SAE
blocks.17.hook_resid_post 16384 none
layer_18/width_16k/average_l0_138
Load this SAE
blocks.18.hook_resid_post 16384 none
layer_18/width_16k/average_l0_23
Load this SAE
blocks.18.hook_resid_post 16384 none
layer_18/width_16k/average_l0_280
Load this SAE
blocks.18.hook_resid_post 16384 none
layer_18/width_16k/average_l0_40
Load this SAE
blocks.18.hook_resid_post 16384 none
layer_18/width_16k/average_l0_74
Load this SAE
blocks.18.hook_resid_post 16384 none
layer_19/width_16k/average_l0_137
Load this SAE
gemma-2-2b/19-gemmascope-res-16k__l0-137 blocks.19.hook_resid_post 16384 none
layer_19/width_16k/average_l0_23
Load this SAE
gemma-2-2b/19-gemmascope-res-16k__l0-23 blocks.19.hook_resid_post 16384 none
layer_19/width_16k/average_l0_279
Load this SAE
gemma-2-2b/19-gemmascope-res-16k__l0-279 blocks.19.hook_resid_post 16384 none
layer_19/width_16k/average_l0_40
Load this SAE
gemma-2-2b/19-gemmascope-res-16k__l0-40 blocks.19.hook_resid_post 16384 none
layer_19/width_16k/average_l0_73
Load this SAE
blocks.19.hook_resid_post 16384 none
layer_20/width_16k/average_l0_139
Load this SAE
blocks.20.hook_resid_post 16384 none
layer_20/width_16k/average_l0_22
Load this SAE
blocks.20.hook_resid_post 16384 none
layer_20/width_16k/average_l0_294
Load this SAE
blocks.20.hook_resid_post 16384 none
layer_20/width_16k/average_l0_38
Load this SAE
blocks.20.hook_resid_post 16384 none
layer_20/width_16k/average_l0_71
Load this SAE
blocks.20.hook_resid_post 16384 none
layer_21/width_16k/average_l0_139
Load this SAE
blocks.21.hook_resid_post 16384 none
layer_21/width_16k/average_l0_22
Load this SAE
blocks.21.hook_resid_post 16384 none
layer_21/width_16k/average_l0_301
Load this SAE
blocks.21.hook_resid_post 16384 none
layer_21/width_16k/average_l0_38
Load this SAE
blocks.21.hook_resid_post 16384 none
layer_21/width_16k/average_l0_70
Load this SAE
blocks.21.hook_resid_post 16384 none
layer_22/width_16k/average_l0_147
Load this SAE
blocks.22.hook_resid_post 16384 none
layer_22/width_16k/average_l0_21
Load this SAE
blocks.22.hook_resid_post 16384 none
layer_22/width_16k/average_l0_349
Load this SAE
blocks.22.hook_resid_post 16384 none
layer_22/width_16k/average_l0_38
Load this SAE
blocks.22.hook_resid_post 16384 none
layer_22/width_16k/average_l0_72
Load this SAE
blocks.22.hook_resid_post 16384 none
layer_23/width_16k/average_l0_157
Load this SAE
blocks.23.hook_resid_post 16384 none
layer_23/width_16k/average_l0_21
Load this SAE
blocks.23.hook_resid_post 16384 none
layer_23/width_16k/average_l0_38
Load this SAE
blocks.23.hook_resid_post 16384 none
layer_23/width_16k/average_l0_404
Load this SAE
blocks.23.hook_resid_post 16384 none
layer_23/width_16k/average_l0_74
Load this SAE
blocks.23.hook_resid_post 16384 none
layer_23/width_16k/average_l0_75
Load this SAE
blocks.23.hook_resid_post 16384 none
layer_24/width_16k/average_l0_158
Load this SAE
blocks.24.hook_resid_post 16384 none
layer_24/width_16k/average_l0_20
Load this SAE
blocks.24.hook_resid_post 16384 none
layer_24/width_16k/average_l0_38
Load this SAE
blocks.24.hook_resid_post 16384 none
layer_24/width_16k/average_l0_457
Load this SAE
blocks.24.hook_resid_post 16384 none
layer_24/width_16k/average_l0_73
Load this SAE
blocks.24.hook_resid_post 16384 none
layer_25/width_16k/average_l0_116
Load this SAE
blocks.25.hook_resid_post 16384 none
layer_25/width_16k/average_l0_16
Load this SAE
blocks.25.hook_resid_post 16384 none
layer_25/width_16k/average_l0_28
Load this SAE
blocks.25.hook_resid_post 16384 none
layer_25/width_16k/average_l0_285
Load this SAE
blocks.25.hook_resid_post 16384 none
layer_25/width_16k/average_l0_55
Load this SAE
blocks.25.hook_resid_post 16384 none
layer_5/width_1m/average_l0_114
Load this SAE
gemma-2-2b/5-gemmascope-res-1m__l0-114 blocks.5.hook_resid_post 1048576 none
layer_5/width_1m/average_l0_13
Load this SAE
gemma-2-2b/5-gemmascope-res-1m__l0-13 blocks.5.hook_resid_post 1048576 none
layer_5/width_1m/average_l0_21
Load this SAE
gemma-2-2b/5-gemmascope-res-1m__l0-21 blocks.5.hook_resid_post 1048576 none
layer_5/width_1m/average_l0_36
Load this SAE
gemma-2-2b/5-gemmascope-res-1m__l0-36 blocks.5.hook_resid_post 1048576 none
layer_5/width_1m/average_l0_63
Load this SAE
gemma-2-2b/5-gemmascope-res-1m__l0-63 blocks.5.hook_resid_post 1048576 none
layer_5/width_1m/average_l0_9
Load this SAE
gemma-2-2b/5-gemmascope-res-1m__l0-9 blocks.5.hook_resid_post 1048576 none
layer_12/width_1m/average_l0_107
Load this SAE
blocks.12.hook_resid_post 1048576 none
layer_12/width_1m/average_l0_19
Load this SAE
gemma-2-2b/12-gemmascope-res-1m__l0-19 blocks.12.hook_resid_post 1048576 none
layer_12/width_1m/average_l0_207
Load this SAE
gemma-2-2b/12-gemmascope-res-1m__l0-207 blocks.12.hook_resid_post 1048576 none
layer_12/width_1m/average_l0_26
Load this SAE
gemma-2-2b/12-gemmascope-res-1m__l0-26 blocks.12.hook_resid_post 1048576 none
layer_12/width_1m/average_l0_58
Load this SAE
gemma-2-2b/12-gemmascope-res-1m__l0-58 blocks.12.hook_resid_post 1048576 none
layer_12/width_1m/average_l0_73
Load this SAE
gemma-2-2b/12-gemmascope-res-1m__l0-73 blocks.12.hook_resid_post 1048576 none
layer_19/width_1m/average_l0_157
Load this SAE
gemma-2-2b/19-gemmascope-res-1m__l0-157 blocks.19.hook_resid_post 1048576 none
layer_19/width_1m/average_l0_16
Load this SAE
gemma-2-2b/19-gemmascope-res-1m__l0-16 blocks.19.hook_resid_post 1048576 none
layer_19/width_1m/average_l0_18
Load this SAE
gemma-2-2b/19-gemmascope-res-1m__l0-18 blocks.19.hook_resid_post 1048576 none
layer_19/width_1m/average_l0_29
Load this SAE
gemma-2-2b/19-gemmascope-res-1m__l0-29 blocks.19.hook_resid_post 1048576 none
layer_19/width_1m/average_l0_50
Load this SAE
gemma-2-2b/19-gemmascope-res-1m__l0-50 blocks.19.hook_resid_post 1048576 none
layer_19/width_1m/average_l0_88
Load this SAE
blocks.19.hook_resid_post 1048576 none
layer_12/width_262k/average_l0_11
Load this SAE
blocks.12.hook_resid_post 262144 none
layer_12/width_262k/average_l0_121
Load this SAE
blocks.12.hook_resid_post 262144 none
layer_12/width_262k/average_l0_21
Load this SAE
blocks.12.hook_resid_post 262144 none
layer_12/width_262k/average_l0_243
Load this SAE
blocks.12.hook_resid_post 262144 none
layer_12/width_262k/average_l0_36
Load this SAE
blocks.12.hook_resid_post 262144 none
layer_12/width_262k/average_l0_67
Load this SAE
blocks.12.hook_resid_post 262144 none
layer_12/width_32k/average_l0_12
Load this SAE
blocks.12.hook_resid_post 32768 none
layer_12/width_32k/average_l0_155
Load this SAE
blocks.12.hook_resid_post 32768 none
layer_12/width_32k/average_l0_22
Load this SAE
blocks.12.hook_resid_post 32768 none
layer_12/width_32k/average_l0_360
Load this SAE
blocks.12.hook_resid_post 32768 none
layer_12/width_32k/average_l0_40
Load this SAE
blocks.12.hook_resid_post 32768 none
layer_12/width_32k/average_l0_76
Load this SAE
blocks.12.hook_resid_post 32768 none
layer_12/width_524k/average_l0_115
Load this SAE
blocks.12.hook_resid_post 524288 none
layer_12/width_524k/average_l0_22
Load this SAE
blocks.12.hook_resid_post 524288 none
layer_12/width_524k/average_l0_227
Load this SAE
blocks.12.hook_resid_post 524288 none
layer_12/width_524k/average_l0_29
Load this SAE
blocks.12.hook_resid_post 524288 none
layer_12/width_524k/average_l0_46
Load this SAE
blocks.12.hook_resid_post 524288 none
layer_12/width_524k/average_l0_65
Load this SAE
blocks.12.hook_resid_post 524288 none
layer_12/width_131k/average_l0_12
Load this SAE
blocks.12.hook_resid_post 131072 none
layer_12/width_131k/average_l0_129
Load this SAE
blocks.12.hook_resid_post 131072 none
layer_12/width_131k/average_l0_20
Load this SAE
blocks.12.hook_resid_post 131072 none
layer_12/width_131k/average_l0_264
Load this SAE
blocks.12.hook_resid_post 131072 none
layer_12/width_131k/average_l0_36
Load this SAE
blocks.12.hook_resid_post 131072 none
layer_12/width_131k/average_l0_67
Load this SAE
blocks.12.hook_resid_post 131072 none
layer_0/width_65k/average_l0_11
Load this SAE
blocks.0.hook_resid_post 65536 none
layer_0/width_65k/average_l0_17
Load this SAE
blocks.0.hook_resid_post 65536 none
layer_0/width_65k/average_l0_27
Load this SAE
blocks.0.hook_resid_post 65536 none
layer_0/width_65k/average_l0_43
Load this SAE
blocks.0.hook_resid_post 65536 none
layer_0/width_65k/average_l0_73
Load this SAE
blocks.0.hook_resid_post 65536 none
layer_1/width_65k/average_l0_121
Load this SAE
blocks.1.hook_resid_post 65536 none
layer_1/width_65k/average_l0_16
Load this SAE
blocks.1.hook_resid_post 65536 none
layer_1/width_65k/average_l0_30
Load this SAE
blocks.1.hook_resid_post 65536 none
layer_1/width_65k/average_l0_54
Load this SAE
blocks.1.hook_resid_post 65536 none
layer_1/width_65k/average_l0_9
Load this SAE
blocks.1.hook_resid_post 65536 none
layer_2/width_65k/average_l0_11
Load this SAE
blocks.2.hook_resid_post 65536 none
layer_2/width_65k/average_l0_169
Load this SAE
blocks.2.hook_resid_post 65536 none
layer_2/width_65k/average_l0_20
Load this SAE
blocks.2.hook_resid_post 65536 none
layer_2/width_65k/average_l0_37
Load this SAE
blocks.2.hook_resid_post 65536 none
layer_2/width_65k/average_l0_77
Load this SAE
blocks.2.hook_resid_post 65536 none
layer_3/width_65k/average_l0_13
Load this SAE
blocks.3.hook_resid_post 65536 none
layer_3/width_65k/average_l0_193
Load this SAE
blocks.3.hook_resid_post 65536 none
layer_3/width_65k/average_l0_23
Load this SAE
blocks.3.hook_resid_post 65536 none
layer_3/width_65k/average_l0_42
Load this SAE
blocks.3.hook_resid_post 65536 none
layer_3/width_65k/average_l0_89
Load this SAE
blocks.3.hook_resid_post 65536 none
layer_4/width_65k/average_l0_14
Load this SAE
blocks.4.hook_resid_post 65536 none
layer_4/width_65k/average_l0_177
Load this SAE
blocks.4.hook_resid_post 65536 none
layer_4/width_65k/average_l0_25
Load this SAE
blocks.4.hook_resid_post 65536 none
layer_4/width_65k/average_l0_46
Load this SAE
blocks.4.hook_resid_post 65536 none
layer_4/width_65k/average_l0_89
Load this SAE
blocks.4.hook_resid_post 65536 none
layer_5/width_65k/average_l0_105
Load this SAE
blocks.5.hook_resid_post 65536 none
layer_5/width_65k/average_l0_17
Load this SAE
gemma-2-2b/5-gemmascope-res-65k__l0-17 blocks.5.hook_resid_post 65536 none
layer_5/width_65k/average_l0_211
Load this SAE
gemma-2-2b/5-gemmascope-res-65k__l0-211 blocks.5.hook_resid_post 65536 none
layer_5/width_65k/average_l0_29
Load this SAE
gemma-2-2b/5-gemmascope-res-65k__l0-29 blocks.5.hook_resid_post 65536 none
layer_5/width_65k/average_l0_53
Load this SAE
gemma-2-2b/5-gemmascope-res-65k__l0-53 blocks.5.hook_resid_post 65536 none
layer_6/width_65k/average_l0_107
Load this SAE
blocks.6.hook_resid_post 65536 none
layer_6/width_65k/average_l0_17
Load this SAE
blocks.6.hook_resid_post 65536 none
layer_6/width_65k/average_l0_208
Load this SAE
blocks.6.hook_resid_post 65536 none
layer_6/width_65k/average_l0_30
Load this SAE
blocks.6.hook_resid_post 65536 none
layer_6/width_65k/average_l0_56
Load this SAE
blocks.6.hook_resid_post 65536 none
layer_7/width_65k/average_l0_107
Load this SAE
blocks.7.hook_resid_post 65536 none
layer_7/width_65k/average_l0_18
Load this SAE
blocks.7.hook_resid_post 65536 none
layer_7/width_65k/average_l0_203
Load this SAE
blocks.7.hook_resid_post 65536 none
layer_7/width_65k/average_l0_31
Load this SAE
blocks.7.hook_resid_post 65536 none
layer_7/width_65k/average_l0_57
Load this SAE
blocks.7.hook_resid_post 65536 none
layer_8/width_65k/average_l0_111
Load this SAE
blocks.8.hook_resid_post 65536 none
layer_8/width_65k/average_l0_19
Load this SAE
blocks.8.hook_resid_post 65536 none
layer_8/width_65k/average_l0_213
Load this SAE
blocks.8.hook_resid_post 65536 none
layer_8/width_65k/average_l0_33
Load this SAE
blocks.8.hook_resid_post 65536 none
layer_8/width_65k/average_l0_59
Load this SAE
blocks.8.hook_resid_post 65536 none
layer_9/width_65k/average_l0_118
Load this SAE
blocks.9.hook_resid_post 65536 none
layer_9/width_65k/average_l0_19
Load this SAE
blocks.9.hook_resid_post 65536 none
layer_9/width_65k/average_l0_240
Load this SAE
blocks.9.hook_resid_post 65536 none
layer_9/width_65k/average_l0_34
Load this SAE
blocks.9.hook_resid_post 65536 none
layer_9/width_65k/average_l0_61
Load this SAE
blocks.9.hook_resid_post 65536 none
layer_10/width_65k/average_l0_128
Load this SAE
blocks.10.hook_resid_post 65536 none
layer_10/width_65k/average_l0_20
Load this SAE
blocks.10.hook_resid_post 65536 none
layer_10/width_65k/average_l0_265
Load this SAE
blocks.10.hook_resid_post 65536 none
layer_10/width_65k/average_l0_36
Load this SAE
blocks.10.hook_resid_post 65536 none
layer_10/width_65k/average_l0_66
Load this SAE
blocks.10.hook_resid_post 65536 none
layer_11/width_65k/average_l0_134
Load this SAE
blocks.11.hook_resid_post 65536 none
layer_11/width_65k/average_l0_21
Load this SAE
blocks.11.hook_resid_post 65536 none
layer_11/width_65k/average_l0_273
Load this SAE
blocks.11.hook_resid_post 65536 none
layer_11/width_65k/average_l0_37
Load this SAE
blocks.11.hook_resid_post 65536 none
layer_11/width_65k/average_l0_70
Load this SAE
blocks.11.hook_resid_post 65536 none
layer_12/width_65k/average_l0_141
Load this SAE
gemma-2-2b/12-gemmascope-res-65k__l0-141 blocks.12.hook_resid_post 65536 none
layer_12/width_65k/average_l0_21
Load this SAE
gemma-2-2b/12-gemmascope-res-65k__l0-21 blocks.12.hook_resid_post 65536 none
layer_12/width_65k/average_l0_297
Load this SAE
gemma-2-2b/12-gemmascope-res-65k__l0-297 blocks.12.hook_resid_post 65536 none
layer_12/width_65k/average_l0_38
Load this SAE
gemma-2-2b/12-gemmascope-res-65k__l0-38 blocks.12.hook_resid_post 65536 none
layer_12/width_65k/average_l0_72
Load this SAE
blocks.12.hook_resid_post 65536 none
layer_13/width_65k/average_l0_142
Load this SAE
blocks.13.hook_resid_post 65536 none
layer_13/width_65k/average_l0_22
Load this SAE
blocks.13.hook_resid_post 65536 none
layer_13/width_65k/average_l0_288
Load this SAE
blocks.13.hook_resid_post 65536 none
layer_13/width_65k/average_l0_40
Load this SAE
blocks.13.hook_resid_post 65536 none
layer_13/width_65k/average_l0_74
Load this SAE
blocks.13.hook_resid_post 65536 none
layer_13/width_65k/average_l0_75
Load this SAE
blocks.13.hook_resid_post 65536 none
layer_14/width_65k/average_l0_144
Load this SAE
blocks.14.hook_resid_post 65536 none
layer_14/width_65k/average_l0_21
Load this SAE
blocks.14.hook_resid_post 65536 none
layer_14/width_65k/average_l0_284
Load this SAE
blocks.14.hook_resid_post 65536 none
layer_14/width_65k/average_l0_40
Load this SAE
blocks.14.hook_resid_post 65536 none
layer_14/width_65k/average_l0_73
Load this SAE
blocks.14.hook_resid_post 65536 none
layer_15/width_65k/average_l0_127
Load this SAE
blocks.15.hook_resid_post 65536 none
layer_15/width_65k/average_l0_21
Load this SAE
blocks.15.hook_resid_post 65536 none
layer_15/width_65k/average_l0_240
Load this SAE
blocks.15.hook_resid_post 65536 none
layer_15/width_65k/average_l0_38
Load this SAE
blocks.15.hook_resid_post 65536 none
layer_15/width_65k/average_l0_68
Load this SAE
blocks.15.hook_resid_post 65536 none
layer_16/width_65k/average_l0_128
Load this SAE
blocks.16.hook_resid_post 65536 none
layer_16/width_65k/average_l0_21
Load this SAE
blocks.16.hook_resid_post 65536 none
layer_16/width_65k/average_l0_244
Load this SAE
blocks.16.hook_resid_post 65536 none
layer_16/width_65k/average_l0_38
Load this SAE
blocks.16.hook_resid_post 65536 none
layer_16/width_65k/average_l0_69
Load this SAE
blocks.16.hook_resid_post 65536 none
layer_17/width_65k/average_l0_125
Load this SAE
blocks.17.hook_resid_post 65536 none
layer_17/width_65k/average_l0_21
Load this SAE
blocks.17.hook_resid_post 65536 none
layer_17/width_65k/average_l0_233
Load this SAE
blocks.17.hook_resid_post 65536 none
layer_17/width_65k/average_l0_38
Load this SAE
blocks.17.hook_resid_post 65536 none
layer_17/width_65k/average_l0_68
Load this SAE
blocks.17.hook_resid_post 65536 none
layer_18/width_65k/average_l0_116
Load this SAE
blocks.18.hook_resid_post 65536 none
layer_18/width_65k/average_l0_117
Load this SAE
blocks.18.hook_resid_post 65536 none
layer_18/width_65k/average_l0_21
Load this SAE
blocks.18.hook_resid_post 65536 none
layer_18/width_65k/average_l0_216
Load this SAE
blocks.18.hook_resid_post 65536 none
layer_18/width_65k/average_l0_36
Load this SAE
blocks.18.hook_resid_post 65536 none
layer_18/width_65k/average_l0_64
Load this SAE
blocks.18.hook_resid_post 65536 none
layer_19/width_65k/average_l0_115
Load this SAE
blocks.19.hook_resid_post 65536 none
layer_19/width_65k/average_l0_21
Load this SAE
gemma-2-2b/19-gemmascope-res-65k__l0-21 blocks.19.hook_resid_post 65536 none
layer_19/width_65k/average_l0_216
Load this SAE
gemma-2-2b/19-gemmascope-res-65k__l0-216 blocks.19.hook_resid_post 65536 none
layer_19/width_65k/average_l0_35
Load this SAE
gemma-2-2b/19-gemmascope-res-65k__l0-35 blocks.19.hook_resid_post 65536 none
layer_19/width_65k/average_l0_63
Load this SAE
gemma-2-2b/19-gemmascope-res-65k__l0-63 blocks.19.hook_resid_post 65536 none
layer_20/width_65k/average_l0_114
Load this SAE
blocks.20.hook_resid_post 65536 none
layer_20/width_65k/average_l0_20
Load this SAE
blocks.20.hook_resid_post 65536 none
layer_20/width_65k/average_l0_221
Load this SAE
blocks.20.hook_resid_post 65536 none
layer_20/width_65k/average_l0_34
Load this SAE
blocks.20.hook_resid_post 65536 none
layer_20/width_65k/average_l0_61
Load this SAE
blocks.20.hook_resid_post 65536 none
layer_21/width_65k/average_l0_111
Load this SAE
blocks.21.hook_resid_post 65536 none
layer_21/width_65k/average_l0_112
Load this SAE
blocks.21.hook_resid_post 65536 none
layer_21/width_65k/average_l0_20
Load this SAE
blocks.21.hook_resid_post 65536 none
layer_21/width_65k/average_l0_225
Load this SAE
blocks.21.hook_resid_post 65536 none
layer_21/width_65k/average_l0_33
Load this SAE
blocks.21.hook_resid_post 65536 none
layer_21/width_65k/average_l0_61
Load this SAE
blocks.21.hook_resid_post 65536 none
layer_22/width_65k/average_l0_116
Load this SAE
blocks.22.hook_resid_post 65536 none
layer_22/width_65k/average_l0_117
Load this SAE
blocks.22.hook_resid_post 65536 none
layer_22/width_65k/average_l0_20
Load this SAE
blocks.22.hook_resid_post 65536 none
layer_22/width_65k/average_l0_248
Load this SAE
blocks.22.hook_resid_post 65536 none
layer_22/width_65k/average_l0_33
Load this SAE
blocks.22.hook_resid_post 65536 none
layer_22/width_65k/average_l0_62
Load this SAE
blocks.22.hook_resid_post 65536 none
layer_23/width_65k/average_l0_123
Load this SAE
blocks.23.hook_resid_post 65536 none
layer_23/width_65k/average_l0_124
Load this SAE
blocks.23.hook_resid_post 65536 none
layer_23/width_65k/average_l0_20
Load this SAE
blocks.23.hook_resid_post 65536 none
layer_23/width_65k/average_l0_272
Load this SAE
blocks.23.hook_resid_post 65536 none
layer_23/width_65k/average_l0_35
Load this SAE
blocks.23.hook_resid_post 65536 none
layer_23/width_65k/average_l0_64
Load this SAE
blocks.23.hook_resid_post 65536 none
layer_24/width_65k/average_l0_124
Load this SAE
blocks.24.hook_resid_post 65536 none
layer_24/width_65k/average_l0_19
Load this SAE
blocks.24.hook_resid_post 65536 none
layer_24/width_65k/average_l0_273
Load this SAE
blocks.24.hook_resid_post 65536 none
layer_24/width_65k/average_l0_34
Load this SAE
blocks.24.hook_resid_post 65536 none
layer_24/width_65k/average_l0_63
Load this SAE
blocks.24.hook_resid_post 65536 none
layer_25/width_65k/average_l0_15
Load this SAE
blocks.25.hook_resid_post 65536 none
layer_25/width_65k/average_l0_197
Load this SAE
blocks.25.hook_resid_post 65536 none
layer_25/width_65k/average_l0_26
Load this SAE
blocks.25.hook_resid_post 65536 none
layer_25/width_65k/average_l0_48
Load this SAE
blocks.25.hook_resid_post 65536 none
layer_25/width_65k/average_l0_93
Load this SAE
blocks.25.hook_resid_post 65536 none

gemma-scope-2b-pt-res-canonical

id neuronpedia hook_name d_sae normalize_activations
layer_0/width_16k/canonical
Load this SAE
gemma-2-2b/0-gemmascope-res-16k blocks.0.hook_resid_post 16384 none
layer_1/width_16k/canonical
Load this SAE
gemma-2-2b/1-gemmascope-res-16k blocks.1.hook_resid_post 16384 none
layer_2/width_16k/canonical
Load this SAE
gemma-2-2b/2-gemmascope-res-16k blocks.2.hook_resid_post 16384 none
layer_3/width_16k/canonical
Load this SAE
gemma-2-2b/3-gemmascope-res-16k blocks.3.hook_resid_post 16384 none
layer_4/width_16k/canonical
Load this SAE
gemma-2-2b/4-gemmascope-res-16k blocks.4.hook_resid_post 16384 none
layer_5/width_16k/canonical
Load this SAE
gemma-2-2b/5-gemmascope-res-16k blocks.5.hook_resid_post 16384 none
layer_6/width_16k/canonical
Load this SAE
gemma-2-2b/6-gemmascope-res-16k blocks.6.hook_resid_post 16384 none
layer_7/width_16k/canonical
Load this SAE
gemma-2-2b/7-gemmascope-res-16k blocks.7.hook_resid_post 16384 none
layer_8/width_16k/canonical
Load this SAE
gemma-2-2b/8-gemmascope-res-16k blocks.8.hook_resid_post 16384 none
layer_9/width_16k/canonical
Load this SAE
gemma-2-2b/9-gemmascope-res-16k blocks.9.hook_resid_post 16384 none
layer_10/width_16k/canonical
Load this SAE
gemma-2-2b/10-gemmascope-res-16k blocks.10.hook_resid_post 16384 none
layer_11/width_16k/canonical
Load this SAE
gemma-2-2b/11-gemmascope-res-16k blocks.11.hook_resid_post 16384 none
layer_12/width_16k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-res-16k blocks.12.hook_resid_post 16384 none
layer_13/width_16k/canonical
Load this SAE
gemma-2-2b/13-gemmascope-res-16k blocks.13.hook_resid_post 16384 none
layer_14/width_16k/canonical
Load this SAE
gemma-2-2b/14-gemmascope-res-16k blocks.14.hook_resid_post 16384 none
layer_15/width_16k/canonical
Load this SAE
gemma-2-2b/15-gemmascope-res-16k blocks.15.hook_resid_post 16384 none
layer_16/width_16k/canonical
Load this SAE
gemma-2-2b/16-gemmascope-res-16k blocks.16.hook_resid_post 16384 none
layer_17/width_16k/canonical
Load this SAE
gemma-2-2b/17-gemmascope-res-16k blocks.17.hook_resid_post 16384 none
layer_18/width_16k/canonical
Load this SAE
gemma-2-2b/18-gemmascope-res-16k blocks.18.hook_resid_post 16384 none
layer_19/width_16k/canonical
Load this SAE
gemma-2-2b/19-gemmascope-res-16k blocks.19.hook_resid_post 16384 none
layer_20/width_16k/canonical
Load this SAE
gemma-2-2b/20-gemmascope-res-16k blocks.20.hook_resid_post 16384 none
layer_21/width_16k/canonical
Load this SAE
gemma-2-2b/21-gemmascope-res-16k blocks.21.hook_resid_post 16384 none
layer_22/width_16k/canonical
Load this SAE
gemma-2-2b/22-gemmascope-res-16k blocks.22.hook_resid_post 16384 none
layer_23/width_16k/canonical
Load this SAE
gemma-2-2b/23-gemmascope-res-16k blocks.23.hook_resid_post 16384 none
layer_24/width_16k/canonical
Load this SAE
gemma-2-2b/24-gemmascope-res-16k blocks.24.hook_resid_post 16384 none
layer_25/width_16k/canonical
Load this SAE
gemma-2-2b/25-gemmascope-res-16k blocks.25.hook_resid_post 16384 none
layer_5/width_1m/canonical
Load this SAE
gemma-2-2b/5-gemmascope-res-1m blocks.5.hook_resid_post 1048576 none
layer_12/width_1m/canonical
Load this SAE
gemma-2-2b/12-gemmascope-res-1m blocks.12.hook_resid_post 1048576 none
layer_19/width_1m/canonical
Load this SAE
gemma-2-2b/19-gemmascope-res-1m blocks.19.hook_resid_post 1048576 none
layer_12/width_262k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-res-262k blocks.12.hook_resid_post 262144 none
layer_12/width_32k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-res-32k blocks.12.hook_resid_post 32768 none
layer_12/width_524k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-res-524k blocks.12.hook_resid_post 524288 none
layer_0/width_65k/canonical
Load this SAE
gemma-2-2b/0-gemmascope-res-65k blocks.0.hook_resid_post 65536 none
layer_1/width_65k/canonical
Load this SAE
gemma-2-2b/1-gemmascope-res-65k blocks.1.hook_resid_post 65536 none
layer_2/width_65k/canonical
Load this SAE
gemma-2-2b/2-gemmascope-res-65k blocks.2.hook_resid_post 65536 none
layer_3/width_65k/canonical
Load this SAE
gemma-2-2b/3-gemmascope-res-65k blocks.3.hook_resid_post 65536 none
layer_4/width_65k/canonical
Load this SAE
gemma-2-2b/4-gemmascope-res-65k blocks.4.hook_resid_post 65536 none
layer_5/width_65k/canonical
Load this SAE
gemma-2-2b/5-gemmascope-res-65k blocks.5.hook_resid_post 65536 none
layer_6/width_65k/canonical
Load this SAE
gemma-2-2b/6-gemmascope-res-65k blocks.6.hook_resid_post 65536 none
layer_7/width_65k/canonical
Load this SAE
gemma-2-2b/7-gemmascope-res-65k blocks.7.hook_resid_post 65536 none
layer_8/width_65k/canonical
Load this SAE
gemma-2-2b/8-gemmascope-res-65k blocks.8.hook_resid_post 65536 none
layer_9/width_65k/canonical
Load this SAE
gemma-2-2b/9-gemmascope-res-65k blocks.9.hook_resid_post 65536 none
layer_10/width_65k/canonical
Load this SAE
gemma-2-2b/10-gemmascope-res-65k blocks.10.hook_resid_post 65536 none
layer_11/width_65k/canonical
Load this SAE
gemma-2-2b/11-gemmascope-res-65k blocks.11.hook_resid_post 65536 none
layer_12/width_65k/canonical
Load this SAE
gemma-2-2b/12-gemmascope-res-65k blocks.12.hook_resid_post 65536 none
layer_13/width_65k/canonical
Load this SAE
gemma-2-2b/13-gemmascope-res-65k blocks.13.hook_resid_post 65536 none
layer_14/width_65k/canonical
Load this SAE
gemma-2-2b/14-gemmascope-res-65k blocks.14.hook_resid_post 65536 none
layer_15/width_65k/canonical
Load this SAE
gemma-2-2b/15-gemmascope-res-65k blocks.15.hook_resid_post 65536 none
layer_16/width_65k/canonical
Load this SAE
gemma-2-2b/16-gemmascope-res-65k blocks.16.hook_resid_post 65536 none
layer_17/width_65k/canonical
Load this SAE
gemma-2-2b/17-gemmascope-res-65k blocks.17.hook_resid_post 65536 none
layer_18/width_65k/canonical
Load this SAE
gemma-2-2b/18-gemmascope-res-65k blocks.18.hook_resid_post 65536 none
layer_19/width_65k/canonical
Load this SAE
gemma-2-2b/19-gemmascope-res-65k blocks.19.hook_resid_post 65536 none
layer_20/width_65k/canonical
Load this SAE
gemma-2-2b/20-gemmascope-res-65k blocks.20.hook_resid_post 65536 none
layer_21/width_65k/canonical
Load this SAE
gemma-2-2b/21-gemmascope-res-65k blocks.21.hook_resid_post 65536 none
layer_22/width_65k/canonical
Load this SAE
gemma-2-2b/22-gemmascope-res-65k blocks.22.hook_resid_post 65536 none
layer_23/width_65k/canonical
Load this SAE
gemma-2-2b/23-gemmascope-res-65k blocks.23.hook_resid_post 65536 none
layer_24/width_65k/canonical
Load this SAE
gemma-2-2b/24-gemmascope-res-65k blocks.24.hook_resid_post 65536 none
layer_25/width_65k/canonical
Load this SAE
gemma-2-2b/25-gemmascope-res-65k blocks.25.hook_resid_post 65536 none

gemma-scope-2b-pt-transcoders

  • Huggingface Repo: google/gemma-scope-2b-pt-transcoders
id neuronpedia hook_name d_sae normalize_activations
layer_0/width_16k/average_l0_76
Load this SAE
gemma-2-2b/0-gemmascope-transcoder-16k blocks.0.ln2.hook_normalized 16384 none
layer_1/width_16k/average_l0_65
Load this SAE
gemma-2-2b/1-gemmascope-transcoder-16k blocks.1.ln2.hook_normalized 16384 none
layer_2/width_16k/average_l0_49
Load this SAE
gemma-2-2b/2-gemmascope-transcoder-16k blocks.2.ln2.hook_normalized 16384 none
layer_3/width_16k/average_l0_54
Load this SAE
gemma-2-2b/3-gemmascope-transcoder-16k blocks.3.ln2.hook_normalized 16384 none
layer_4/width_16k/average_l0_88
Load this SAE
gemma-2-2b/4-gemmascope-transcoder-16k blocks.4.ln2.hook_normalized 16384 none
layer_5/width_16k/average_l0_87
Load this SAE
gemma-2-2b/5-gemmascope-transcoder-16k blocks.5.ln2.hook_normalized 16384 none
layer_6/width_16k/average_l0_95
Load this SAE
gemma-2-2b/6-gemmascope-transcoder-16k blocks.6.ln2.hook_normalized 16384 none
layer_7/width_16k/average_l0_70
Load this SAE
gemma-2-2b/7-gemmascope-transcoder-16k blocks.7.ln2.hook_normalized 16384 none
layer_8/width_16k/average_l0_52
Load this SAE
gemma-2-2b/8-gemmascope-transcoder-16k blocks.8.ln2.hook_normalized 16384 none
layer_9/width_16k/average_l0_72
Load this SAE
gemma-2-2b/9-gemmascope-transcoder-16k blocks.9.ln2.hook_normalized 16384 none
layer_10/width_16k/average_l0_88
Load this SAE
gemma-2-2b/10-gemmascope-transcoder-16k blocks.10.ln2.hook_normalized 16384 none
layer_11/width_16k/average_l0_5
Load this SAE
gemma-2-2b/11-gemmascope-transcoder-16k blocks.11.ln2.hook_normalized 16384 none
layer_12/width_16k/average_l0_6
Load this SAE
gemma-2-2b/12-gemmascope-transcoder-16k blocks.12.ln2.hook_normalized 16384 none
layer_13/width_16k/average_l0_8
Load this SAE
gemma-2-2b/13-gemmascope-transcoder-16k blocks.13.ln2.hook_normalized 16384 none
layer_14/width_16k/average_l0_8
Load this SAE
gemma-2-2b/14-gemmascope-transcoder-16k blocks.14.ln2.hook_normalized 16384 none
layer_15/width_16k/average_l0_8
Load this SAE
gemma-2-2b/15-gemmascope-transcoder-16k blocks.15.ln2.hook_normalized 16384 none
layer_16/width_16k/average_l0_10
Load this SAE
gemma-2-2b/16-gemmascope-transcoder-16k blocks.16.ln2.hook_normalized 16384 none
layer_17/width_16k/average_l0_12
Load this SAE
gemma-2-2b/17-gemmascope-transcoder-16k blocks.17.ln2.hook_normalized 16384 none
layer_18/width_16k/average_l0_13
Load this SAE
gemma-2-2b/18-gemmascope-transcoder-16k blocks.18.ln2.hook_normalized 16384 none
layer_19/width_16k/average_l0_12
Load this SAE
gemma-2-2b/19-gemmascope-transcoder-16k blocks.19.ln2.hook_normalized 16384 none
layer_20/width_16k/average_l0_11
Load this SAE
gemma-2-2b/20-gemmascope-transcoder-16k blocks.20.ln2.hook_normalized 16384 none
layer_21/width_16k/average_l0_13
Load this SAE
gemma-2-2b/21-gemmascope-transcoder-16k blocks.21.ln2.hook_normalized 16384 none
layer_22/width_16k/average_l0_15
Load this SAE
gemma-2-2b/22-gemmascope-transcoder-16k blocks.22.ln2.hook_normalized 16384 none
layer_23/width_16k/average_l0_25
Load this SAE
gemma-2-2b/23-gemmascope-transcoder-16k blocks.23.ln2.hook_normalized 16384 none
layer_24/width_16k/average_l0_37
Load this SAE
gemma-2-2b/24-gemmascope-transcoder-16k blocks.24.ln2.hook_normalized 16384 none
layer_25/width_16k/average_l0_41
Load this SAE
gemma-2-2b/25-gemmascope-transcoder-16k blocks.25.ln2.hook_normalized 16384 none

mntss-gemma-2-2b-2.5m-clt-as-per-layer

  • Huggingface Repo: mntss/clt-gemma-2-2b-2.5M
id neuronpedia hook_name d_sae normalize_activations
layer_0
Load this SAE
gemma-2-2b/0-clt-hp blocks.0.hook_resid_mid 98304 none
layer_1
Load this SAE
gemma-2-2b/1-clt-hp blocks.1.hook_resid_mid 98304 none
layer_2
Load this SAE
gemma-2-2b/2-clt-hp blocks.2.hook_resid_mid 98304 none
layer_3
Load this SAE
gemma-2-2b/3-clt-hp blocks.3.hook_resid_mid 98304 none
layer_4
Load this SAE
gemma-2-2b/4-clt-hp blocks.4.hook_resid_mid 98304 none
layer_5
Load this SAE
gemma-2-2b/5-clt-hp blocks.5.hook_resid_mid 98304 none
layer_6
Load this SAE
gemma-2-2b/6-clt-hp blocks.6.hook_resid_mid 98304 none
layer_7
Load this SAE
gemma-2-2b/7-clt-hp blocks.7.hook_resid_mid 98304 none
layer_8
Load this SAE
gemma-2-2b/8-clt-hp blocks.8.hook_resid_mid 98304 none
layer_9
Load this SAE
gemma-2-2b/9-clt-hp blocks.9.hook_resid_mid 98304 none
layer_10
Load this SAE
gemma-2-2b/10-clt-hp blocks.10.hook_resid_mid 98304 none
layer_11
Load this SAE
gemma-2-2b/11-clt-hp blocks.11.hook_resid_mid 98304 none
layer_12
Load this SAE
gemma-2-2b/12-clt-hp blocks.12.hook_resid_mid 98304 none
layer_13
Load this SAE
gemma-2-2b/13-clt-hp blocks.13.hook_resid_mid 98304 none
layer_14
Load this SAE
gemma-2-2b/14-clt-hp blocks.14.hook_resid_mid 98304 none
layer_15
Load this SAE
gemma-2-2b/15-clt-hp blocks.15.hook_resid_mid 98304 none
layer_16
Load this SAE
gemma-2-2b/16-clt-hp blocks.16.hook_resid_mid 98304 none
layer_17
Load this SAE
gemma-2-2b/17-clt-hp blocks.17.hook_resid_mid 98304 none
layer_18
Load this SAE
gemma-2-2b/18-clt-hp blocks.18.hook_resid_mid 98304 none
layer_19
Load this SAE
gemma-2-2b/19-clt-hp blocks.19.hook_resid_mid 98304 none
layer_20
Load this SAE
gemma-2-2b/20-clt-hp blocks.20.hook_resid_mid 98304 none
layer_21
Load this SAE
gemma-2-2b/21-clt-hp blocks.21.hook_resid_mid 98304 none
layer_22
Load this SAE
gemma-2-2b/22-clt-hp blocks.22.hook_resid_mid 98304 none
layer_23
Load this SAE
gemma-2-2b/23-clt-hp blocks.23.hook_resid_mid 98304 none
layer_24
Load this SAE
gemma-2-2b/24-clt-hp blocks.24.hook_resid_mid 98304 none
layer_25
Load this SAE
gemma-2-2b/25-clt-hp blocks.25.hook_resid_mid 98304 none

sae_bench_gemma-2-2b_topk_width-2pow12_date-1109

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow12_date-1109
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_308
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_97
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_976
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_308
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_97
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_976
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_308
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_97
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_976
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_308
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_97
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_976
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_308
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_97
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_976
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_308
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_97
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_976
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_9765 blocks.12.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_308
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_97
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_976
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_308
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_97
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_976
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_308
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_97
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_976
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_308
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_97
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_976
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_308
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_97
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_976
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_308
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_97
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_976
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_9765 blocks.19.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_308
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_97
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_976
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_308
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_97
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_976
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_308
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_97
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_976
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_308
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_97
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_976
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_308
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_97
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_976
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_308
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_97
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_976
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_9765 blocks.5.hook_resid_post 4096 none

sae_bench_gemma-2-2b_topk_width-2pow14_date-1109

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-1109
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_146
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_463
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_146
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_463
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_146
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_463
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_146
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_463
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_146
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_463
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_146
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_463
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_46322 blocks.12.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_146
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_463
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_146
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_463
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_146
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_463
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_146
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_463
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_146
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_463
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_146
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_463
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_46322 blocks.19.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_146
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_463
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_146
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_463
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_146
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_463
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_146
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_463
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_146
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_463
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_146
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_463
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_46322 blocks.5.hook_resid_post 16384 none

sae_bench_gemma-2-2b_topk_width-2pow16_date-1109

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-1109
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_final blocks.12.hook_resid_post 65536 none
blocks.19.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_final blocks.19.hook_resid_post 64512 none
blocks.5.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_final blocks.5.hook_resid_post 65536 none

sae_bench_gemma-2-2b_vanilla_width-2pow12_date-1109

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow12_date-1109
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_308
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_97
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_976
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_0_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_308
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_97
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_976
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_308
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_97
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_976
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_308
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_97
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_976
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_308
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_97
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_976
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_9765 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_0 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_308
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_308 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_3088
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_3088 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_30881
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_30881 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_97
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_97 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_976
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_976 blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5_step_9765
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_9765 blocks.12.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_308
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_97
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_976
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_0_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_308
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_97
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_976
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_1_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_308
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_97
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_976
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_2_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_308
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_97
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_976
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_3_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_308
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_97
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_976
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_4_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_9765 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_final blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_0 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_308
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_308 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_3088
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_3088 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_30881
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_30881 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_97
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_97 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_976
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_976 blocks.19.hook_resid_post 4096 none
blocks.19.hook_resid_post__trainer_5_step_9765
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_9765 blocks.19.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_308
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_97
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_976
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_0_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_308
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_97
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_976
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_1_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_308
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_97
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_976
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_2_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_308
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_97
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_976
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_3_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_308
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_97
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_976
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_4_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_9765 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_final blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_0 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_308
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_308 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_3088
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_3088 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_30881
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_30881 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_97
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_97 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_976
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_976 blocks.5.hook_resid_post 4096 none
blocks.5.hook_resid_post__trainer_5_step_9765
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_9765 blocks.5.hook_resid_post 4096 none

sae_bench_gemma-2-2b_vanilla_width-2pow14_date-1109

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-1109
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_146
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_463
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_0_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_146
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_463
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_146
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_463
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_146
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_463
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_146
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_463
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_46322 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_0 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_146
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_146 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_1464
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_1464 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_14648
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_14648 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_463
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_463 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_4632
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_4632 blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5_step_46322
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_46322 blocks.12.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_146
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_463
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_0_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_146
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_463
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_1_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_146
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_463
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_2_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_146
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_463
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_3_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_146
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_463
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_4_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_46322 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_final blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_0 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_146
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_146 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_1464
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_1464 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_14648
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_14648 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_463
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_463 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_4632
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_4632 blocks.19.hook_resid_post 16384 none
blocks.19.hook_resid_post__trainer_5_step_46322
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_46322 blocks.19.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_146
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_463
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_0_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_146
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_463
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_1_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_146
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_463
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_2_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_146
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_463
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_3_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_146
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_463
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_4_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_46322 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_final blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_0 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_146
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_146 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_1464
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_1464 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_14648
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_14648 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_463
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_463 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_4632
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_4632 blocks.5.hook_resid_post 16384 none
blocks.5.hook_resid_post__trainer_5_step_46322
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_46322 blocks.5.hook_resid_post 16384 none

sae_bench_gemma-2-2b_vanilla_width-2pow16_date-1109

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-1109
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_final blocks.12.hook_resid_post 65536 none
blocks.19.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_final blocks.19.hook_resid_post 64512 none
blocks.19.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_final blocks.19.hook_resid_post 64512 none
blocks.5.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_final blocks.5.hook_resid_post 65536 none
blocks.5.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_final blocks.5.hook_resid_post 65536 none

saebench_gemma-2-2b_width-2pow12_date-0108

  • Huggingface Repo: adamkarvonen/saebench_gemma-2-2b_width-2pow12_date-0108
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-4k__trainer_0_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-4k__trainer_1_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-4k__trainer_2_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-4k__trainer_3_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-4k__trainer_4_step_final blocks.12.hook_resid_post 4096 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-4k__trainer_5_step_final blocks.12.hook_resid_post 4096 none

saebench_gemma-2-2b_width-2pow14_date-0107

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-0107
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-16k__trainer_0_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-16k__trainer_1_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-16k__trainer_2_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-16k__trainer_3_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-16k__trainer_4_step_final blocks.12.hook_resid_post 16384 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-16k__trainer_5_step_final blocks.12.hook_resid_post 16384 none

saebench_gemma-2-2b_width-2pow16_date-0107

  • Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-0107
  • Additional Links:
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post__trainer_0
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-65k__trainer_0_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_1
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-65k__trainer_1_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_2
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-65k__trainer_2_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_3
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-65k__trainer_3_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_4
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-65k__trainer_4_step_final blocks.12.hook_resid_post 65536 none
blocks.12.hook_resid_post__trainer_5
Load this SAE
gemma-2-2b/12-sae_bench-matryoshka-res-65k__trainer_5_step_final blocks.12.hook_resid_post 65536 none

temporal-sae-gemma-2-2b

  • Huggingface Repo: canrager/temporalSAEs
id neuronpedia hook_name d_sae normalize_activations
blocks.12.hook_resid_post
Load this SAE
gemma-2-2b/12-temporal-res blocks.12.hook_resid_post 9216 constant_scalar_rescale
×