Skip to content

gemma-2-27b

This page lists all pretrained SAEs available for gemma-2-27b.

gemma-scope-27b-pt-res

  • Huggingface Repo: google/gemma-scope-27b-pt-res
id neuronpedia hook_name d_sae normalize_activations
layer_10/width_131k/average_l0_106
Load this SAE
blocks.10.hook_resid_post 131072 none
layer_10/width_131k/average_l0_15
Load this SAE
blocks.10.hook_resid_post 131072 none
layer_10/width_131k/average_l0_200
Load this SAE
blocks.10.hook_resid_post 131072 none
layer_10/width_131k/average_l0_24
Load this SAE
blocks.10.hook_resid_post 131072 none
layer_10/width_131k/average_l0_37
Load this SAE
blocks.10.hook_resid_post 131072 none
layer_10/width_131k/average_l0_64
Load this SAE
blocks.10.hook_resid_post 131072 none
layer_22/width_131k/average_l0_150
Load this SAE
blocks.22.hook_resid_post 131072 none
layer_22/width_131k/average_l0_20
Load this SAE
blocks.22.hook_resid_post 131072 none
layer_22/width_131k/average_l0_290
Load this SAE
blocks.22.hook_resid_post 131072 none
layer_22/width_131k/average_l0_31
Load this SAE
blocks.22.hook_resid_post 131072 none
layer_22/width_131k/average_l0_48
Load this SAE
blocks.22.hook_resid_post 131072 none
layer_22/width_131k/average_l0_82
Load this SAE
blocks.22.hook_resid_post 131072 none
layer_34/width_131k/average_l0_155
Load this SAE
blocks.34.hook_resid_post 131072 none
layer_34/width_131k/average_l0_21
Load this SAE
blocks.34.hook_resid_post 131072 none
layer_34/width_131k/average_l0_333
Load this SAE
blocks.34.hook_resid_post 131072 none
layer_34/width_131k/average_l0_38
Load this SAE
blocks.34.hook_resid_post 131072 none
layer_34/width_131k/average_l0_72
Load this SAE
blocks.34.hook_resid_post 131072 none
layer_34/width_131k/average_l0_785
Load this SAE
blocks.34.hook_resid_post 131072 none

gemma-scope-27b-pt-res-canonical

  • Huggingface Repo: google/gemma-scope-27b-pt-res
id neuronpedia hook_name d_sae normalize_activations
layer_10/width_131k/canonical
Load this SAE
gemma-2-27b/10-gemmascope-res-131k blocks.10.hook_resid_post 131072 none
layer_22/width_131k/canonical
Load this SAE
gemma-2-27b/22-gemmascope-res-131k blocks.22.hook_resid_post 131072 none
layer_34/width_131k/canonical
Load this SAE
gemma-2-27b/34-gemmascope-res-131k blocks.34.hook_resid_post 131072 none
×