gpt2-small
This page lists all pretrained SAEs available for gpt2-small.
gpt2-small-attn-out-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-attn-out-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_attn_out Load this SAE |
gpt2-small/0-att_128k-oai | blocks.0.hook_attn_out | 131072 | layer_norm |
blocks.1.hook_attn_out Load this SAE |
gpt2-small/1-att_128k-oai | blocks.1.hook_attn_out | 131072 | layer_norm |
blocks.2.hook_attn_out Load this SAE |
gpt2-small/2-att_128k-oai | blocks.2.hook_attn_out | 131072 | layer_norm |
blocks.3.hook_attn_out Load this SAE |
gpt2-small/3-att_128k-oai | blocks.3.hook_attn_out | 131072 | layer_norm |
blocks.4.hook_attn_out Load this SAE |
gpt2-small/4-att_128k-oai | blocks.4.hook_attn_out | 131072 | layer_norm |
blocks.5.hook_attn_out Load this SAE |
gpt2-small/5-att_128k-oai | blocks.5.hook_attn_out | 131072 | layer_norm |
blocks.6.hook_attn_out Load this SAE |
gpt2-small/6-att_128k-oai | blocks.6.hook_attn_out | 131072 | layer_norm |
blocks.7.hook_attn_out Load this SAE |
gpt2-small/7-att_128k-oai | blocks.7.hook_attn_out | 131072 | layer_norm |
blocks.8.hook_attn_out Load this SAE |
gpt2-small/8-att_128k-oai | blocks.8.hook_attn_out | 131072 | layer_norm |
blocks.9.hook_attn_out Load this SAE |
gpt2-small/9-att_128k-oai | blocks.9.hook_attn_out | 131072 | layer_norm |
blocks.10.hook_attn_out Load this SAE |
gpt2-small/10-att_128k-oai | blocks.10.hook_attn_out | 131072 | layer_norm |
blocks.11.hook_attn_out Load this SAE |
gpt2-small/11-att_128k-oai | blocks.11.hook_attn_out | 131072 | layer_norm |
gpt2-small-attn-out-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-attn-out-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_attn_out Load this SAE |
gpt2-small/0-att_32k-oai | blocks.0.hook_attn_out | 32768 | layer_norm |
blocks.1.hook_attn_out Load this SAE |
gpt2-small/1-att_32k-oai | blocks.1.hook_attn_out | 32768 | layer_norm |
blocks.2.hook_attn_out Load this SAE |
gpt2-small/2-att_32k-oai | blocks.2.hook_attn_out | 32768 | layer_norm |
blocks.3.hook_attn_out Load this SAE |
gpt2-small/3-att_32k-oai | blocks.3.hook_attn_out | 32768 | layer_norm |
blocks.4.hook_attn_out Load this SAE |
gpt2-small/4-att_32k-oai | blocks.4.hook_attn_out | 32768 | layer_norm |
blocks.5.hook_attn_out Load this SAE |
gpt2-small/5-att_32k-oai | blocks.5.hook_attn_out | 32768 | layer_norm |
blocks.6.hook_attn_out Load this SAE |
gpt2-small/6-att_32k-oai | blocks.6.hook_attn_out | 32768 | layer_norm |
blocks.7.hook_attn_out Load this SAE |
gpt2-small/7-att_32k-oai | blocks.7.hook_attn_out | 32768 | layer_norm |
blocks.8.hook_attn_out Load this SAE |
gpt2-small/8-att_32k-oai | blocks.8.hook_attn_out | 32768 | layer_norm |
blocks.9.hook_attn_out Load this SAE |
gpt2-small/9-att_32k-oai | blocks.9.hook_attn_out | 32768 | layer_norm |
blocks.10.hook_attn_out Load this SAE |
gpt2-small/10-att_32k-oai | blocks.10.hook_attn_out | 32768 | layer_norm |
blocks.11.hook_attn_out Load this SAE |
gpt2-small/11-att_32k-oai | blocks.11.hook_attn_out | 32768 | layer_norm |
gpt2-small-hook-z-kk
- Huggingface Repo: ckkissane/attn-saes-gpt2-small-all-layers
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_z Load this SAE |
gpt2-small/0-att-kk | blocks.0.attn.hook_z | 24576 | none |
blocks.1.hook_z Load this SAE |
gpt2-small/1-att-kk | blocks.1.attn.hook_z | 24576 | none |
blocks.2.hook_z Load this SAE |
gpt2-small/2-att-kk | blocks.2.attn.hook_z | 24576 | none |
blocks.3.hook_z Load this SAE |
gpt2-small/3-att-kk | blocks.3.attn.hook_z | 24576 | none |
blocks.4.hook_z Load this SAE |
gpt2-small/4-att-kk | blocks.4.attn.hook_z | 24576 | none |
blocks.5.hook_z Load this SAE |
gpt2-small/5-att-kk | blocks.5.attn.hook_z | 49152 | none |
blocks.6.hook_z Load this SAE |
gpt2-small/6-att-kk | blocks.6.attn.hook_z | 24576 | none |
blocks.7.hook_z Load this SAE |
gpt2-small/7-att-kk | blocks.7.attn.hook_z | 49152 | none |
blocks.8.hook_z Load this SAE |
gpt2-small/8-att-kk | blocks.8.attn.hook_z | 24576 | none |
blocks.9.hook_z Load this SAE |
gpt2-small/9-att-kk | blocks.9.attn.hook_z | 24576 | none |
blocks.10.hook_z Load this SAE |
gpt2-small/10-att-kk | blocks.10.attn.hook_z | 24576 | none |
blocks.11.hook_z Load this SAE |
gpt2-small/11-att-kk | blocks.11.attn.hook_z | 24576 | none |
gpt2-small-mlp-out-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-mlp-out-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
gpt2-small/0-mlp_128k-oai | blocks.0.hook_mlp_out | 131072 | layer_norm |
blocks.1.hook_mlp_out Load this SAE |
gpt2-small/1-mlp_128k-oai | blocks.1.hook_mlp_out | 131072 | layer_norm |
blocks.2.hook_mlp_out Load this SAE |
gpt2-small/2-mlp_128k-oai | blocks.2.hook_mlp_out | 131072 | layer_norm |
blocks.3.hook_mlp_out Load this SAE |
gpt2-small/3-mlp_128k-oai | blocks.3.hook_mlp_out | 131072 | layer_norm |
blocks.4.hook_mlp_out Load this SAE |
gpt2-small/4-mlp_128k-oai | blocks.4.hook_mlp_out | 131072 | layer_norm |
blocks.5.hook_mlp_out Load this SAE |
gpt2-small/5-mlp_128k-oai | blocks.5.hook_mlp_out | 131072 | layer_norm |
blocks.6.hook_mlp_out Load this SAE |
gpt2-small/6-mlp_128k-oai | blocks.6.hook_mlp_out | 131072 | layer_norm |
blocks.7.hook_mlp_out Load this SAE |
gpt2-small/7-mlp_128k-oai | blocks.7.hook_mlp_out | 131072 | layer_norm |
blocks.8.hook_mlp_out Load this SAE |
gpt2-small/8-mlp_128k-oai | blocks.8.hook_mlp_out | 131072 | layer_norm |
blocks.9.hook_mlp_out Load this SAE |
gpt2-small/9-mlp_128k-oai | blocks.9.hook_mlp_out | 131072 | layer_norm |
blocks.10.hook_mlp_out Load this SAE |
gpt2-small/10-mlp_128k-oai | blocks.10.hook_mlp_out | 131072 | layer_norm |
blocks.11.hook_mlp_out Load this SAE |
gpt2-small/11-mlp_128k-oai | blocks.11.hook_mlp_out | 131072 | layer_norm |
gpt2-small-mlp-out-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-mlp-out-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
gpt2-small/0-mlp_32k-oai | blocks.0.hook_mlp_out | 32768 | layer_norm |
blocks.1.hook_mlp_out Load this SAE |
gpt2-small/1-mlp_32k-oai | blocks.1.hook_mlp_out | 32768 | layer_norm |
blocks.2.hook_mlp_out Load this SAE |
gpt2-small/2-mlp_32k-oai | blocks.2.hook_mlp_out | 32768 | layer_norm |
blocks.3.hook_mlp_out Load this SAE |
gpt2-small/3-mlp_32k-oai | blocks.3.hook_mlp_out | 32768 | layer_norm |
blocks.4.hook_mlp_out Load this SAE |
gpt2-small/4-mlp_32k-oai | blocks.4.hook_mlp_out | 32768 | layer_norm |
blocks.5.hook_mlp_out Load this SAE |
gpt2-small/5-mlp_32k-oai | blocks.5.hook_mlp_out | 32768 | layer_norm |
blocks.6.hook_mlp_out Load this SAE |
gpt2-small/6-mlp_32k-oai | blocks.6.hook_mlp_out | 32768 | layer_norm |
blocks.7.hook_mlp_out Load this SAE |
gpt2-small/7-mlp_32k-oai | blocks.7.hook_mlp_out | 32768 | layer_norm |
blocks.8.hook_mlp_out Load this SAE |
gpt2-small/8-mlp_32k-oai | blocks.8.hook_mlp_out | 32768 | layer_norm |
blocks.9.hook_mlp_out Load this SAE |
gpt2-small/9-mlp_32k-oai | blocks.9.hook_mlp_out | 32768 | layer_norm |
blocks.10.hook_mlp_out Load this SAE |
gpt2-small/10-mlp_32k-oai | blocks.10.hook_mlp_out | 32768 | layer_norm |
blocks.11.hook_mlp_out Load this SAE |
gpt2-small/11-mlp_32k-oai | blocks.11.hook_mlp_out | 32768 | layer_norm |
gpt2-small-mlp-tm
- Huggingface Repo: tommmcgrath/gpt2-small-mlp-out-saes
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_mlp_out Load this SAE |
blocks.0.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.1.hook_mlp_out Load this SAE |
blocks.1.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.2.hook_mlp_out Load this SAE |
blocks.2.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.3.hook_mlp_out Load this SAE |
blocks.3.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.4.hook_mlp_out Load this SAE |
blocks.4.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.5.hook_mlp_out Load this SAE |
blocks.5.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.6.hook_mlp_out Load this SAE |
blocks.6.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.7.hook_mlp_out Load this SAE |
blocks.7.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.8.hook_mlp_out Load this SAE |
blocks.8.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.9.hook_mlp_out Load this SAE |
blocks.9.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.10.hook_mlp_out Load this SAE |
blocks.10.hook_mlp_out | 24576 | expected_average_only_in | |
blocks.11.hook_mlp_out Load this SAE |
blocks.11.hook_mlp_out | 24576 | expected_average_only_in |
gpt2-small-res-jb
- Huggingface Repo: jbloom/GPT2-Small-SAEs-Reformatted
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_resid_pre Load this SAE |
gpt2-small/0-res-jb | blocks.0.hook_resid_pre | 24576 | none |
blocks.1.hook_resid_pre Load this SAE |
gpt2-small/1-res-jb | blocks.1.hook_resid_pre | 24576 | none |
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res-jb | blocks.2.hook_resid_pre | 24576 | none |
blocks.3.hook_resid_pre Load this SAE |
gpt2-small/3-res-jb | blocks.3.hook_resid_pre | 24576 | none |
blocks.4.hook_resid_pre Load this SAE |
gpt2-small/4-res-jb | blocks.4.hook_resid_pre | 24576 | none |
blocks.5.hook_resid_pre Load this SAE |
gpt2-small/5-res-jb | blocks.5.hook_resid_pre | 24576 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res-jb | blocks.6.hook_resid_pre | 24576 | none |
blocks.7.hook_resid_pre Load this SAE |
gpt2-small/7-res-jb | blocks.7.hook_resid_pre | 24576 | none |
blocks.8.hook_resid_pre Load this SAE |
gpt2-small/8-res-jb | blocks.8.hook_resid_pre | 24576 | none |
blocks.9.hook_resid_pre Load this SAE |
gpt2-small/9-res-jb | blocks.9.hook_resid_pre | 24576 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res-jb | blocks.10.hook_resid_pre | 24576 | none |
blocks.11.hook_resid_pre Load this SAE |
gpt2-small/11-res-jb | blocks.11.hook_resid_pre | 24576 | none |
blocks.11.hook_resid_post Load this SAE |
gpt2-small/12-res-jb | blocks.11.hook_resid_post | 24576 | none |
gpt2-small-res-jb-feature-splitting
- Huggingface Repo: jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.8.hook_resid_pre_768 Load this SAE |
gpt2-small/8-res_fs768-jb | blocks.8.hook_resid_pre | 768 | none |
blocks.8.hook_resid_pre_1536 Load this SAE |
gpt2-small/8-res_fs1536-jb | blocks.8.hook_resid_pre | 1536 | none |
blocks.8.hook_resid_pre_3072 Load this SAE |
gpt2-small/8-res_fs3072-jb | blocks.8.hook_resid_pre | 3072 | none |
blocks.8.hook_resid_pre_6144 Load this SAE |
gpt2-small/8-res_fs6144-jb | blocks.8.hook_resid_pre | 6144 | none |
blocks.8.hook_resid_pre_12288 Load this SAE |
gpt2-small/8-res_fs12288-jb | blocks.8.hook_resid_pre | 12288 | none |
blocks.8.hook_resid_pre_24576 Load this SAE |
gpt2-small/8-res_fs24576-jb | blocks.8.hook_resid_pre | 24576 | none |
blocks.8.hook_resid_pre_49152 Load this SAE |
gpt2-small/8-res_fs49152-jb | blocks.8.hook_resid_pre | 49152 | none |
blocks.8.hook_resid_pre_98304 Load this SAE |
gpt2-small/8-res_fs98304-jb | blocks.8.hook_resid_pre | 98304 | none |
gpt2-small-res_sce-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_sce-ajt
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res_sce-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res_sce-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res_sce-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_scefr-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_scefr-ajt
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res_scefr-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res_scefr-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res_scefr-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_scl-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_scl-ajt
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res_scl-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res_scl-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res_scl-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_sle-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_sle-ajt
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res_sle-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res_sle-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res_sle-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_slefr-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_slefr-ajt
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res_slefr-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res_slefr-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res_slefr-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-res_sll-ajt
- Huggingface Repo: neuronpedia/gpt2-small__res_sll-ajt
- Additional Links:
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.2.hook_resid_pre Load this SAE |
gpt2-small/2-res_sll-ajt | blocks.2.hook_resid_pre | 46080 | none |
blocks.6.hook_resid_pre Load this SAE |
gpt2-small/6-res_sll-ajt | blocks.6.hook_resid_pre | 46080 | none |
blocks.10.hook_resid_pre Load this SAE |
gpt2-small/10-res_sll-ajt | blocks.10.hook_resid_pre | 46080 | none |
gpt2-small-resid-mid-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-mid-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_resid_mid Load this SAE |
gpt2-small/0-res_mid_128k-oai | blocks.0.hook_resid_mid | 131072 | layer_norm |
blocks.1.hook_resid_mid Load this SAE |
gpt2-small/1-res_mid_128k-oai | blocks.1.hook_resid_mid | 131072 | layer_norm |
blocks.2.hook_resid_mid Load this SAE |
gpt2-small/2-res_mid_128k-oai | blocks.2.hook_resid_mid | 131072 | layer_norm |
blocks.3.hook_resid_mid Load this SAE |
gpt2-small/3-res_mid_128k-oai | blocks.3.hook_resid_mid | 131072 | layer_norm |
blocks.4.hook_resid_mid Load this SAE |
gpt2-small/4-res_mid_128k-oai | blocks.4.hook_resid_mid | 131072 | layer_norm |
blocks.5.hook_resid_mid Load this SAE |
gpt2-small/5-res_mid_128k-oai | blocks.5.hook_resid_mid | 131072 | layer_norm |
blocks.6.hook_resid_mid Load this SAE |
gpt2-small/6-res_mid_128k-oai | blocks.6.hook_resid_mid | 131072 | layer_norm |
blocks.7.hook_resid_mid Load this SAE |
gpt2-small/7-res_mid_128k-oai | blocks.7.hook_resid_mid | 131072 | layer_norm |
blocks.8.hook_resid_mid Load this SAE |
gpt2-small/8-res_mid_128k-oai | blocks.8.hook_resid_mid | 131072 | layer_norm |
blocks.9.hook_resid_mid Load this SAE |
gpt2-small/9-res_mid_128k-oai | blocks.9.hook_resid_mid | 131072 | layer_norm |
blocks.10.hook_resid_mid Load this SAE |
gpt2-small/10-res_mid_128k-oai | blocks.10.hook_resid_mid | 131072 | layer_norm |
blocks.11.hook_resid_mid Load this SAE |
gpt2-small/11-res_mid_128k-oai | blocks.11.hook_resid_mid | 131072 | layer_norm |
gpt2-small-resid-mid-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-mid-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_resid_mid Load this SAE |
gpt2-small/0-res_mid_32k-oai | blocks.0.hook_resid_mid | 32768 | layer_norm |
blocks.1.hook_resid_mid Load this SAE |
gpt2-small/1-res_mid_32k-oai | blocks.1.hook_resid_mid | 32768 | layer_norm |
blocks.2.hook_resid_mid Load this SAE |
gpt2-small/2-res_mid_32k-oai | blocks.2.hook_resid_mid | 32768 | layer_norm |
blocks.3.hook_resid_mid Load this SAE |
gpt2-small/3-res_mid_32k-oai | blocks.3.hook_resid_mid | 32768 | layer_norm |
blocks.4.hook_resid_mid Load this SAE |
gpt2-small/4-res_mid_32k-oai | blocks.4.hook_resid_mid | 32768 | layer_norm |
blocks.5.hook_resid_mid Load this SAE |
gpt2-small/5-res_mid_32k-oai | blocks.5.hook_resid_mid | 32768 | layer_norm |
blocks.6.hook_resid_mid Load this SAE |
gpt2-small/6-res_mid_32k-oai | blocks.6.hook_resid_mid | 32768 | layer_norm |
blocks.7.hook_resid_mid Load this SAE |
gpt2-small/7-res_mid_32k-oai | blocks.7.hook_resid_mid | 32768 | layer_norm |
blocks.8.hook_resid_mid Load this SAE |
gpt2-small/8-res_mid_32k-oai | blocks.8.hook_resid_mid | 32768 | layer_norm |
blocks.9.hook_resid_mid Load this SAE |
gpt2-small/9-res_mid_32k-oai | blocks.9.hook_resid_mid | 32768 | layer_norm |
blocks.10.hook_resid_mid Load this SAE |
gpt2-small/10-res_mid_32k-oai | blocks.10.hook_resid_mid | 32768 | layer_norm |
blocks.11.hook_resid_mid Load this SAE |
gpt2-small/11-res_mid_32k-oai | blocks.11.hook_resid_mid | 32768 | layer_norm |
gpt2-small-resid-post-v5-128k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-post-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
gpt2-small/0-res_post_128k-oai | blocks.0.hook_resid_post | 131072 | layer_norm |
blocks.1.hook_resid_post Load this SAE |
gpt2-small/1-res_post_128k-oai | blocks.1.hook_resid_post | 131072 | layer_norm |
blocks.2.hook_resid_post Load this SAE |
gpt2-small/2-res_post_128k-oai | blocks.2.hook_resid_post | 131072 | layer_norm |
blocks.3.hook_resid_post Load this SAE |
gpt2-small/3-res_post_128k-oai | blocks.3.hook_resid_post | 131072 | layer_norm |
blocks.4.hook_resid_post Load this SAE |
gpt2-small/4-res_post_128k-oai | blocks.4.hook_resid_post | 131072 | layer_norm |
blocks.5.hook_resid_post Load this SAE |
gpt2-small/5-res_post_128k-oai | blocks.5.hook_resid_post | 131072 | layer_norm |
blocks.6.hook_resid_post Load this SAE |
gpt2-small/6-res_post_128k-oai | blocks.6.hook_resid_post | 131072 | layer_norm |
blocks.7.hook_resid_post Load this SAE |
gpt2-small/7-res_post_128k-oai | blocks.7.hook_resid_post | 131072 | layer_norm |
blocks.8.hook_resid_post Load this SAE |
gpt2-small/8-res_post_128k-oai | blocks.8.hook_resid_post | 131072 | layer_norm |
blocks.9.hook_resid_post Load this SAE |
gpt2-small/9-res_post_128k-oai | blocks.9.hook_resid_post | 131072 | layer_norm |
blocks.10.hook_resid_post Load this SAE |
gpt2-small/10-res_post_128k-oai | blocks.10.hook_resid_post | 131072 | layer_norm |
blocks.11.hook_resid_post Load this SAE |
gpt2-small/11-res_post_128k-oai | blocks.11.hook_resid_post | 131072 | layer_norm |
gpt2-small-resid-post-v5-32k
- Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-post-SAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.0.hook_resid_post Load this SAE |
gpt2-small/0-res_post_32k-oai | blocks.0.hook_resid_post | 32768 | layer_norm |
blocks.1.hook_resid_post Load this SAE |
gpt2-small/1-res_post_32k-oai | blocks.1.hook_resid_post | 32768 | layer_norm |
blocks.2.hook_resid_post Load this SAE |
gpt2-small/2-res_post_32k-oai | blocks.2.hook_resid_post | 32768 | layer_norm |
blocks.3.hook_resid_post Load this SAE |
gpt2-small/3-res_post_32k-oai | blocks.3.hook_resid_post | 32768 | layer_norm |
blocks.4.hook_resid_post Load this SAE |
gpt2-small/4-res_post_32k-oai | blocks.4.hook_resid_post | 32768 | layer_norm |
blocks.5.hook_resid_post Load this SAE |
gpt2-small/5-res_post_32k-oai | blocks.5.hook_resid_post | 32768 | layer_norm |
blocks.6.hook_resid_post Load this SAE |
gpt2-small/6-res_post_32k-oai | blocks.6.hook_resid_post | 32768 | layer_norm |
blocks.7.hook_resid_post Load this SAE |
gpt2-small/7-res_post_32k-oai | blocks.7.hook_resid_post | 32768 | layer_norm |
blocks.8.hook_resid_post Load this SAE |
gpt2-small/8-res_post_32k-oai | blocks.8.hook_resid_post | 32768 | layer_norm |
blocks.9.hook_resid_post Load this SAE |
gpt2-small/9-res_post_32k-oai | blocks.9.hook_resid_post | 32768 | layer_norm |
blocks.10.hook_resid_post Load this SAE |
gpt2-small/10-res_post_32k-oai | blocks.10.hook_resid_post | 32768 | layer_norm |
blocks.11.hook_resid_post Load this SAE |
gpt2-small/11-res_post_32k-oai | blocks.11.hook_resid_post | 32768 | layer_norm |
×