llama-3.1-8b
This page lists all pretrained SAEs available for llama-3.1-8b.
llama_scope_lxa_32x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-32x
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
l0a_32x Load this SAE |
llama3.1-8b/0-llamascope-att-131k | blocks.0.hook_attn_out | 131072 | expected_average_only_in |
l1a_32x Load this SAE |
llama3.1-8b/1-llamascope-att-131k | blocks.1.hook_attn_out | 131072 | expected_average_only_in |
l2a_32x Load this SAE |
llama3.1-8b/2-llamascope-att-131k | blocks.2.hook_attn_out | 131072 | expected_average_only_in |
l3a_32x Load this SAE |
llama3.1-8b/3-llamascope-att-131k | blocks.3.hook_attn_out | 131072 | expected_average_only_in |
l4a_32x Load this SAE |
llama3.1-8b/4-llamascope-att-131k | blocks.4.hook_attn_out | 131072 | expected_average_only_in |
l5a_32x Load this SAE |
llama3.1-8b/5-llamascope-att-131k | blocks.5.hook_attn_out | 131072 | expected_average_only_in |
l6a_32x Load this SAE |
llama3.1-8b/6-llamascope-att-131k | blocks.6.hook_attn_out | 131072 | expected_average_only_in |
l7a_32x Load this SAE |
llama3.1-8b/7-llamascope-att-131k | blocks.7.hook_attn_out | 131072 | expected_average_only_in |
l8a_32x Load this SAE |
llama3.1-8b/8-llamascope-att-131k | blocks.8.hook_attn_out | 131072 | expected_average_only_in |
l9a_32x Load this SAE |
llama3.1-8b/9-llamascope-att-131k | blocks.9.hook_attn_out | 131072 | expected_average_only_in |
l10a_32x Load this SAE |
llama3.1-8b/10-llamascope-att-131k | blocks.10.hook_attn_out | 131072 | expected_average_only_in |
l11a_32x Load this SAE |
llama3.1-8b/11-llamascope-att-131k | blocks.11.hook_attn_out | 131072 | expected_average_only_in |
l12a_32x Load this SAE |
llama3.1-8b/12-llamascope-att-131k | blocks.12.hook_attn_out | 131072 | expected_average_only_in |
l13a_32x Load this SAE |
llama3.1-8b/13-llamascope-att-131k | blocks.13.hook_attn_out | 131072 | expected_average_only_in |
l14a_32x Load this SAE |
llama3.1-8b/14-llamascope-att-131k | blocks.14.hook_attn_out | 131072 | expected_average_only_in |
l15a_32x Load this SAE |
llama3.1-8b/15-llamascope-att-131k | blocks.15.hook_attn_out | 131072 | expected_average_only_in |
l16a_32x Load this SAE |
llama3.1-8b/16-llamascope-att-131k | blocks.16.hook_attn_out | 131072 | expected_average_only_in |
l17a_32x Load this SAE |
llama3.1-8b/17-llamascope-att-131k | blocks.17.hook_attn_out | 131072 | expected_average_only_in |
l18a_32x Load this SAE |
llama3.1-8b/18-llamascope-att-131k | blocks.18.hook_attn_out | 131072 | expected_average_only_in |
l19a_32x Load this SAE |
llama3.1-8b/19-llamascope-att-131k | blocks.19.hook_attn_out | 131072 | expected_average_only_in |
l20a_32x Load this SAE |
llama3.1-8b/20-llamascope-att-131k | blocks.20.hook_attn_out | 131072 | expected_average_only_in |
l21a_32x Load this SAE |
llama3.1-8b/21-llamascope-att-131k | blocks.21.hook_attn_out | 131072 | expected_average_only_in |
l22a_32x Load this SAE |
llama3.1-8b/22-llamascope-att-131k | blocks.22.hook_attn_out | 131072 | expected_average_only_in |
l23a_32x Load this SAE |
llama3.1-8b/23-llamascope-att-131k | blocks.23.hook_attn_out | 131072 | expected_average_only_in |
l24a_32x Load this SAE |
llama3.1-8b/24-llamascope-att-131k | blocks.24.hook_attn_out | 131072 | expected_average_only_in |
l25a_32x Load this SAE |
llama3.1-8b/25-llamascope-att-131k | blocks.25.hook_attn_out | 131072 | expected_average_only_in |
l26a_32x Load this SAE |
llama3.1-8b/26-llamascope-att-131k | blocks.26.hook_attn_out | 131072 | expected_average_only_in |
l27a_32x Load this SAE |
llama3.1-8b/27-llamascope-att-131k | blocks.27.hook_attn_out | 131072 | expected_average_only_in |
l28a_32x Load this SAE |
llama3.1-8b/28-llamascope-att-131k | blocks.28.hook_attn_out | 131072 | expected_average_only_in |
l29a_32x Load this SAE |
llama3.1-8b/29-llamascope-att-131k | blocks.29.hook_attn_out | 131072 | expected_average_only_in |
l30a_32x Load this SAE |
llama3.1-8b/30-llamascope-att-131k | blocks.30.hook_attn_out | 131072 | expected_average_only_in |
l31a_32x Load this SAE |
llama3.1-8b/31-llamascope-att-131k | blocks.31.hook_attn_out | 131072 | expected_average_only_in |
llama_scope_lxa_8x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-8x
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
l0a_8x Load this SAE |
llama3.1-8b/0-llamascope-att-32k | blocks.0.hook_attn_out | 32768 | expected_average_only_in |
l1a_8x Load this SAE |
llama3.1-8b/1-llamascope-att-32k | blocks.1.hook_attn_out | 32768 | expected_average_only_in |
l2a_8x Load this SAE |
llama3.1-8b/2-llamascope-att-32k | blocks.2.hook_attn_out | 32768 | expected_average_only_in |
l3a_8x Load this SAE |
llama3.1-8b/3-llamascope-att-32k | blocks.3.hook_attn_out | 32768 | expected_average_only_in |
l4a_8x Load this SAE |
llama3.1-8b/4-llamascope-att-32k | blocks.4.hook_attn_out | 32768 | expected_average_only_in |
l5a_8x Load this SAE |
llama3.1-8b/5-llamascope-att-32k | blocks.5.hook_attn_out | 32768 | expected_average_only_in |
l6a_8x Load this SAE |
llama3.1-8b/6-llamascope-att-32k | blocks.6.hook_attn_out | 32768 | expected_average_only_in |
l7a_8x Load this SAE |
llama3.1-8b/7-llamascope-att-32k | blocks.7.hook_attn_out | 32768 | expected_average_only_in |
l8a_8x Load this SAE |
llama3.1-8b/8-llamascope-att-32k | blocks.8.hook_attn_out | 32768 | expected_average_only_in |
l9a_8x Load this SAE |
llama3.1-8b/9-llamascope-att-32k | blocks.9.hook_attn_out | 32768 | expected_average_only_in |
l10a_8x Load this SAE |
llama3.1-8b/10-llamascope-att-32k | blocks.10.hook_attn_out | 32768 | expected_average_only_in |
l11a_8x Load this SAE |
llama3.1-8b/11-llamascope-att-32k | blocks.11.hook_attn_out | 32768 | expected_average_only_in |
l12a_8x Load this SAE |
llama3.1-8b/12-llamascope-att-32k | blocks.12.hook_attn_out | 32768 | expected_average_only_in |
l13a_8x Load this SAE |
llama3.1-8b/13-llamascope-att-32k | blocks.13.hook_attn_out | 32768 | expected_average_only_in |
l14a_8x Load this SAE |
llama3.1-8b/14-llamascope-att-32k | blocks.14.hook_attn_out | 32768 | expected_average_only_in |
l15a_8x Load this SAE |
llama3.1-8b/15-llamascope-att-32k | blocks.15.hook_attn_out | 32768 | expected_average_only_in |
l16a_8x Load this SAE |
llama3.1-8b/16-llamascope-att-32k | blocks.16.hook_attn_out | 32768 | expected_average_only_in |
l17a_8x Load this SAE |
llama3.1-8b/17-llamascope-att-32k | blocks.17.hook_attn_out | 32768 | expected_average_only_in |
l18a_8x Load this SAE |
llama3.1-8b/18-llamascope-att-32k | blocks.18.hook_attn_out | 32768 | expected_average_only_in |
l19a_8x Load this SAE |
llama3.1-8b/19-llamascope-att-32k | blocks.19.hook_attn_out | 32768 | expected_average_only_in |
l20a_8x Load this SAE |
llama3.1-8b/20-llamascope-att-32k | blocks.20.hook_attn_out | 32768 | expected_average_only_in |
l21a_8x Load this SAE |
llama3.1-8b/21-llamascope-att-32k | blocks.21.hook_attn_out | 32768 | expected_average_only_in |
l22a_8x Load this SAE |
llama3.1-8b/22-llamascope-att-32k | blocks.22.hook_attn_out | 32768 | expected_average_only_in |
l23a_8x Load this SAE |
llama3.1-8b/23-llamascope-att-32k | blocks.23.hook_attn_out | 32768 | expected_average_only_in |
l24a_8x Load this SAE |
llama3.1-8b/24-llamascope-att-32k | blocks.24.hook_attn_out | 32768 | expected_average_only_in |
l25a_8x Load this SAE |
llama3.1-8b/25-llamascope-att-32k | blocks.25.hook_attn_out | 32768 | expected_average_only_in |
l26a_8x Load this SAE |
llama3.1-8b/26-llamascope-att-32k | blocks.26.hook_attn_out | 32768 | expected_average_only_in |
l27a_8x Load this SAE |
llama3.1-8b/27-llamascope-att-32k | blocks.27.hook_attn_out | 32768 | expected_average_only_in |
l28a_8x Load this SAE |
llama3.1-8b/28-llamascope-att-32k | blocks.28.hook_attn_out | 32768 | expected_average_only_in |
l29a_8x Load this SAE |
llama3.1-8b/29-llamascope-att-32k | blocks.29.hook_attn_out | 32768 | expected_average_only_in |
l30a_8x Load this SAE |
llama3.1-8b/30-llamascope-att-32k | blocks.30.hook_attn_out | 32768 | expected_average_only_in |
l31a_8x Load this SAE |
llama3.1-8b/31-llamascope-att-32k | blocks.31.hook_attn_out | 32768 | expected_average_only_in |
llama_scope_lxm_32x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-32x
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
l0m_32x Load this SAE |
llama3.1-8b/0-llamascope-mlp-131k | blocks.0.hook_mlp_out | 131072 | expected_average_only_in |
l1m_32x Load this SAE |
llama3.1-8b/1-llamascope-mlp-131k | blocks.1.hook_mlp_out | 131072 | expected_average_only_in |
l2m_32x Load this SAE |
llama3.1-8b/2-llamascope-mlp-131k | blocks.2.hook_mlp_out | 131072 | expected_average_only_in |
l3m_32x Load this SAE |
llama3.1-8b/3-llamascope-mlp-131k | blocks.3.hook_mlp_out | 131072 | expected_average_only_in |
l4m_32x Load this SAE |
llama3.1-8b/4-llamascope-mlp-131k | blocks.4.hook_mlp_out | 131072 | expected_average_only_in |
l5m_32x Load this SAE |
llama3.1-8b/5-llamascope-mlp-131k | blocks.5.hook_mlp_out | 131072 | expected_average_only_in |
l6m_32x Load this SAE |
llama3.1-8b/6-llamascope-mlp-131k | blocks.6.hook_mlp_out | 131072 | expected_average_only_in |
l7m_32x Load this SAE |
llama3.1-8b/7-llamascope-mlp-131k | blocks.7.hook_mlp_out | 131072 | expected_average_only_in |
l8m_32x Load this SAE |
llama3.1-8b/8-llamascope-mlp-131k | blocks.8.hook_mlp_out | 131072 | expected_average_only_in |
l9m_32x Load this SAE |
llama3.1-8b/9-llamascope-mlp-131k | blocks.9.hook_mlp_out | 131072 | expected_average_only_in |
l10m_32x Load this SAE |
llama3.1-8b/10-llamascope-mlp-131k | blocks.10.hook_mlp_out | 131072 | expected_average_only_in |
l11m_32x Load this SAE |
llama3.1-8b/11-llamascope-mlp-131k | blocks.11.hook_mlp_out | 131072 | expected_average_only_in |
l12m_32x Load this SAE |
llama3.1-8b/12-llamascope-mlp-131k | blocks.12.hook_mlp_out | 131072 | expected_average_only_in |
l13m_32x Load this SAE |
llama3.1-8b/13-llamascope-mlp-131k | blocks.13.hook_mlp_out | 131072 | expected_average_only_in |
l14m_32x Load this SAE |
llama3.1-8b/14-llamascope-mlp-131k | blocks.14.hook_mlp_out | 131072 | expected_average_only_in |
l15m_32x Load this SAE |
llama3.1-8b/15-llamascope-mlp-131k | blocks.15.hook_mlp_out | 131072 | expected_average_only_in |
l16m_32x Load this SAE |
llama3.1-8b/16-llamascope-mlp-131k | blocks.16.hook_mlp_out | 131072 | expected_average_only_in |
l17m_32x Load this SAE |
llama3.1-8b/17-llamascope-mlp-131k | blocks.17.hook_mlp_out | 131072 | expected_average_only_in |
l18m_32x Load this SAE |
llama3.1-8b/18-llamascope-mlp-131k | blocks.18.hook_mlp_out | 131072 | expected_average_only_in |
l19m_32x Load this SAE |
llama3.1-8b/19-llamascope-mlp-131k | blocks.19.hook_mlp_out | 131072 | expected_average_only_in |
l20m_32x Load this SAE |
llama3.1-8b/20-llamascope-mlp-131k | blocks.20.hook_mlp_out | 131072 | expected_average_only_in |
l21m_32x Load this SAE |
llama3.1-8b/21-llamascope-mlp-131k | blocks.21.hook_mlp_out | 131072 | expected_average_only_in |
l22m_32x Load this SAE |
llama3.1-8b/22-llamascope-mlp-131k | blocks.22.hook_mlp_out | 131072 | expected_average_only_in |
l23m_32x Load this SAE |
llama3.1-8b/23-llamascope-mlp-131k | blocks.23.hook_mlp_out | 131072 | expected_average_only_in |
l24m_32x Load this SAE |
llama3.1-8b/24-llamascope-mlp-131k | blocks.24.hook_mlp_out | 131072 | expected_average_only_in |
l25m_32x Load this SAE |
llama3.1-8b/25-llamascope-mlp-131k | blocks.25.hook_mlp_out | 131072 | expected_average_only_in |
l26m_32x Load this SAE |
llama3.1-8b/26-llamascope-mlp-131k | blocks.26.hook_mlp_out | 131072 | expected_average_only_in |
l27m_32x Load this SAE |
llama3.1-8b/27-llamascope-mlp-131k | blocks.27.hook_mlp_out | 131072 | expected_average_only_in |
l28m_32x Load this SAE |
llama3.1-8b/28-llamascope-mlp-131k | blocks.28.hook_mlp_out | 131072 | expected_average_only_in |
l29m_32x Load this SAE |
llama3.1-8b/29-llamascope-mlp-131k | blocks.29.hook_mlp_out | 131072 | expected_average_only_in |
l30m_32x Load this SAE |
llama3.1-8b/30-llamascope-mlp-131k | blocks.30.hook_mlp_out | 131072 | expected_average_only_in |
l31m_32x Load this SAE |
llama3.1-8b/31-llamascope-mlp-131k | blocks.31.hook_mlp_out | 131072 | expected_average_only_in |
llama_scope_lxm_8x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-8x
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
l0m_8x Load this SAE |
llama3.1-8b/0-llamascope-mlp-32k | blocks.0.hook_mlp_out | 32768 | expected_average_only_in |
l1m_8x Load this SAE |
llama3.1-8b/1-llamascope-mlp-32k | blocks.1.hook_mlp_out | 32768 | expected_average_only_in |
l2m_8x Load this SAE |
llama3.1-8b/2-llamascope-mlp-32k | blocks.2.hook_mlp_out | 32768 | expected_average_only_in |
l3m_8x Load this SAE |
llama3.1-8b/3-llamascope-mlp-32k | blocks.3.hook_mlp_out | 32768 | expected_average_only_in |
l4m_8x Load this SAE |
llama3.1-8b/4-llamascope-mlp-32k | blocks.4.hook_mlp_out | 32768 | expected_average_only_in |
l5m_8x Load this SAE |
llama3.1-8b/5-llamascope-mlp-32k | blocks.5.hook_mlp_out | 32768 | expected_average_only_in |
l6m_8x Load this SAE |
llama3.1-8b/6-llamascope-mlp-32k | blocks.6.hook_mlp_out | 32768 | expected_average_only_in |
l7m_8x Load this SAE |
llama3.1-8b/7-llamascope-mlp-32k | blocks.7.hook_mlp_out | 32768 | expected_average_only_in |
l8m_8x Load this SAE |
llama3.1-8b/8-llamascope-mlp-32k | blocks.8.hook_mlp_out | 32768 | expected_average_only_in |
l9m_8x Load this SAE |
llama3.1-8b/9-llamascope-mlp-32k | blocks.9.hook_mlp_out | 32768 | expected_average_only_in |
l10m_8x Load this SAE |
llama3.1-8b/10-llamascope-mlp-32k | blocks.10.hook_mlp_out | 32768 | expected_average_only_in |
l11m_8x Load this SAE |
llama3.1-8b/11-llamascope-mlp-32k | blocks.11.hook_mlp_out | 32768 | expected_average_only_in |
l12m_8x Load this SAE |
llama3.1-8b/12-llamascope-mlp-32k | blocks.12.hook_mlp_out | 32768 | expected_average_only_in |
l13m_8x Load this SAE |
llama3.1-8b/13-llamascope-mlp-32k | blocks.13.hook_mlp_out | 32768 | expected_average_only_in |
l14m_8x Load this SAE |
llama3.1-8b/14-llamascope-mlp-32k | blocks.14.hook_mlp_out | 32768 | expected_average_only_in |
l15m_8x Load this SAE |
llama3.1-8b/15-llamascope-mlp-32k | blocks.15.hook_mlp_out | 32768 | expected_average_only_in |
l16m_8x Load this SAE |
llama3.1-8b/16-llamascope-mlp-32k | blocks.16.hook_mlp_out | 32768 | expected_average_only_in |
l17m_8x Load this SAE |
llama3.1-8b/17-llamascope-mlp-32k | blocks.17.hook_mlp_out | 32768 | expected_average_only_in |
l18m_8x Load this SAE |
llama3.1-8b/18-llamascope-mlp-32k | blocks.18.hook_mlp_out | 32768 | expected_average_only_in |
l19m_8x Load this SAE |
llama3.1-8b/19-llamascope-mlp-32k | blocks.19.hook_mlp_out | 32768 | expected_average_only_in |
l20m_8x Load this SAE |
llama3.1-8b/20-llamascope-mlp-32k | blocks.20.hook_mlp_out | 32768 | expected_average_only_in |
l21m_8x Load this SAE |
llama3.1-8b/21-llamascope-mlp-32k | blocks.21.hook_mlp_out | 32768 | expected_average_only_in |
l22m_8x Load this SAE |
llama3.1-8b/22-llamascope-mlp-32k | blocks.22.hook_mlp_out | 32768 | expected_average_only_in |
l23m_8x Load this SAE |
llama3.1-8b/23-llamascope-mlp-32k | blocks.23.hook_mlp_out | 32768 | expected_average_only_in |
l24m_8x Load this SAE |
llama3.1-8b/24-llamascope-mlp-32k | blocks.24.hook_mlp_out | 32768 | expected_average_only_in |
l25m_8x Load this SAE |
llama3.1-8b/25-llamascope-mlp-32k | blocks.25.hook_mlp_out | 32768 | expected_average_only_in |
l26m_8x Load this SAE |
llama3.1-8b/26-llamascope-mlp-32k | blocks.26.hook_mlp_out | 32768 | expected_average_only_in |
l27m_8x Load this SAE |
llama3.1-8b/27-llamascope-mlp-32k | blocks.27.hook_mlp_out | 32768 | expected_average_only_in |
l28m_8x Load this SAE |
llama3.1-8b/28-llamascope-mlp-32k | blocks.28.hook_mlp_out | 32768 | expected_average_only_in |
l29m_8x Load this SAE |
llama3.1-8b/29-llamascope-mlp-32k | blocks.29.hook_mlp_out | 32768 | expected_average_only_in |
l30m_8x Load this SAE |
llama3.1-8b/30-llamascope-mlp-32k | blocks.30.hook_mlp_out | 32768 | expected_average_only_in |
l31m_8x Load this SAE |
llama3.1-8b/31-llamascope-mlp-32k | blocks.31.hook_mlp_out | 32768 | expected_average_only_in |
llama_scope_lxr_32x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-32x
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
l0r_32x Load this SAE |
llama3.1-8b/0-llamascope-res-131k | blocks.0.hook_resid_post | 131072 | expected_average_only_in |
l1r_32x Load this SAE |
llama3.1-8b/1-llamascope-res-131k | blocks.1.hook_resid_post | 131072 | expected_average_only_in |
l2r_32x Load this SAE |
llama3.1-8b/2-llamascope-res-131k | blocks.2.hook_resid_post | 131072 | expected_average_only_in |
l3r_32x Load this SAE |
llama3.1-8b/3-llamascope-res-131k | blocks.3.hook_resid_post | 131072 | expected_average_only_in |
l4r_32x Load this SAE |
llama3.1-8b/4-llamascope-res-131k | blocks.4.hook_resid_post | 131072 | expected_average_only_in |
l5r_32x Load this SAE |
llama3.1-8b/5-llamascope-res-131k | blocks.5.hook_resid_post | 131072 | expected_average_only_in |
l6r_32x Load this SAE |
llama3.1-8b/6-llamascope-res-131k | blocks.6.hook_resid_post | 131072 | expected_average_only_in |
l7r_32x Load this SAE |
llama3.1-8b/7-llamascope-res-131k | blocks.7.hook_resid_post | 131072 | expected_average_only_in |
l8r_32x Load this SAE |
llama3.1-8b/8-llamascope-res-131k | blocks.8.hook_resid_post | 131072 | expected_average_only_in |
l9r_32x Load this SAE |
llama3.1-8b/9-llamascope-res-131k | blocks.9.hook_resid_post | 131072 | expected_average_only_in |
l10r_32x Load this SAE |
llama3.1-8b/10-llamascope-res-131k | blocks.10.hook_resid_post | 131072 | expected_average_only_in |
l11r_32x Load this SAE |
llama3.1-8b/11-llamascope-res-131k | blocks.11.hook_resid_post | 131072 | expected_average_only_in |
l12r_32x Load this SAE |
llama3.1-8b/12-llamascope-res-131k | blocks.12.hook_resid_post | 131072 | expected_average_only_in |
l13r_32x Load this SAE |
llama3.1-8b/13-llamascope-res-131k | blocks.13.hook_resid_post | 131072 | expected_average_only_in |
l14r_32x Load this SAE |
llama3.1-8b/14-llamascope-res-131k | blocks.14.hook_resid_post | 131072 | expected_average_only_in |
l15r_32x Load this SAE |
llama3.1-8b/15-llamascope-res-131k | blocks.15.hook_resid_post | 131072 | expected_average_only_in |
l16r_32x Load this SAE |
llama3.1-8b/16-llamascope-res-131k | blocks.16.hook_resid_post | 131072 | expected_average_only_in |
l17r_32x Load this SAE |
llama3.1-8b/17-llamascope-res-131k | blocks.17.hook_resid_post | 131072 | expected_average_only_in |
l18r_32x Load this SAE |
llama3.1-8b/18-llamascope-res-131k | blocks.18.hook_resid_post | 131072 | expected_average_only_in |
l19r_32x Load this SAE |
llama3.1-8b/19-llamascope-res-131k | blocks.19.hook_resid_post | 131072 | expected_average_only_in |
l20r_32x Load this SAE |
llama3.1-8b/20-llamascope-res-131k | blocks.20.hook_resid_post | 131072 | expected_average_only_in |
l21r_32x Load this SAE |
llama3.1-8b/21-llamascope-res-131k | blocks.21.hook_resid_post | 131072 | expected_average_only_in |
l22r_32x Load this SAE |
llama3.1-8b/22-llamascope-res-131k | blocks.22.hook_resid_post | 131072 | expected_average_only_in |
l23r_32x Load this SAE |
llama3.1-8b/23-llamascope-res-131k | blocks.23.hook_resid_post | 131072 | expected_average_only_in |
l24r_32x Load this SAE |
llama3.1-8b/24-llamascope-res-131k | blocks.24.hook_resid_post | 131072 | expected_average_only_in |
l25r_32x Load this SAE |
llama3.1-8b/25-llamascope-res-131k | blocks.25.hook_resid_post | 131072 | expected_average_only_in |
l26r_32x Load this SAE |
llama3.1-8b/26-llamascope-res-131k | blocks.26.hook_resid_post | 131072 | expected_average_only_in |
l27r_32x Load this SAE |
llama3.1-8b/27-llamascope-res-131k | blocks.27.hook_resid_post | 131072 | expected_average_only_in |
l28r_32x Load this SAE |
llama3.1-8b/28-llamascope-res-131k | blocks.28.hook_resid_post | 131072 | expected_average_only_in |
l29r_32x Load this SAE |
llama3.1-8b/29-llamascope-res-131k | blocks.29.hook_resid_post | 131072 | expected_average_only_in |
l30r_32x Load this SAE |
llama3.1-8b/30-llamascope-res-131k | blocks.30.hook_resid_post | 131072 | expected_average_only_in |
l31r_32x Load this SAE |
llama3.1-8b/31-llamascope-res-131k | blocks.31.hook_resid_post | 131072 | expected_average_only_in |
llama_scope_lxr_8x
- Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-8x
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
l0r_8x Load this SAE |
llama3.1-8b/0-llamascope-res-32k | blocks.0.hook_resid_post | 32768 | expected_average_only_in |
l1r_8x Load this SAE |
llama3.1-8b/1-llamascope-res-32k | blocks.1.hook_resid_post | 32768 | expected_average_only_in |
l2r_8x Load this SAE |
llama3.1-8b/2-llamascope-res-32k | blocks.2.hook_resid_post | 32768 | expected_average_only_in |
l3r_8x Load this SAE |
llama3.1-8b/3-llamascope-res-32k | blocks.3.hook_resid_post | 32768 | expected_average_only_in |
l4r_8x Load this SAE |
llama3.1-8b/4-llamascope-res-32k | blocks.4.hook_resid_post | 32768 | expected_average_only_in |
l5r_8x Load this SAE |
llama3.1-8b/5-llamascope-res-32k | blocks.5.hook_resid_post | 32768 | expected_average_only_in |
l6r_8x Load this SAE |
llama3.1-8b/6-llamascope-res-32k | blocks.6.hook_resid_post | 32768 | expected_average_only_in |
l7r_8x Load this SAE |
llama3.1-8b/7-llamascope-res-32k | blocks.7.hook_resid_post | 32768 | expected_average_only_in |
l8r_8x Load this SAE |
llama3.1-8b/8-llamascope-res-32k | blocks.8.hook_resid_post | 32768 | expected_average_only_in |
l9r_8x Load this SAE |
llama3.1-8b/9-llamascope-res-32k | blocks.9.hook_resid_post | 32768 | expected_average_only_in |
l10r_8x Load this SAE |
llama3.1-8b/10-llamascope-res-32k | blocks.10.hook_resid_post | 32768 | expected_average_only_in |
l11r_8x Load this SAE |
llama3.1-8b/11-llamascope-res-32k | blocks.11.hook_resid_post | 32768 | expected_average_only_in |
l12r_8x Load this SAE |
llama3.1-8b/12-llamascope-res-32k | blocks.12.hook_resid_post | 32768 | expected_average_only_in |
l13r_8x Load this SAE |
llama3.1-8b/13-llamascope-res-32k | blocks.13.hook_resid_post | 32768 | expected_average_only_in |
l14r_8x Load this SAE |
llama3.1-8b/14-llamascope-res-32k | blocks.14.hook_resid_post | 32768 | expected_average_only_in |
l15r_8x Load this SAE |
llama3.1-8b/15-llamascope-res-32k | blocks.15.hook_resid_post | 32768 | expected_average_only_in |
l16r_8x Load this SAE |
llama3.1-8b/16-llamascope-res-32k | blocks.16.hook_resid_post | 32768 | expected_average_only_in |
l17r_8x Load this SAE |
llama3.1-8b/17-llamascope-res-32k | blocks.17.hook_resid_post | 32768 | expected_average_only_in |
l18r_8x Load this SAE |
llama3.1-8b/18-llamascope-res-32k | blocks.18.hook_resid_post | 32768 | expected_average_only_in |
l19r_8x Load this SAE |
llama3.1-8b/19-llamascope-res-32k | blocks.19.hook_resid_post | 32768 | expected_average_only_in |
l20r_8x Load this SAE |
llama3.1-8b/20-llamascope-res-32k | blocks.20.hook_resid_post | 32768 | expected_average_only_in |
l21r_8x Load this SAE |
llama3.1-8b/21-llamascope-res-32k | blocks.21.hook_resid_post | 32768 | expected_average_only_in |
l22r_8x Load this SAE |
llama3.1-8b/22-llamascope-res-32k | blocks.22.hook_resid_post | 32768 | expected_average_only_in |
l23r_8x Load this SAE |
llama3.1-8b/23-llamascope-res-32k | blocks.23.hook_resid_post | 32768 | expected_average_only_in |
l24r_8x Load this SAE |
llama3.1-8b/24-llamascope-res-32k | blocks.24.hook_resid_post | 32768 | expected_average_only_in |
l25r_8x Load this SAE |
llama3.1-8b/25-llamascope-res-32k | blocks.25.hook_resid_post | 32768 | expected_average_only_in |
l26r_8x Load this SAE |
llama3.1-8b/26-llamascope-res-32k | blocks.26.hook_resid_post | 32768 | expected_average_only_in |
l27r_8x Load this SAE |
llama3.1-8b/27-llamascope-res-32k | blocks.27.hook_resid_post | 32768 | expected_average_only_in |
l28r_8x Load this SAE |
llama3.1-8b/28-llamascope-res-32k | blocks.28.hook_resid_post | 32768 | expected_average_only_in |
l29r_8x Load this SAE |
llama3.1-8b/29-llamascope-res-32k | blocks.29.hook_resid_post | 32768 | expected_average_only_in |
l30r_8x Load this SAE |
llama3.1-8b/30-llamascope-res-32k | blocks.30.hook_resid_post | 32768 | expected_average_only_in |
l31r_8x Load this SAE |
llama3.1-8b/31-llamascope-res-32k | blocks.31.hook_resid_post | 32768 | expected_average_only_in |
temporal-sae-llama-3.1-8b
- Huggingface Repo: canrager/temporalSAEs
| id | neuronpedia | hook_name | d_sae | normalize_activations |
|---|---|---|---|---|
blocks.15.hook_resid_post Load this SAE |
llama3.1-8b/15-temporal-res | blocks.15.hook_resid_post | 16384 | constant_scalar_rescale |
blocks.26.hook_resid_post Load this SAE |
llama3.1-8b/26-temporal-res | blocks.26.hook_resid_post | 16384 | constant_scalar_rescale |
×