Pretrained SAEs
This is a list of SAEs importable from the SAELens package. Click on a model to see all available SAEs.
These pages contain the contents of sae_lens/pretrained_saes.yaml in Markdown
Models
| Model | Releases | Total SAEs |
|---|---|---|
| deepseek-r1-distill-llama-8b | 2 | 97 |
| gemma-2-27b | 2 | 21 |
| gemma-2-2b | 20 | 1731 |
| gemma-2-9b | 8 | 1849 |
| gemma-2-9b-it | 1 | 6 |
| gemma-2b | 1 | 5 |
| gemma-2b-it | 1 | 1 |
| gemma-3-12b-it | 8 | 1156 |
| gemma-3-12b-pt | 8 | 1156 |
| gemma-3-1b | 1 | 25 |
| gemma-3-1b-it | 8 | 728 |
| gemma-3-1b-pt | 8 | 728 |
| gemma-3-270m | 8 | 486 |
| gemma-3-270m-it | 8 | 556 |
| gemma-3-27b-it | 8 | 1431 |
| gemma-3-27b-pt | 3 | 791 |
| gemma-3-4b-it | 8 | 876 |
| gemma-3-4b-pt | 8 | 876 |
| gpt-oss-20b | 1 | 6 |
| gpt2-small | 18 | 159 |
| llama-3.1-8b | 7 | 194 |
| llama-3.1-8b-instruct | 2 | 8 |
| llama-3.3-70b-instruct | 1 | 1 |
| meta-llama-3-8b-instruct | 1 | 1 |
| mistral-7b | 1 | 3 |
| pythia-70m-deduped | 7 | 207 |
| qwen2.5-7b-instruct | 1 | 7 |
| qwen3-0.6b | 1 | 28 |
| qwen3-1.7b | 1 | 28 |
| qwen3-14b | 2 | 80 |
| qwen3-4b | 1 | 36 |
| qwen3-8b | 1 | 36 |