© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Models
Steer
SAE Evals
Exports
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
Home
OpenAI · Sparse Autoencoder for GPT2-Small - v5 2024
GPT2-Small
Residual Mid - 32k
11-RES_MID_32K-OAI
gpt2-small · 11-res_mid_32k-oai
Source from
gpt2sm-oai-2024
·
Residual Mid - 32k
· Layer 11
Jump to Source/SAE
11-res_mid_32k-oai
Source/SAE
Go
Jump to Feature
11-res_mid_32k-oai
Source/SAE
INDEX
Go
Configuration
jbloom/GPT2-Small-OAI-v5-32k-resid-mid-SAEs/v5_32k_layer_11
How To Load
Features
32,768
Data Type
torch.float32
Hook Name
blocks.11.hook_resid_mid
Hook Layer
11
Architecture
standard
Context Size
64
Dataset
Skylion007/openwebtext
Activation Function
topk
Show All
Search via Inference
?
Residual Mid - 32k
Layer 11
SEARCH
Run Example Search
Random
🌮 Food
📰 News
📖 Literary
👯 Personal
🧑💻 Programming
🧑🔬 Technical
🧑🏫 Academic
💼 Business
🧑⚖️ Legal
🧑🏫 Educational
🗼 Cultural
Search TopK by Token
MODEL
Residual Mid - 32k
LAYER
RANDOM
SEARCH
Density Threshold:
0.75%
Reset
0%
1%
10%
100%
Show BOS
Hide BOS
Sort by Frequency
Sort by Max Act
Sort by Density
Search Explanations
All
By Release
By Model
By Sources
MODEL
Residual Mid - 32k
Layer 11
Show Dashboards
Hide Dashboards
Browse
MODEL
Residual Mid - 32k
LAYER
Features in
GPT2-SMALL
@
11-res_mid_32k-oai
Hover over a feature on the left to preview its details.
Click a feature to lock it and interact with it.