© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Models
Steer
SAE Evals
Exports
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
GPT2-SMALL · 6-RES_SCL-AJT · 5004 ｜ Neuronpedia
Home
Apollo Research · Taylor · Identifying Functionally Important Features with End-to-End Sparse Dictionary Learning
GPT2-Small
Residual Similar CE Local
6-RES_SCL-AJT
5004
Prev
Next
MODEL
6-res_scl-ajt
Source/SAE
INDEX
Go
Explanations
No Explanations Found
New Auto-Interp
AutoInterp Type
claude-4-5-haiku
Generate
Top Features by Cosine Similarity
Configuration
neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt
How To Load
Prompts (Dashboard)
12,288 prompts, 128 tokens each
Dataset (Dashboard)
Skylion007/openwebtext
Features
46,080
Data Type
torch.float32
Hook Point
blocks.6.hook_resid_pre
Architecture
standard
Context Size
128
Dataset
apollo-research/Skylion007-openwebtext-tokenizer-gpt2
Hook Point Layer
6
Activation Function
relu
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/gpt2-small/6-res_scl-ajt/5004?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/gpt2-small/6-res_scl-ajt/5004?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Not in Any Lists
Add to List
▼
No Comments
ADD
Test
Steer
No Known Activations
This feature has no known activations.
Show Anyway
