© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
GPT2-SMALL · 6-RES_SCEFR-AJT · 8717 ｜ Neuronpedia
Home
Apollo Research · Taylor · Identifying Functionally Important Features with End-to-End Sparse Dictionary Learning
GPT2-Small
Residual Similar CE E2E Recon
6-RES_SCEFR-AJT
8717
Prev
Next
MODEL
6-res_scefr-ajt
Source/SAE
INDEX
Go
Explanations
descriptions of individuals and their actions in news articles and reports
oai_token-act-pair · gpt-3.5-turbo
No Scores
New Auto-Interp
AutoInterp Type
claude-4-5-haiku
Generate
Interpretable Score
Intrusion Detection
Top Features by Cosine Similarity
Configuration
neuronpedia/gpt2-small__res_scefr-ajt/6-res_scefr-ajt
How To Load
Prompts (Dashboard)
12,288 prompts, 128 tokens each
Dataset (Dashboard)
Skylion007/openwebtext
Features
46,080
Data Type
torch.float32
Hook Point
blocks.6.hook_resid_pre
Architecture
standard
Context Size
128
Dataset
apollo-research/Skylion007-openwebtext-tokenizer-gpt2
Hook Point Layer
6
Activation Function
relu
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/gpt2-small/6-res_scefr-ajt/8717?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/gpt2-small/6-res_scefr-ajt/8717?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Not in Any Lists
Add to List
▼
No Comments
ADD
Neuron Alignment
Index
Value
% of L₁
264
+0.12
0.5%
127
+0.12
0.5%
599
+0.12
0.5%
Correlated Neurons
Index
P. Corr.
Cos Sim.
526
+0.12
-0.06
61
+0.12
0.10
599
+0.12
0.09
Negative Logits
.",
-0.86
.,"
-0.81
ogether
-0.79
guiName
-0.79
"""
-0.77
(?,
-0.77
mmmm
-0.75
cause
-0.72
EVA
-0.70
":
-0.69
POSITIVE LOGITS
*)
1.27
?)
1.25
)?
1.21
?).
1.20
?),
1.17
)[
1.11
?)
1.06
)}
1.05
)
1.00
)—
0.98
Act
ivations
Density 10.107%
Test
Steer
Stacked
Snippet
Full
Show Breaks
Hide Breaks
No Known Activations
