© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Models
Search
Steer
SAE Evals
Exports
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
PYTHIA-70M-DEDUPED · 0-MLP-SM · 27947 ｜ Neuronpedia
Home
Under Peer Review · Sparse Autoencoders for Pythia-70M-Deduped
Pythia-70M-Deduped
MLP Post
0-MLP-SM
27947
Prev
Next
MODEL
0-mlp-sm
Source/SAE
INDEX
Go
Explanations
phrases related to connections or interconnectivity in various contexts
oai_token-act-pair · gpt-4o-mini
Triggered by @bot
No Scores
New Auto-Interp
AutoInterp Type
claude-4-5-haiku
Generate
Top Features by Cosine Similarity
Configuration
ctigges/pythia-70m-deduped__mlp-sm_processed/0-mlp-sm
How To Load
Prompts (Dashboard)
32,768 prompts, 128 tokens each
Dataset (Dashboard)
monology/pile-uncopyrighted
Features
32,768
Data Type
torch.float32
Hook Name
blocks.0.hook_mlp_out
Hook Layer
0
Architecture
standard
Context Size
128
Dataset
EleutherAI/the_pile_deduplicated
Activation Function
relu
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/pythia-70m-deduped/0-mlp-sm/27947?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/pythia-70m-deduped/0-mlp-sm/27947?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Not in Any Lists
Add to List
▼
No Comments
ADD
Neuron Alignment
Index
Value
% of L₁
376
+0.12
0.7%
365
+0.11
0.7%
156
+0.10
0.6%
Correlated Neurons
Index
P. Corr.
Cos Sim.
158
+0.12
0.01
232
+0.11
0.01
365
+0.10
0.01
Negative Logits
ĥ½
-2.86
¿
-2.54
Ĥ¬
-2.35
ľ
-2.18
¤
-2.07
ĩ
-2.06
Ľ
-2.04
·¸
-1.98
ĨĴ
-1.94
¦
-1.90
POSITIVE LOGITS
naire
2.16
ally
1.82
notes
1.77
als
1.75
pool
1.75
ist
1.75
ists
1.74
ÅĽci
1.69
castle
1.68
lens
1.67
Act
ivations
Density 0.021%
Stacked
Snippet
Full
Show Breaks
Hide Breaks
No Known Activations
