© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
MAY 26
Assistant Axis
JAN 26
Circuit Tracer
APR 26
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
Docs
Community
Blog
Privacy & Terms
Contact
Sign In
GPT2-SMALL · 8-RES_FS768-JB · 380 ｜ Neuronpedia
Home
Joseph Bloom · Feature Splitting for GPT2-Small
GPT2-Small
Residual Feature Splitting 768
8-RES_FS768-JB
380
Prev
Next
MODEL
8-res_fs768-jb
Source/SAE
INDEX
Go
Explanations
numerical measurements such as scores, statistics, or other quantifiable data
oai_token-act-pair · gpt-3.5-turbo
Triggered by @bot
No Scores
New Auto-Interp
AutoInterp Type
claude-4-5-haiku
Generate
Interpretable Score
Intrusion Detection
Top Features by Cosine Similarity
Comparing With
GPT2-SMALL @ 8-res_fs768-jb
Configuration
jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8/blocks.8.hook_resid_pre_768
How To Load
Prompts (Dashboard)
24,576 prompts, 128 tokens each
Dataset (Dashboard)
Skylion007/openwebtext
Features
768
Data Type
torch.float32
Hook Point
blocks.8.hook_resid_pre
Architecture
standard
Context Size
128
Dataset
Skylion007/openwebtext
Hook Point Layer
8
Activation Function
relu
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/gpt2-small/8-res_fs768-jb/380?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/gpt2-small/8-res_fs768-jb/380?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Not in Any Lists
Add to List
▼
No Comments
ADD
Neuron Alignment
Index
Value
% of L₁
507
+0.12
0.6%
314
+0.12
0.5%
260
+0.10
0.4%
Correlated Neurons
Index
P. Corr.
Cos Sim.
507
+0.12
0.16
260
+0.12
0.16
693
+0.10
0.15
Negative Logits
atem
-0.55
Uriel
-0.55
Sorceress
-0.54
Aly
-0.53
£ı
-0.53
retweet
-0.53
Jagu
-0.53
DRAG
-0.51
Lara
-0.51
Levant
-0.51
POSITIVE LOGITS
th
1.43
76
1.27
71
1.24
56
1.21
87
1.21
73
1.20
61
1.20
72
1.20
34
1.20
54
1.19
Act
ivations
Density 1.377%
Test
Steer
Stacked
Snippet
Full
Show Breaks
Hide Breaks
No Known Activations
