© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
MAY 26
Assistant Axis
JAN 26
Circuit Tracer
APR 26
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
Docs
Community
Blog
Privacy & Terms
Contact
Sign In
GEMMA-2-2B · 24-GEMMASCOPE-RES-16K · 1922 ｜ Neuronpedia
Home
Google DeepMind · Exploring Gemma 2 with Gemma Scope
Gemma-2-2B
Residual Stream - 16k
24-GEMMASCOPE-RES-16K
1922
Prev
Next
MODEL
24-gemmascope-res-16k
Source/SAE
INDEX
Go
Explanations
statements and inquiries about causality and evidence
oai_token-act-pair · gpt-4o-mini
Triggered by @bot
No Scores
"he" after certain words
np_acts-logits-general · gemini-2.0-flash
No Scores
pronoun he
np_acts-logits-general · gemini-2.5-flash-lite
No Scores
New Auto-Interp
AutoInterp Type
claude-haiku-5-5
Generate
Interpretable Score
Intrusion Detection
Top Features by Cosine Similarity
Comparing With
GEMMA-2-2B @ 24-gemmascope-res-16k
Configuration
google/gemma-scope-2b-pt-res/layer_24/width_16k/average_l0_73
How To Load
Prompts (Dashboard)
36,864 prompts, 128 tokens each
Dataset (Dashboard)
monology/pile-uncopyrighted
Features
16,384
Data Type
float32
Hook Name
blocks.24.hook_resid_post
Hook Layer
24
Architecture
jumprelu
Context Size
1,024
Dataset
monology/pile-uncopyrighted
Activation Function
relu
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/gemma-2-2b/24-gemmascope-res-16k/1922?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/gemma-2-2b/24-gemmascope-res-16k/1922?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Negative Logits
His
-1.17
his
-1.05
his
-1.04
His
-0.96
seinen
-0.90
HIS
-0.84
HIS
-0.82
hans
-0.76
seine
-0.75
istrinya
-0.70
POSITIVE LOGITS
he
3.29
he
1.72
он
1.72
He
1.28
HE
1.27
він
1.25
הוא
1.15
वह
1.07
He
0.99
hee
0.95
Act
ivations
Density 0.541%
Test
Steer
Stacked
Snippet
Full
Show Breaks
Hide Breaks
No Known Activations
