© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
GEMMA-2-2B · 12-RES-MATRYOSHKA-DC · 3528 ｜ Neuronpedia
Home
Gemma-2-2B
12-RES-MATRYOSHKA-DC
3528
Prev
Next
MODEL
12-res-matryoshka-dc
Source/SAE
INDEX
Go
Explanations
elements related to mathematical or scientific expressions
oai_token-act-pair · gpt-4o-mini
No Scores
New Auto-Interp
AutoInterp Type
claude-4-5-haiku
Generate
Top Features by Cosine Similarity
Configuration
chanind/gemma-2-2b-batch-topk-matryoshka-saes-w-32k-l0-40/standard/blocks.12.hook_resid_post
How To Load
Prompts (Dashboard)
24,576 prompts, 128 tokens each
Dataset (Dashboard)
monology/pile-uncopyrighted
Features
32,768
Data Type
float32
Hook Name
blocks.12.hook_resid_post
Architecture
jumprelu
Context Size
1,024
Dataset
chanind/pile-uncopyrighted-gemma-1024-abbrv-1B
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/gemma-2-2b/12-res-matryoshka-dc/3528?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/gemma-2-2b/12-res-matryoshka-dc/3528?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Not in Any Lists
Add to List
▼
No Comments
ADD
Negative Logits
itſelf
-1.57
myſelf
-1.46
iſt
-1.25
Jefus
-1.25
Efq
-1.25
Anſ
-1.24
Theſe
-1.23
ſelf
-1.21
―――――
-1.21
^(@)
-1.20
POSITIVE LOGITS
<eos>
0.88
...
0.75
...
0.69
↵
0.65
Or
0.64
j
0.63
.
0.63
↵↵
0.63
0.62
(
0.60
Act
ivations
Density 1.296%
Test
Steer
Stacked
Snippet
Full
Show Breaks
Hide Breaks
No Known Activations
