© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Models
Steer
SAE Evals
Exports
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
LLAMA3.1-8B · 31-LLAMASCOPE-RES-32K · 2509 ｜ Neuronpedia
Home
OpenMOSS · Llama Scope: SAEs for Llama-3.1-8B
Llama3.1-8B (Base)
Residual Stream
31-LLAMASCOPE-RES-32K
2509
Prev
Next
MODEL
31-llamascope-res-32k
Source/SAE
INDEX
Go
Explanations
specific numerical data and references in academic or formal documents
oai_token-act-pair · gpt-4o-mini
Triggered by @bot
No Scores
New Auto-Interp
AutoInterp Type
claude-4-5-haiku
Generate
Top Features by Cosine Similarity
Comparing With
LLAMA3.1-8B @ 31-llamascope-res-32k
Configuration
fnlp/Llama3_1-8B-Base-LXR-8x/Llama3_1-8B-Base-L31R-8x
How To Load
Prompts (Dashboard)
24,576 prompts, 128 tokens each
Dataset (Dashboard)
cerebras/SlimPajama-627B
Features
32,768
Data Type
bfloat16
Hook Name
blocks.31.hook_resid_post
Hook Layer
31
Architecture
jumprelu
Context Size
1,024
Dataset
cerebras/SlimPajama-627B
Activation Function
relu
Show All
Embeds
Show Plots
Show Explanation
Show Activations
Show Test Field
Show Steer
Show Link
IFrame
<iframe src="https://www.neuronpedia.org/llama3.1-8b/31-llamascope-res-32k/2509?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true" title="Neuronpedia" style="height: 300px; width: 540px;"></iframe>
Link
https://www.neuronpedia.org/llama3.1-8b/31-llamascope-res-32k/2509?embed=true&embedexplanation=true&embedplots=true&embedsteer=true&embedactivations=true&embedlink=true&embedtest=true
Not in Any Lists
Add to List
▼
No Comments
ADD
Negative Logits
19
-0.24
39
-0.23
18
-0.23
21
-0.23
11
-0.22
79
-0.22
17
-0.22
37
-0.22
13
-0.22
26
-0.21
POSITIVE LOGITS
500
0.51
499
0.42
498
0.41
502
0.41
501
0.41
503
0.41
505
0.40
480
0.39
510
0.38
497
0.38
Act
ivations
Density 0.086%
Test
Steer
Stacked
Snippet
Full
Show Raw Tokens
Show Formatted
Show Breaks
Hide Breaks
No Known Activations
