© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
Home
Models
Qwen3-1.7B
qwen3-1.7b
Alibaba
Jump to Source/SAE
0-llamascope-2-lorsa-16k-k64
Source/SAE
Go
Jump to Feature
0-llamascope-2-lorsa-16k-k64
Source/SAE
INDEX
Go
Releases
Qwen3 SAEs
April 2026
Adam Karvonen
qwen3-res-ak
Circuit Tracing with Interpretable Attention
April 2026
OpenMOSS
llama-scope-2
Attention Visualizer
HeadVis
(Luger, Kamath et al.)
Find Head By Metric
Metric & Number of Heads
Induction Score
Prev Token Score
Attention Entropy
Self Attention
Top 8
Click head to select
Layer 3
Head 10
Layer 6
Head 11
Layer 16
Head 10
Head 14
Head 15
Layer 20
Head 14
Layer 21
Head 8
Head 9
Select Head Manually
Layer
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
Head Index
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Circuit Tracing
?
Choose a Featured Graph to Open
Generate New Graph
Search Explanations
All
By Release
By Model
By Sources
MODEL
Show Dashboards
Hide Dashboards
Browse
MODEL
Attn/LORSA - 16k - k64
LAYER
Features in
QWEN3-1.7B
@
0-llamascope-2-lorsa-16k-k64
Hover over a feature on the left to preview its details.
Click a feature to lock it and interact with it.