© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
MAY 26
Assistant Axis
JAN 26
Circuit Tracer
APR 26
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
Docs
Community
Blog
Privacy & Terms
Contact
Sign In
Home
Models
Llama3.3-70B-IT
llama3.3-70b-it
Meta
Jump to Source/SAE
Neurons Layer 0
Go
Jump to Feature
Neurons Layer 0
INDEX
Go
Releases
Llama 3.3 70B Instruct SAE
February 2025
Goodfire
llama3.3-70b-it-gf
Attention Visualizer
HeadVis
(Luger, Kamath et al.)
Find Head By Metric
Metric & Number of Heads
Induction Score
Prev Token Score
Attention Entropy
Self Attention
Top 8
Click head to select
Layer 18
Head 4
Layer 52
Head 19
Layer 76
Head 56
Head 57
Head 61
Head 63
Layer 77
Head 50
Head 52
Select Head Manually
Layer
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
Head Index
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
Search Explanations
All
By Release
By Model
By Sources
MODEL
Show Dashboards
Hide Dashboards
Search via Inference
?
All Layers
SEARCH
Run Example Search
Random
🌮 Food
📰 News
📖 Literary
👯 Personal
🧑💻 Programming
🧑🔬 Technical
🧑🏫 Academic
💼 Business
🧑⚖️ Legal
🧑🏫 Educational
🗼 Cultural
Browse
MODEL
LAYER
Features in
LLAMA3.3-70B-IT
@
0
Hover over a feature on the left to preview its details.
Click a feature to lock it and interact with it.