© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Jacobian Lens
NEW
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Steer
SAE Evals
Exports
interp-engine
NEW
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
Home
Models
Llama3.3-70B-IT
llama3.3-70b-it
Meta
Jump to Source/SAE
50-resid-post-gf
Source/SAE
Go
Jump to Feature
50-resid-post-gf
Source/SAE
INDEX
Go
Releases
Llama 3.3 70B Instruct SAE
February 2025
Goodfire
llama3.3-70b-it-gf
Attention Visualizer
HeadVis
(Luger, Kamath et al.)
Find Head By Metric
Metric & Number of Heads
Induction Score
Prev Token Score
Attention Entropy
Self Attention
Top 8
Click head to select
Layer 18
Head 4
Layer 52
Head 19
Layer 76
Head 56
Head 57
Head 61
Head 63
Layer 77
Head 50
Head 52
Select Head Manually
Layer
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
Head Index
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
Search Explanations
All
By Release
By Model
By Sources
MODEL
Show Dashboards
Hide Dashboards
Search via Inference
?
Resid Post
All Layers
SEARCH
Run Example Search
Random
🌮 Food
📰 News
📖 Literary
👯 Personal
🧑💻 Programming
🧑🔬 Technical
🧑🏫 Academic
💼 Business
🧑⚖️ Legal
🧑🏫 Educational
🗼 Cultural
Browse
MODEL
Resid Post
LAYER
Features in
LLAMA3.3-70B-IT
@
50-resid-post-gf
Hover over a feature on the left to preview its details.
Click a feature to lock it and interact with it.