© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Models
Steer
SAE Evals
Exports
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
EXPLANATION TYPE
oai_token-act-pair
Description
OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
Author
OpenAI
URL
https://github.com/hijohnnylin/automated-interpretability
Settings
Default prompts from the main branch, strategy TokenActivationPair.
Recent Explanations
the word "macular" in medical and ophthalmological contexts.
claude-4-5-haiku
ov
ascular
age
-related
mac
ular
deg
eneration
(
n
AMD
QWEN3-4B
4-TRANSCODER-HP
INDEX 183
numeric values and numerical measurements in text.
claude-4-5-haiku
[\
"
']
(?
<
1
>[
^
\"
']
*)
GEMMA-3-12B
12-GEMMASCOPE-2-RES-16K
INDEX 159
the neuron looks for marketing/advertising text, especially product descriptions that include numbers and pricing/data.
gpt-5-nano
star
in
the
romance
of
the
century
,
nothing
and
no
GEMMA-3-12B
12-GEMMASCOPE-2-RES-16K
INDEX 158
the neuron activates on content-bearing topical words—especially nouns and proper nouns that signal key subjects or entities.
gpt-5-mini
star
in
the
romance
of
the
century
,
nothing
and
no
GEMMA-3-12B
12-GEMMASCOPE-2-RES-16K
INDEX 158
the word "the" appearing in definite article contexts before nouns.
claude-4-5-haiku
star
in
the
romance
of
the
century
,
nothing
and
no
GEMMA-3-12B
12-GEMMASCOPE-2-RES-16K
INDEX 158
copular constructions where “is” or “’s” is followed by the indefinite article introducing a noun phrase (the “is a/’s a” pattern).
gpt-5
of
people
.
This
is
a
fabulous
commem
oration
of
a
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 18875
mentions of numerical data, especially decimal figures, percentages, and currency amounts.
gpt-5
3
-
5
$
245
,
888
70
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 24473
numeric measurement values in styling/layout code (CSS/HTML/XML), such as lengths, sizes, spacing, and positioning parameters.
gpt-5
90
%;↵
margin
:
0
auto
;↵
max
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 32532
technical automotive specifications and performance stats, especially numeric powertrain, acceleration, speed, torque, transmission, and battery details.
gpt-5
figures
(
288
b
hp
,
0
-
62
mph
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 6653
references to overarching social ideologies and power structures, especially critiques of systemic oppression and hierarchy.
gpt-5
adherence
to
the
entire
patriarch
al
world
order
.
If
you
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 21269
references to contact information, especially email/phone details and notes about their availability or setup online.
gpt-5
target
emails
are
usually
also
available
online
tied
to
target
organizations
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 24004
the beginning of a document and LaTeX-style structural markers for sections and headings.
gpt-5
<|begin_of_text|>
pot
ato
e
hi
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 25464
domain-specific key terms and named concepts, such as technical components, standards, historical events, and other topic-defining nouns.
gpt-5
the
area
to
5
stories
or
a
few
blocks
can
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 2607
common function words and lightweight connective tokens that signal grammatical structure rather than content.
gpt-5
subtle
and
easily
sw
amped
by
other
more
colored
elements
in
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 3001
the definite article used to introduce noun phrases.
gpt-5
compromised
,"
including
some
of
the
bank
's
most
sensitive
systems
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 8045
situations where someone approaches a home and interacts with its entry (front door/porch/gate), especially knocking or ringing to gain attention.
gpt-5
so
he
couldn
't
knock
.
So
he
waited
.↵
He
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 11442
mentions of proper nouns—capitalized names, titles, or specific named entities.
gpt-5
"
Des
ert
Po
em
"
reflects
on
the
at
on
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 462
mentions of the winter season and closely related seasonal timing or context.
gpt-5
so
we
will
continue
our
winter
cleaning
tips
and
suggestions
.↵
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 6188
expressions about eliminating or getting rid of unwanted things, often framed as action-oriented, permanent removal.
gpt-5
...
and
how
to
permanently
get
rid
of
scars
-
even
LLAMA3.1-8B
25-LLAMASCOPE-RES-32K
INDEX 32334
programming-related identifiers, especially CamelCase or namespaced tokens within code-like text.
gpt-5
events
(
check
with
majestic
tours
/
activities
for
additional
stuff
LLAMA3.1-8B
15-LLAMASCOPE-RES-32K
INDEX 6796
