© Neuronpedia 2026
Privacy & Terms
Blog
GitHub
Slack
Twitter
Contact
Neuronpedia
Natural Language
Autoencoders
NEW
Assistant Axis
NEW
Circuit Tracer
UPDATE
Releases
Jump To
Search
Models
Steer
SAE Evals
Exports
Guides
API
Community
Blog
Privacy & Terms
Contact
Sign In
EXPLANATION TYPE
oai_token-act-pair
Description
OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
Author
OpenAI
URL
https://github.com/hijohnnylin/automated-interpretability
Settings
Default prompts from the main branch, strategy TokenActivationPair.
Recent Explanations
phrases expressing contrast or opposition between two states or perspectives, particularly in the form "being X" or "X versus Y" constructions.
claude-4-5-sonnet
of
psychosocial
stress
around
"
being
fat
."
We
use
the
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 66550
lines of code that contain method calls with `self` or object references followed by method invocations.
claude-4-5-sonnet
Bind
Data
();
↵
fs
Search
.
Visible
=
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 68480
the end of code blocks or statements in programming languages.
claude-4-5-sonnet
export
$
e
↵
done
↵↵
Works
:
↵
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 75139
comparative and superlative constructions, particularly phrases describing size, scale, or ranking relationships.
claude-4-5-sonnet
penis
,
you
have
the
highest
per
cross
section
area
of
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 332
email header formatting and metadata (including timestamps, sender/recipient information, and message routing details).
claude-4-5-sonnet
6
6
5
U
↵
FM
C
NO
WASHINGTON
DC
↵
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 36444
plural nouns in technical or scientific contexts.
claude-4-5-sonnet
to
questions
about
making
musical
instruments
?
↵↵
A
:
↵↵
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 40116
the token "sp" when it appears as an abbreviation for "sponsor", "service pack", "stored procedure", or in technical/code contexts.
claude-4-5-sonnet
function
add
Spons
ership
(
sp
ons
er
)
{
↵
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 98436
text formatting instructions or descriptions, particularly mentions of highlighting, bolding, or other visual emphasis applied to text.
claude-4-5-sonnet
this
string
,
these
bol
ded
numbers
vary
:
tv
m
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 12997
usernames or handles in chat logs and online forums.
claude-4-5-sonnet
mother
?
↵↵
~~~
↵
myname
ish
ere
↵
Given
a
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 79785
the beginning of academic article text, particularly after the title and abstract, where the main argument or discussion starts.
claude-4-5-sonnet
.
In
particular
,
this
article
explores
the
possibility
that
the
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 84288
sentence-ending periods in product listings, classified ads, and other commercial or transactional text.
claude-4-5-sonnet
touching
my
shoulders
.
Doesn
'
t
tangle
a
lot
.
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 104490
informational or encyclopedic text describing topics, events, or concepts.
claude-4-5-sonnet
anime
series
.
This
story
arc
illustrates
two
of
Jira
iya
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 28363
email unsubscribe links and instructions for opting out of mailing lists.
claude-4-5-sonnet
atlantic
.
com
↵
to
unsubscribe
ener
fax
daily
as
:
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 69009
statements describing whether something is normal or expected behavior.
claude-4-5-sonnet
↵
Is
this
"
normal
"
behaviour
?
I
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 67616
phrases expressing moral or ethical concerns about harm, waste, or mistreatment.
claude-4-5-sonnet
isex
uality
and
to
the
colonialism
,
sexism
,
and
racism
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 71496
code-related text, particularly method definitions and function calls in programming contexts.
claude-4-5-sonnet
add
(
e
)
method
to
first
look
-
up
the
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 9562
legal case citations and reporter references in court documents.
claude-4-5-sonnet
9
8
0
]
I
CR
7
5
5
is
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 70630
article or blog post subheadings and section transitions, particularly colons and line breaks that introduce new topics or list items.
claude-4-5-sonnet
candles
...
↵↵
Dark
Chocolate
:
Chocolate
lovers
,
rejoice
!
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 95594
whitespace and formatting characters in legal or formal documents, particularly tabs and spaces used for indentation and alignment.
claude-4-5-sonnet
3
2
4
"
All
right
,
"
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 73737
political or advocacy text about policy issues, legislation, and government actions.
claude-4-5-sonnet
Budget
and
Trump
care
contain
dramatic
GEMMA-2-27B
22-GEMMASCOPE-RES-131K
INDEX 93158