OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
The neuron detects tokens that appear at the start of the model/assistant's responses—especially the conversational acknowledgement "Okay" or other assistant-turn opening tokens.
gpt-5-mini
based on a30-year tenor (loan
questions and agenda-style overviews that introduce or enumerate specific topics to be discussed or explained.
gpt-5
wolf's howl unique, and how the wolf population
programming and scripting code tokens, especially method/function calls, query/filter operators, and shell pipeline syntax.
gpt-5
: "aText".replace("seachPattern","
human-centric plural nouns, especially those referring to people’s identity, lives, and sensory/communicative body parts.
gpt-5
the money.↵↵Black lives matter. And the lives
expressions of subjective evaluation or sentiment, especially opinionated judgments about quality, value, or experiences in reviews or commentary.
gpt-5
LOL).↵↵As with most products, it's
category-defining common nouns that denote goods, services, or organized activities, especially in informational or promotional contexts.
gpt-5
offering the benefits of drip watering at a<bos>
descriptions of hotel or lodging amenities and room/property features, especially “with”-phrased facilities, bathrooms, electronics, and on-site services (often including measurements or availability/cost details).
gpt-5
), concealed flat screen TV with Sky and Netflix.
typographic apostrophes (the curly ’) used in English contractions and possessives.
gpt-5
seem overwhelming. It shouldn’t. You can’
asterisk markup used for informal stage directions/emotes or bullet-style emphasis in text.
gpt-5
UC and Moon!↵↵*wonders what Steph did
apostrophe markers in English contractions and possessive forms.
gpt-5
2010-2018 One Sister
dense academic/technical prose, especially with quantitative or economics/science terminology and formal, jargon-heavy phrasing.
gpt-5
Culture: of drinks may Add true staff for people(
This neuron detects rare or highly salient content tokens — uncommon words or numbers that carry strong informational weight.
gpt-5-mini
having a ceremony after already being married.(This
key, high‑salience content words that carry a sentence’s main focus—especially emphasized terms, negations, and core subject nouns/verbs (e.g., “hard,” “no,” “over,” primary topic keywords).
gpt-5
's world is *hard*. We're bombarded
the verb "heard" and words that follow it in reported speech or hearsay contexts.
claude-4-5-haiku
. For years I had heard many versions of the history
