© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.
    Recent Explanations
    key, high‑salience content words that carry a sentence’s main focus—especially emphasized terms, negations, and core subject nouns/verbs (e.g., “hard,” “no,” “over,” primary topic keywords).
    gpt-5
    's world is *hard*. We're bombarded
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 1284
    the verb "heard" and words that follow it in reported speech or hearsay contexts.
    claude-4-5-haiku
    . For years I had heard many versions of the history
    Neuronpedia logo
    GEMMA-2-2B
    23-GEMMASCOPE-RES-16K
    INDEX 16330
    adjectives that evaluate or qualify nouns (e.g., indicating quality, complexity, specificity, rarity, or possibility).
    gpt-5
    Experimental Design:**  Planning effective experiments to maximize information gained
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 2673
    concepts and discussions related to light and optics, including illumination, color, wavelengths, scattering, and physics-of-light phenomena.
    gpt-5
    eye! You see things because light bounces off of them
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 24111
    the neuron detects section headings / numbered step labels and other high-level discourse markers that start or emphasize explanatory sections.
    gpt-5-mini
    eye! You see things because light bounces off of them
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 24111
    This neuron detects numeric tokens (strings containing digits, especially decimal/floating-point numbers).
    gpt-5-mini
    Apps, or Components within Larger Apps**↵    *
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 32725
    The neuron detects emphatic intensity words—strong evaluative adjectives and adverbs (intensifiers) that add emphasis to a description.
    gpt-5-mini
    ? Just finished a particularly satisfying placement yesterday. Really got
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 6474
    Tokens that mark emphasis or structural importance (section headings, bolded/emphatic words, numbers/dates or other prominent markers) indicating a document's important or attention-grabbing elements.
    gpt-5-mini
    lkIn19--1ad3fdc1
    Neuronpedia logo
    GEMMA-3-27B-IT
    41-GEMMASCOPE-2-RES-262K
    INDEX 59273
    numerical temperature values with their units (degrees Celsius, Fahrenheit, or Kelvin).
    claude-4-5-sonnet
    , and then cooled to 4°C. Two modified
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 81
    the pronoun "it" (or "It") at the beginning of sentences, particularly when introducing or explaining a concept.
    claude-4-5-sonnet
    market and other media.↵It begins with a specific purpose
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 16149
    HTML/CSS/JavaScript code containing the attribute "id=" in element declarations.
    claude-4-5-sonnet
     <div class=""><div id="block-menu-secondary-links
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 6476
    the phrase "willing to" followed by a verb, indicating readiness or openness to perform an action.
    claude-4-5-sonnet
    5 blocks away now and willing to help when I want
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 25363
    references to artists, artworks, and art historical documentation (names, dates, exhibition details, and archival citations).
    claude-4-5-sonnet
    Private Archives of Julio Le Parc, Cachan
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 3950
    the verb "pretend" or "pretending" along with its immediate context (often followed by "to" or "not to").
    claude-4-5-sonnet
    his own game, I pretended not to understand the gesture
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 13677
    words or phrases that indicate similarity, comparison, or things being used together in a relationship.
    claude-4-5-sonnet
    cyclotis, often are grouped with the better-known
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 3515
    the phrase "difference between" or "distinction between" when comparing two things.
    claude-4-5-sonnet
    might argue that the difference between the two could be chalk
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 9439
    Looking at the activations, this neuron activates strongly (values 4-5) on tokens like "os", "i", "e", "ne" that appear to be parts of external link sections in Wikipedia articles across multiple languages (Spanish "Enlaces externos", Italian "Collegamenti esterni",
    claude-4-5-sonnet
    encias↵↵Enlaces externos ↵Lista de medall
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 24266
    proper nouns, particularly names of people and artists, often followed by punctuation marks like commas or hyphens.
    claude-4-5-sonnet
    : Papoose] Papoose, Papoose I had
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 16685
    the verb "mix" or its variations (mixing, mixed) followed by a preposition, typically describing the combining of different things.
    claude-4-5-sonnet
    has plenty of silly stuff mixed in with some nice racing
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 19170
    the word "insert" and its variations (inserting, inserted) in technical or procedural contexts.
    claude-4-5-sonnet
    to insert emojis from a PC with
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 7399