© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.
    Recent Explanations
    numerical temperature values with their units (degrees Celsius, Fahrenheit, or Kelvin).
    claude-4-5-sonnet
    , and then cooled to 4°C. Two modified
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 81
    the pronoun "it" (or "It") at the beginning of sentences, particularly when introducing or explaining a concept.
    claude-4-5-sonnet
    market and other media.↵It begins with a specific purpose
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 16149
    HTML/CSS/JavaScript code containing the attribute "id=" in element declarations.
    claude-4-5-sonnet
     <div class=""><div id="block-menu-secondary-links
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 6476
    the phrase "willing to" followed by a verb, indicating readiness or openness to perform an action.
    claude-4-5-sonnet
    5 blocks away now and willing to help when I want
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 25363
    references to artists, artworks, and art historical documentation (names, dates, exhibition details, and archival citations).
    claude-4-5-sonnet
    Private Archives of Julio Le Parc, Cachan
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 3950
    the verb "pretend" or "pretending" along with its immediate context (often followed by "to" or "not to").
    claude-4-5-sonnet
    his own game, I pretended not to understand the gesture
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 13677
    words or phrases that indicate similarity, comparison, or things being used together in a relationship.
    claude-4-5-sonnet
    cyclotis, often are grouped with the better-known
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 3515
    the phrase "difference between" or "distinction between" when comparing two things.
    claude-4-5-sonnet
    might argue that the difference between the two could be chalk
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 9439
    Looking at the activations, this neuron activates strongly (values 4-5) on tokens like "os", "i", "e", "ne" that appear to be parts of external link sections in Wikipedia articles across multiple languages (Spanish "Enlaces externos", Italian "Collegamenti esterni",
    claude-4-5-sonnet
    encias↵↵Enlaces externos ↵Lista de medall
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 24266
    proper nouns, particularly names of people and artists, often followed by punctuation marks like commas or hyphens.
    claude-4-5-sonnet
    : Papoose] Papoose, Papoose I had
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 16685
    the verb "mix" or its variations (mixing, mixed) followed by a preposition, typically describing the combining of different things.
    claude-4-5-sonnet
    has plenty of silly stuff mixed in with some nice racing
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 19170
    the word "insert" and its variations (inserting, inserted) in technical or procedural contexts.
    claude-4-5-sonnet
    to insert emojis from a PC with
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 7399
    the phrase "dig" followed by words indicating depth or thoroughness of investigation or effort.
    claude-4-5-sonnet
    and were already planning to dig through their old tapes and
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 5813
    text discussing transparency, public access, and open availability of information or documents.
    claude-4-5-sonnet
    school directors, release their documents for public inspection or any
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 14095
    the phrase "for me" in first-person narrative contexts.
    claude-4-5-sonnet
    hard to consider diet for me, because I had a
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 23650
    JavaScript/code syntax involving property access, assignment, and conditional statements with object properties.
    claude-4-5-sonnet
    -anonymity-header").html("Select anonymity level
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 22985
    references to awareness or commemorative days, weeks, or months.
    claude-4-5-sonnet
    12 being World Kidney Day, the pair is sharing
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 30752
    references to digital technology, devices, and online systems.
    claude-4-5-sonnet
    with our credit cards and Web browsers today, tomorrow's
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 18270
    references to fast food restaurant chains and franchise brands.
    claude-4-5-sonnet
    (the owner of Carl Jr.'s and Hardee
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 32493
    references to ethnic or national groups in contexts discussing their demographic presence, cultural identity, or historical conflicts.
    claude-4-5-sonnet
    Bulgaria all lands that are inhabited mostly by ethnic Bulgarians
    Neuronpedia logo
    LLAMA3.1-8B
    15-LLAMASCOPE-RES-32K
    INDEX 31495