© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    date/time stamps in technical text, especially numeric dates and times in metadata or “Generated on/Date” headers with hyphen/colon-separated sequences.
    gpt-5
    2017-02-07↵↵
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 322
    The neuron activates on numeric tokens representing dates—especially four-digit year strings in comments or metadata.
    o4-mini
    2017-02-07↵↵
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 322
    blank lines or whitespace in code.
    claude-4-5-haiku
            cart.sum++↵    },↵    //
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 320
    The neuron is primarily detecting numeric expressions (years, counts) and all-caps acronyms or organization names.
    o4-mini
     the EU Commissioner for International Cooperation, Humanitarian Aid and Crisis
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 6976
    The neuron responds strongly to object attribute or method‐call syntax, i.e. an identifier followed by a dot (`.`).
    o4-mini
    if i == q1.dequeue():↵        counter
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 48132
    This neuron activates on references to “cgi-bin” file paths or URLs (including the separate “cgi”, “-”, and “bin” tokens).
    o4-mini
     test files in the cgi-bin, httpdocs and
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 75694
    The neuron fires on short, all-caps letter sequences (two-letter acronyms/abbreviations).
    o4-mini
     study of a peculiar nebula MF16 associated with an
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 103356
    The neuron strongly activates on mentions of “aloe vera” (especially in product or juice contexts).
    o4-mini
     solved with two words: aloe vera. Does you stomach
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 89974
    The neuron fires on generic product‐description phrases detailing what a device is used for (e.g. “for use in a variety of applications,” “keeps any system running smoothly,” etc.).
    o4-mini
     in restaurants, specialty stores, farmer's markets and
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 59040
    The neuron is triggered by Java method/function names and related keywords (e.g. method declarations like “protected void onActivityResult” and calls like “startActivityForResult”).
    o4-mini
    REQUEST);↵↵protected void onActivityResult(int requestCode,
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 98018
    The neuron strongly activates on mentions of airports (e.g. the word “Airport” and airport names).
    o4-mini
    23, 2006 the airport had
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 60104
    The neuron strongly activates on isolated code‐style tokens (identifiers like “map,” “name,” “Python,” etc.) and numeric literals, i.e. short alphanumeric pieces you’d see in code or metadata.
    o4-mini
    ↵↵// Dispatch↵const mapDispatchToProps = {↵  
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 87013
    The neuron activates on date and time expressions (months and associated numbers) in document headers.
    o4-mini
     and Submitted Nov. 25, 19
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 7964
    This neuron detects words and phrases that signal collective support or solidarity (e.g. “solidarity,” “support,” “outpouring of support,” “community support”).
    o4-mini
     aid organisations received in a show of international solidarity following the
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 37999
    The neuron activates on standalone numeric tokens (sequences of digits), i.e. numbers.
    o4-mini
    , March 2012↵↵(All workers
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 38408
    The neuron responds strongly to geographic and geopolitical terms—names of regions or broad place descriptors (e.g. Europe, Western, World, colonial, Ottoman, Asian).
    o4-mini
    ably similar systems have developed throughout history, whenever and wherever
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 34729
    The neuron activates on calls to JavaScript’s `createElement` (and related DOM‐element construction) methods.
    o4-mini
    var background = document.createElement("div");↵
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 8313
    The neuron strongly responds to tokens that appear in open-source license and copyright boilerplate (e.g. “forms,” “of,” “without,” “charge,” “AS IS”), i.e. it detects legal/license header language.
    o4-mini
    awp\calderaforms\cf2\Fields
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 90980
    The neuron strongly activates on the word “real” (as in “the real deal,” “real thing,” etc.), i.e. uses of “real” to signal authenticity.
    o4-mini
     determine fake news from the real stuff, the push to
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 7045
    The neuron strongly activates on multi-digit numeric tokens—especially years.
    o4-mini
    It took Shah Jahan 17 years to build
    Neuronpedia logo
    GEMMA-2-27B
    34-GEMMASCOPE-RES-131K
    INDEX 55840