© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    The neuron strongly activates on unusually rare or infrequent tokens—i.e. words that occur very infrequently in the corpus.
    o4-mini
    the word to do this among all existing media players.
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12290
    The neuron specifically detects numeric tokens representing decimal or floating-point numbers.
    o4-mini
    013-2018 market shares for
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 6148
    The neuron is highly sensitive to numeric and quantitative expressions (numbers, measurements, counts, or associated units).
    o4-mini
    to accept more challenging training. In the evening, we
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12056
    This neuron fires on imperative “add” instructions (and similar command verbs) in step-by-step or tutorial language.
    o4-mini
    bracelet or you want to add more pearls..↵↵You
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 6002
    The neuron activates on multi‐letter uppercase abbreviations (acronyms), especially when they appear in parentheses.
    o4-mini
    of High Energetic Materials (AIHEM). AI
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14011
    This neuron strongly fires on the word “all” when it appears in emphatic multi‐word expressions (e.g. “It all happened so quickly,” “Now all in one line”).
    o4-mini
    problem at all. It all happened so quickly. But
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 5966
    The neuron activates on numeric measurements (quantities, units, and values) in the text.
    o4-mini
    athletic build, he loved swimming and mountaineering and,
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 10414
    The neuron specializes in spotting technical or scientific terminology related to physical quantities and mathematical expressions (e.g. mentions of angles, currents, torques, equilibria, and related parameters).
    o4-mini
    known one-dimensional current sheet equilibrium is Harris current sheet
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 8135
    This neuron fires most strongly on tokens that single out or refer to a target group or category (e.g. “those,” “patients,” “website visitors,” etc.).
    o4-mini
    foregoing detailed description will provide those skilled in the art with
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12681
    This neuron strongly activates on passages that present structured numeric data or statistical information (e.g. lists of figures, percentages, or counts).
    o4-mini
    nominated games in the Arcade. A training session in advance
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 5274
    The neuron fires strongly on numeric tokens—especially floating‐point numbers—flagging decimal figures in the text.
    o4-mini
    8,070 filed Mar. 23
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 4690
    This neuron strongly activates on the first meaningful word of new sections or headings (e.g. the leading content token that begins a paragraph, title, or block).
    o4-mini
    awayThis image gallery named as 24 Best Go
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 8116
    This neuron selectively activates on numeric tokens written with decimal points (i.e. floating-point numbers).
    o4-mini
    RIGHT VIOLATION NOTICE: This piece of content was
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 7813
    The main thing this neuron does is pick out the unusually informative or high-weight tokens in a passage—words (including numbers, common function words, and key content terms) that carry the most semantic or structural importance.
    o4-mini
    factor these legal entity relationships into their implementation plans for new
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 7027
    The neuron fires on auxiliary or modal expressions that convey ability, permission, or potential.
    o4-mini
    the ways cannabis businesses are able to market, similar to
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 7780
    This neuron is triggered by imperative calls to action—short instructional phrases (often addressed to “you”) like “download this image for free,” “find the most recent pictures,” or “write a review and earn.”
    o4-mini
    the previous points. Study how you can organize your IELTS
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12289
    The neuron strongly activates on uncommon, low‐frequency tokens—i.e. those rare or “surprising” words or symbols in the text.
    o4-mini
    7pm to 9pm and on Thursday morning
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 8428
    The neuron strongly activates on religious/theological discourse and doctrinal exposition.
    o4-mini
    an opportunity to have Christ offered to you'. What a
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 11150
    The neuron strongly activates on mentions of “God” (and closely related theological terms describing His will, wrath, or relationship), effectively detecting explicit references to the deity.
    o4-mini
    of the wheel. If God’s way gets a
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 16382
    The neuron strongly activates on single tokens that are proper names, technical terms, or acronyms (e.g. brand and organization names, legislation abbreviations, and other named entities).
    o4-mini
    professors of zoology, professors of human flourishing, etc
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 16117