© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    The neuron is looking for numeric tokens—particularly multi‐digit numbers, decimals, and other quantitative values embedded in the text.
    o4-mini
     the Solomon Islands.↵↵Career statistics↵↵International↵↵References
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131065
    The neuron fires strongly on “structural” code‐or‐doc tokens – things like section‐separator lines of dashes, package or domain names (e.g. imports, GitHub or Eclipse URLs), and other dotted/qualified identifiers.
    o4-mini
    ↵//------------------------------------------------------------------------------↵↵func LogLevel
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131044
    The neuron fires strongly on content-bearing tokens—nouns, main verbs, adjectives, and other informative words—while ignoring common function words.
    o4-mini
     option on a Les Paul. In 195
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131064
    The neuron fires on occurrences of the word “set” (particularly in uppercase or code‐related contexts such as macro names and commands).
    o4-mini
    -messages');↵↵// Set up an event listener for
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131059
    The neuron activates on individual numeric digit tokens (e.g. parts of phone numbers).
    o4-mini
    37-1682↵↵About:↵↵
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131060
    The neuron spotlights high-level evaluation or impact terms in technical writing—words like “risk,” “health,” “potential,” “clinical,” “diagnostic,” “conservation,” and “economic” that describe study outcomes or significance.
    o4-mini
     bleaching filtrates. The environmental risk of such compounds is
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131051
    The neuron fires on subjective evaluation words or phrases—i.e. tokens that express judgment of how well something “works,” “looks,” or “plays a role,” etc.
    o4-mini
    ↵Individually each query works, but I want to
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131057
    This neuron does not activate on any of the given tokens (i.e., it remains inactive).
    o4-mini
    32fun↵I'm
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131058
    The neuron is triggered by parts of web addresses—i.e. domain-name tokens, subdomain strings, and their punctuation in URLs.
    o4-mini
    ↵www.nebraska.gov/apps-courts
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131053
    The neuron strongly activates on integer literal tokens (numeric constants) in code.
    o4-mini
     a map of them by their integral id field:↵
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131049
    The neuron strongly activates on numeric tokens—i.e. any token containing digits or numeric values.
    o4-mini
     resource.id)↵↵resource_item_business_
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131038
    The neuron strongly activates on high-frequency function words (e.g. articles, prepositions, and other common grammatical “stop” words).
    o4-mini
     is before the Court upon the Motion for Indefinite
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131042
    The neuron activates on standalone numeric tokens (digits or numbers), i.e. it detects numeric identifiers in the text.
    o4-mini
    575-06↵↵↵RONALD MIXON
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131041
    The neuron fires strongly on content‐bearing keywords (mostly nouns and salient topic words) in titles or ad‐style listings, ignoring common function words.
    o4-mini
    Online Store↵↵Marriage Documents↵↵German Marriage Certificate Translation in
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131004
    The neuron fires on numeric literals (e.g. CSS values), i.e. tokens representing numbers and measurements.
    o4-mini
    -shadow: 2px 3px 5
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131036
    The neuron primarily activates on numeric literals (numbers) in the text.
    o4-mini
    0) {↵     result += "b"↵
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131035
    The neuron fires on tokens that signal law‐practice or attorney names and titles (e.g. “Offices,” “P.C.,” “lawyer,” “firm,” “Attorney,” etc.).
    o4-mini
     DUI/DWI defense lawyer and represent clients in all
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131027
    The neuron is picking out numeric tokens (e.g. years, quantities, or other digit sequences).
    o4-mini
     IC chip and the substrate, as well as the permissible
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131031
    This neuron responds to layout‐direction settings—e.g. XML orientation attributes or CSS flex-direction declarations.
    o4-mini
    "↵    android:orientation="horizontal"↵    
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131021
    The neuron activates on numeric tokens, i.e. numbers appearing in the text.
    o4-mini
     Year on Logic and Algorithms, DIMACS↵hosted the
    Neuronpedia logo
    GEMMA-2-27B
    22-GEMMASCOPE-RES-131K
    INDEX 131028