© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    The neuron appears to be essentially inactive—it does not reliably detect or respond to any particular kind of token in these passages.
    o4-mini
    . It is located approximately 5 miles south of Vicksburg
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70505
    The neuron fires on named geographic locations (place names).
    o4-mini
     (JAR), the Pasvik company (PAS) and
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70494
    The neuron activates on numerical tokens (digits or number-related words).
    o4-mini
     300 workers till this year. 2
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70496
    The neuron fires on occurrences of the word “claim” (or its plural/inflected forms).
    o4-mini
     the attack ad’s claim that the health care bill
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70491
    The neuron activates on terms that denote bereaved status—words indicating someone is a widow, widower, orphan, or surviving parent.
    o4-mini
     of mine who is a widow got engaged. The children
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70497
    The neuron detects capitalized proper names and specialized terms (i.e. named entities and titles).
    o4-mini
     in baseball↵ Clean Up Records, a record label↵
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70490
    The neuron never fires on any of these texts—it appears effectively inactive and does not detect any consistent pattern.
    o4-mini
     ↵ ↵ ↵ ↵↵Category
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70487
    The neuron is broadly detecting common English function words—especially auxiliary and connective tokens like “is,” “to,” “would,” “if,” “it,” “but,” and similar.
    o4-mini
    osphenes, but wherein the elic
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70467
    This neuron strongly activates on tokens containing the substring “ote,” i.e. words ending in or including “ote” (e.g. epimastigote, creosote, heterozygote, etc.).
    o4-mini
    cyclic, epimastigote, and metacyclic)
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70461
    The neuron responds to longer, uncommon tokens—especially technical‐oriented terms and proper names—i.e. specialized jargon or proper nouns.
    o4-mini
     UBM (under bump metallurgy) for flip chip inter
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70465
    This neuron detects instances of reported speech or dialogue attribution—especially sentences that begin with a pronoun (He/She) introducing what someone says or does, often marked by a colon.
    o4-mini
     beautiful: He tells her he loves her and makes her
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70459
    The neuron activates on cognitive or opinion‐expressing verbs (e.g. think, expect, believe).
    o4-mini
    , don't think that it does, and the
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70480
    The neuron fires on any token containing the letter sequence “lag.”
    o4-mini
    Lagrangian coherent structures at the
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70474
    The neuron fires on multi-syllable capitalized names—that is, it picks out proper nouns and named entities.
    o4-mini
    ↵ By place ↵ Byzantine Empire ↵ August 
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70468
    The neuron strongly activates on the word “improved,” highlighting instances of that specific adjective.
    o4-mini
    35.↵An improved one-pot synthesis procedure
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70486
    The neuron activates on tokens containing numeric values—especially version numbers and decimal quantities.
    o4-mini
    Miner, Partek Genomics Suite and so on. Most
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70462
    The neuron fires on programming‐style identifiers—especially CamelCase API or framework names and properties (e.g. ModelState, IsValid, navigationItem, TempData).
    o4-mini
     it possible to apply ModelState.IsValid to just one
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70475
    The neuron fires on occurrences of the word “halt” (and its morphological variants like halting, halted) in the text.
    o4-mini
    't know how to halt the execution of a function
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70463
    The neuron responds to underscore characters—i.e. it fires on the “_” token (as used in identifiers or variable names).
    o4-mini
    let↵fun help(_a:'a list) :
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70449
    The neuron selectively detects the occurrence of the term “response” (especially in phrases like “response of” or “response to”) in clinical or experimental treatment contexts.
    o4-mini
    q/liter. The response of the serum potassium level
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 70454