© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    core topic terms—salient nouns and domain-specific keywords that denote the main subject or concepts in informational or technical text.
    gpt-5
    An “About Me” page can be critical to your
    Neuronpedia logo
    GEMMA-3-12B
    31-GEMMASCOPE-2-RES-16K
    INDEX 133
    The neuron fires strongly on content‐bearing nouns and proper nouns (e.g. product names, service terms, organization and role titles).
    o4-mini
    An “About Me” page can be critical to your
    Neuronpedia logo
    GEMMA-3-12B
    31-GEMMASCOPE-2-RES-16K
    INDEX 133
    This neuron specifically fires on the word “Chemistry,” as it appears in academic department or affiliation names.
    o4-mini
    2.↵↵Department of Chemistry , Capital Normal University ,
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 126
    positive adjectives used to describe quality or value.
    claude-4-5-haiku
    establish a thoughtful, effective and cost-conscious direction for
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 120
    The neuron consistently fires on numeric expressions—both digits and spelled-out numbers (including ordinals and cardinals).
    o4-mini
    collaborative work chair to an eight-hour task chair,
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 117
    This neuron detects mentions of John Rawls’s work and key terms from his political‐liberal theory (e.g. Rawls, Political Liberalism, justice, fairness, normative principles).
    o4-mini
    of Rawls' Political Liberalism (Pl). There
    Neuronpedia logo
    QWEN2.5-7B-IT
    11-RESID-POST-AA
    INDEX 63
    The neuron is looking for past-tense or past-participial verbs (i.e. “-ed” forms).
    o4-mini
    The perversion has been developed in our own time by
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 41
    This neuron activates on numeric tokens, especially multi‐digit numbers with decimal points (i.e. floating-point measurements).
    o4-mini
    without making notes soon after the experience. Looking back a
    Neuronpedia logo
    GEMMA-3-27B
    16-GEMMASCOPE-2-RES-16K
    INDEX 30
    business and finance reporting about specific companies, especially references to corporate performance metrics, stock/share activity, and mergers or acquisitions.
    gpt-5
     sector.↵↵RIM’s current problems are well documented
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 2304
    expressions of personal wondering or questioning, typically first-person statements indicating uncertainty or curiosity.
    gpt-5
    ↵mmaunder↵I wonder if he covers front and
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 3018
    language signaling that something has been finished or brought to completion, often in temporal clauses marking “upon/when” completion of an action or process.
    gpt-5
     click ‘Save Changes’ when you are finished.<bos>
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 1194
    numeric identifiers and codes in references/metadata (digits in URLs/DOIs, catalog or gene IDs, phone/patent numbers), with a strong bias toward the sequence 17.
    gpt-5
    0.1017/CBO97
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 13453
    LaTeX-style mathematical notation referring to norms—particularly L2 norms—and related functional analysis expressions.
    gpt-5
     $\beta$ ranging from 2 to 4 and
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 6384
    text involving PostgreSQL-specific SQL and metadata, especially system catalog/schema operations and Npgsql-based connection/query code in C#.
    gpt-5
    database.datistemplate = false set.↵↵<bos>
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 11339
    HTML/XML markup tokens, especially closing tags and structural block elements within code snippets.
    gpt-5
     Button END -->↵↵</div>↵↵<br />
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 7817
    mentions of military installations and unit organizational history, especially bases/airfields, squadrons/wings, and their activations, assignments, movements, and station locations.
    gpt-5
     military uses Guantanamo Naval base in south Cuba as
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 12981
    closing curly braces that mark the end of code blocks in programming snippets.
    gpt-5
    000);↵            }↵        }↵
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 10619
    aggressive, confrontational commands or threats directed at “you,” often shouted with profanity and emphatic punctuation.
    gpt-5
     on what's mine. The slave you've
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 728
    special formatting and layout markers—especially unusual whitespace/indentation—that signal tables, section breaks, lists, or math/technical formatting in structured documents.
    gpt-5
     roots.↵↵  Nr.    $|R
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 11565
    blank lines that mark paragraph or section breaks, especially preceding headings in formal documents.
    gpt-5
     recurrence after curative resection.↵↵RESULTS {#s2}
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 3459