© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    the file extension ".html" in code, particularly in template paths, URLs, and file references.
    claude-4-5-sonnet
    ="/badge/index.html"/>↵<%namespace name
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 10000
    The neuron detects sentence boundaries / sentence-level shifts (it activates strongly on sentence-start tokens and on punctuation marking ends or major breaks).
    gpt-5-mini
     than just a diet trick. It’s also the
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 6555
    This neuron responds to programming control-flow constructs (conditionals and loop keywords like if, else, while/for and related block delimiters).
    gpt-5-mini
    ()↵        if wait:↵            self.join
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 7700
    UI/metadata elements such as dates, times, numbers, counts and other publishing/comment labels (timestamps, "Posted", "Comments", "Joined", etc.).
    gpt-5-mini
     on Apr 17, 2014
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 7019
    the word "The" when it appears at the start of sentences in factual or technical descriptions.
    claude-4-5-sonnet
     rear wheels by belts. The suspension used half elliptic leaf
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 0
    commas that follow descriptive phrases or clauses in sports journalism, particularly in soccer-related text.
    claude-4-5-sonnet
    at St James' Park, after which he said:
    Neuronpedia logo
    GPT2-SMALL
    8-RES-JB
    INDEX 55
    It detects tokens that signal explanations or causes — i.e., phrases pointing to reasons, causes, or the origin of something.
    gpt-5-mini
     to veterinarians to determine the reason for this result.↵↵
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 9416
    The neuron detects expressions of relationships or dependencies between entities (e.g., composition, containment, comparison).
    gpt-5-mini
    minimality assumption which is weaker than the CFC for both
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 2455
    The neuron detects named entities—titles of organizations, events, sports competitions, and other proper nouns.
    gpt-5-mini
     categories.↵↵President of Winter Games Federation of India (
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 2855
    The neuron detects tokens that signal logical reasoning, judgments about what makes sense, or claims about rationality and plausibility.
    gpt-5-mini
     flies in the face of logic.↵Another way to
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 3167
    Conditional negation checks (patterns like "if (!found)", "if not found", or other "not"/"!" tests indicating something is absent).
    gpt-5-mini
    ↵                    if (!found) {↵                        listModel
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 3067
    words expressing criticism, blame, or negligence (e.g., tokens indicating inaction, complacency, evasion, minimization, or inadequacy).
    gpt-5-mini
     DDT saw the GOP whitewash as a vindication.
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 2710
    The neuron detects numeric quantities and figure tokens (raw numbers and other numeric expressions) in the text.
    gpt-5-mini
     $150,000 total. Wilson
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 10245
    Mentions of meetings or planned meetings between political leaders or high‑level officials (words/phrases like "meet", "met", "planning to meet", "counterpart", leader names).
    gpt-5-mini
     and Xi are planning to meet, saying only it'
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 278
    It detects mentions of online discussion forums and related site/posting/navigation elements.
    gpt-5-mini
     trade-offs chat to forums web hosting options and trade
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 876
    technical, process-oriented phrases describing performing or initiating actions that attach/connect components or change system state
    gpt-5
    , individual interactions are constantly formed, remodeled, and broken
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 11200
    the neuron detects verbs in the past tense / past participle form (tokens ending in "-ed").
    gpt-5-mini
    , individual interactions are constantly formed, remodeled, and broken
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 11200
    the neuron fires on common function/connective tokens (frequent prepositions, auxiliaries, and transition words) that link clauses.
    gpt-5-mini
     two edges must intersect, since empty intersection is even.
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 9158
    code snippets that declare or reference data types and typed fields (e.g., primitive types, enums, string/number fields) within method signatures and data schemas.
    gpt-5
    "extendsDataType": "decimal"
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 8611
    references to football/soccer and related sports entities like teams, leagues, clubs, players, and positions.
    gpt-5
     is a Samoan professional football manager.↵↵Career↵
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-16K
    INDEX 2576