Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    APICircuit TracerNEWSteerSAE EvalsExportsSlackBlogPrivacy & TermsContact
    © Neuronpedia 2025
    Privacy & TermsBlogGitHubSlackTwitterContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    the word "between" typically used to introduce time periods, date ranges, or numerical ranges.
    claude-4-5-haiku
     prisoners at will.↵↵Between its establishment in 1
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-65K
    INDEX 58423
    the word "between" in comparative or contrastive statements.
    claude-4-5-haiku
     In our view the disparity between the compensatory damages ($5
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-65K
    INDEX 43412
    the word "between" and the article that typically follows it.
    claude-4-5-haiku
     about by the friendly intercourse between the courts of Berlin and
    Neuronpedia logo
    GEMMA-2-2B
    12-GEMMASCOPE-RES-65K
    INDEX 36693
    laudatory descriptors that signal high quality, popularity, prestige, or cutting‑edge status.
    gpt-5
     on Its Highly Acclaimed Past F1 2
    Neuronpedia logo
    GEMMA-2-2B
    4-GEMMASCOPE-MLP-65K
    INDEX 6
    phrases indicating progression or movement “through” something, literally or figuratively, often as “make one’s way through” paths, routes, or tasks.
    gpt-5
    zigzags its way through the
    Neuronpedia logo
    GEMMA-2-2B
    6-GEMMASCOPE-MLP-16K
    INDEX 8
    open-source software license headers and legal disclaimer boilerplate in source code files.
    gpt-5
    ↵ * KIND, either express or implied.  See
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 15887
    the beginnings of documents or sections, especially when followed by academic-style titles or citation metadata.
    gpt-5
    82: Selected Papers<bos>Diagnostic value of emergency medical
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 15385
    title-cased or camel/pascal-cased technical terms and identifiers, especially function/variable names, IDs, and capitalized multiword labels.
    gpt-5
     {↵↵    $Subpages=get_subpages
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 15277
    capitalized standalone keywords or headings, especially technical terms used as section titles, labels, or list items in scientific/technical text.
    gpt-5
     are related by:↵↵Inertia is obviously ignored, and
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 14684
    mentions of numerical measurements with scientific units and symbols in technical text.
    gpt-5
    Bond length in precursor (Å)   Bond length in
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 14497
    ASCII-style horizontal rules and table/code block separators made of repeated punctuation and monospaced spacing.
    gpt-5
    -------------------- ----------------------------------------------------- ----------↵  Age
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 13411
    sentence-initial demonstrative pronouns/determiners referring to something just mentioned, especially when used to start a statement.
    gpt-5
     send me a note! This great service reimagines
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 13087
    signals of structured, formal text—document headers/metadata, Q/A or code formatting, and dense scientific/legal/technical language.
    gpt-5
     costs.<bos>     The summaries of the
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 12896
    LaTeX math formatting commands and spacing constructs, especially sequences indicating fine-grained kerning and symbol formatting around Greek-letter expressions.
    gpt-5
    smash{\Phi }\mkern-2mu}\mk
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 11515
    the start-of-document marker, i.e., the beginning of a new text segment.
    gpt-5
     Manchester<bos>Queen Victoria’s private
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 11291
    syntax tokens that mark structure in code or markup, like tag delimiters, field prefixes, and operator-style punctuation.
    gpt-5
    1}↵        m_Offset: {x:
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 11228
    structured alphanumeric identifiers and paths, especially those with punctuation separators (hyphens/slashes/underscores) and numeric codes in URLs, figure/reference labels, and code tokens.
    gpt-5
    era-asv-logs/tree/master/
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 11224
    This neuron activates on highly structured technical text, especially LaTeX-style math/diagram syntax and code-like test identifiers with dense brackets, braces, operators, and numeric parameters.
    gpt-5
     left =15\] node\[above\] [ ]
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 10063
    structural connectors and delimiters linking elements—prepositions and conjunctions plus syntax symbols (slashes, braces, assignment/statement endings)—especially in technical, math, or code contexts.
    gpt-5
     4^{21}, 5
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 9367
    structural markers of formal, technical or expository prose—function words, punctuation and connective/notation cues that signal complex, multi-clause sentences and technical descriptions.
    gpt-5
    ic wiring is indispensable to a high density mounting and,
    Neuronpedia logo
    GEMMA-2-2B
    13-GEMMASCOPE-RES-16K
    INDEX 8808