© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.
    Recent Explanations
    quotations or quoted speech, particularly detecting the beginning or end of direct quotes and dialogue.
    claude-4-5-sonnet
    ’s atmosphere should be perceptible to the naked eye when
    Neuronpedia logo
    QWEN3-14B
    20-RESID-BATCHTOPK-65K__L0-80
    INDEX 15159
    technical or specialized nouns in formal/academic contexts, particularly in scientific and patent documents.
    claude-4-5-sonnet
    write a simple multi-layer network with 3 neurons (
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 39570
    references to specific fields, disciplines, or specialized domains of activity.
    claude-4-5-sonnet
    meeting minimum requirements for viewing ads per day and completing appropriate
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 17087
    words related to technical or scientific processes, procedures, and specialized domains (particularly in patents, scientific papers, and technical descriptions).
    claude-4-5-sonnet
    and selenium hydrides are formed at higher acidity. All
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 10883
    words related to positive qualities or pleasant experiences, particularly those describing aesthetic, emotional, or atmospheric appeal.
    claude-4-5-sonnet
    elasticity and an engineered body consciousness. Spring at Phi had
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 16096
    proper nouns and names (particularly surnames and technical/product names).
    claude-4-5-sonnet
    by hard-up families last night after saying they were to
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 20556
    words indicating temporal or contextual similarity, particularly "as" and phrases comparing one thing to another.
    claude-4-5-sonnet
    . This election was a part of national Italian general election
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 29973
    sentence or paragraph openings, particularly at the start of new topics or sections.
    claude-4-5-sonnet
    ↵↵Parcel2Go.com has strengthened its international shipping service
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 14780
    words related to physically demanding or challenging activities and seasons.
    claude-4-5-sonnet
    renowned all-you-can-eat data plan, with 
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 14130
    introductory or framing language in technical and academic documents, particularly statements about background information, requirements, or the purpose of research.
    claude-4-5-sonnet
    risk factors combine: the interaction between alcohol
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 14941
    semicolons that appear in formal or technical writing contexts.
    claude-4-5-sonnet
    how dogs must be rescued; and the reporter on the
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14363
    the word "of" when it appears in certain contexts, particularly in phrases like "none of", "most of", or constructions with "but".
    claude-4-5-sonnet
    be worn in nowadays. Take it easy and enjoy,
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12418
    references to past time periods, especially specific years or decades.
    claude-4-5-sonnet
    in the early 70’s when a group
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14721
    biographical and administrative details about individuals and regulations.
    claude-4-5-haiku
    Church South; he preaches and teaches in the public
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 4537
    biographical or descriptive information about people, particularly in formal records or historical documents.
    claude-4-5-sonnet
    Church South; he preaches and teaches in the public
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 4537
    punctuation marks, particularly commas and periods, that appear in formal or narrative text.
    claude-4-5-sonnet
    to be allowed to love.
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12751
    Star Wars references and terminology, particularly the word "Jedi" and related characters and concepts from the Star Wars universe.
    claude-4-5-haiku
    vader is not a Jedi.
    Neuronpedia logo
    GPT2-SMALL
    9-RES-JB
    INDEX 21474
    The neuron identifies specific lexical items, often proper nouns, technical terms, or distinct non-English words.
    gemini-2.5-flash
    , no drugs.\nRec marijuana.\nCurrent medications:Med
    Neuronpedia logo
    LLAMA3.3-70B-IT
    50-RESID-POST-GF
    INDEX 25074
    stems of content words—especially nouns, proper names, or template field labels—often appearing at the beginning of a word or token.
    gpt-5
    , no drugs.\nRec marijuana.\nCurrent medications:Med
    Neuronpedia logo
    LLAMA3.3-70B-IT
    50-RESID-POST-GF
    INDEX 25074
    the beginning of a text sequence or document.
    claude-4-5-haiku
    <bos>holiday↵
    Neuronpedia logo
    GEMMA-3-4B-IT
    9-GEMMASCOPE-2-RES-16K
    INDEX 122