© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.
    Recent Explanations
    gerunds (verbs ending in "-ing") that express actions or ongoing activities.
    claude-4-5-sonnet
    that you feel fear in doing it, especially if this
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9884
    prepositions and common function words in formal or instructional contexts.
    claude-4-5-sonnet
    whole. The immense conformity of the population, has allowed
    the beginning of a new sentence or section, particularly after line breaks or at the start of paragraphs.
    claude-4-5-sonnet
     30+.↵↵The Raiders methodically and frequently
    generic or filler content, particularly from spam, low-quality web pages, or automatically generated text.
    claude-4-5-sonnet
    ! Check Out our other related articles like cheesecake, se
    sports-related text discussing player performance, game analysis, and team strategy.
    claude-4-5-sonnet
    the Redskins?The guys know.has had great success
    adjectives describing quality, size, or desirability in descriptive or promotional contexts.
    claude-4-5-sonnet
    it but based on the empty plate, I know Mr
    Looking at the activations, this neuron responds strongly to: - Formal, organizational language - Geographic/location references (countries, regions, cities) - Institutional/professional contexts (grants, programs, services) - Numeric data (especially when describing scope, populations served
    claude-4-5-sonnet
    scheduled for Saturday, October 20, 2
    periods following sentences, especially at major sentence or paragraph boundaries.
    claude-4-5-sonnet
    s world capsizes.↵↵Sexual assault is terrifying,
    technical specifications and numerical data, particularly in product descriptions or code.
    claude-4-5-sonnet
    clarified it for me directly. That PR
    technical or specialized terminology, particularly related to products, brands, models, and professional/industry-specific jargon.
    claude-4-5-sonnet
    all aspect of their Walmart business including sales, category management
    religious or biblical content, particularly Christian theological texts and scripture references.
    claude-4-5-sonnet
    ’t say anything about Nazareth. It was a question
    Let me analyze the activation patterns for Neuron 4. Looking at the high activation values (>200): First document: Very high activations on words like "supports" (363.7), "Expansion" (383.8), "of" (421.9),
    claude-4-5-sonnet
    .↵↵Sponsorship for “Tuition Aid for Participants
    historical or descriptive passages about ancient civilizations and their peoples, customs, and daily life.
    claude-4-5-sonnet
    fig tree.” In those days “under the fig tree
    contrasting statements or turning points introduced by coordinating conjunctions like "but."
    claude-4-5-sonnet
    awards over the decades, but it is in the public
    descriptive or emphatic words and phrases related to unusual, extreme, or fantastical subjects and experiences.
    claude-4-5-sonnet
    described as, Nazi “flying saucers” and had
    introspective, self-reflective personal narrative or contemplative thought, often involving questions about personal growth, awareness, or emotional/spiritual development.
    claude-4-5-sonnet
    old ways.↵↵In allowing even one thought of justification
    references to astronomical or cosmic objects and distances.
    claude-4-5-sonnet
    ebaran, a solar system 68 light-
    critical or negative commentary about political corruption, moral decay, or institutional failures.
    claude-4-5-sonnet
    go, but will narrow it down to one for today
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 11925
    adjectives describing large quantities, sizes, or magnitudes.
    claude-4-5-sonnet
    year for amassing a large number of properties to 
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 26928
    words with intense or extreme connotations, particularly those describing something impressive, severe, or extraordinary.
    claude-4-5-sonnet
    work yesterday and wanted to die fifteen times. It's
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 33017
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14492
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 11113
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 7778
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9979
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14514
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9722
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 13462
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 8759
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9906
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 15507
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 15437
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14350
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9719
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9233
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 15741
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 8799