© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.
    Recent Explanations
    the auxiliary verb "be" in future tense constructions (will be).
    claude-4-5-sonnet
    0.↵↵I will be receiving a complimentary copy of
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 4479
    words that indicate minor issues, problems, or negative qualifications (particularly with adverbs like "slightly" and phrases suggesting something is less than ideal).
    claude-4-5-sonnet
    difficult and complications sometimes do occur. The whole procedure is
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 17804
    informal or colloquial language, particularly slang terms and casual expressions.
    claude-4-5-sonnet
    DB tables are splitted as hell (like users and their
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 30378
    the phrase "one of" in formal or technical writing contexts.
    claude-4-5-sonnet
    look absolutely drool-worthy! It’s perfect
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 12514
    line breaks or paragraph boundaries between distinct sections of text.
    claude-4-5-sonnet
    of new hardware deployment?↵↵Are you upgrading equipment and
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 5951
    the word "is" when it appears in isolation or as a standalone token.
    claude-4-5-sonnet
    work, and then it is copied into the main canvas
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 10326
    proper nouns, particularly names and brand names.
    claude-4-5-sonnet
    files as MP3, Twonky streams it as
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9663
    the phrase "to be" in formal or technical writing contexts.
    claude-4-5-sonnet
    the First World War, so i’ve taken this
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 14278
    the word "to" when it precedes verbs or indicates purpose/direction in formal or instructional contexts.
    claude-4-5-sonnet
    from Canon Frome have taken all our hay and corn
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 9863
    connecting words in the middle of sentences that link clauses or continue thoughts.
    claude-4-5-sonnet
    ," she says, "but for me, one of
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 8992
    text that presents or discusses arguments, positions, or perspectives on social and political issues.
    claude-4-5-sonnet
    headline, doesn't it? :o
    Neuronpedia logo
    QWEN3-14B
    20-RESID-BATCHTOPK-65K__L0-80
    INDEX 12434
    Looking at the activations, I notice that all the activation values shown are 0. This means the neuron is not activating on any of the tokens in these examples. However, based on the instruction to explain what the neuron is looking for, and noting that the examples contain technical
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 23309
    single-digit numbers, particularly in mathematical or data contexts.
    claude-4-5-sonnet
    ↵-0.01↵What is the nearest
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 64041
    line breaks or whitespace in technical/code documentation.
    claude-4-5-sonnet
    -image]][coveralls-url]↵↵An HTTP content negot
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 50115
    word fragments ending in suffixes like "-ed", "-es", "-ation", or "-ing" that form past participles or noun forms
    claude-4-5-sonnet
    ripped_N3Corrected_clone_lToads_
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 2521
    phrases introducing clarifications or additional information for readers.
    claude-4-5-sonnet
    ↵↵A:↵↵For anyone who
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 30040
    documents containing code, technical specifications, or structured data formats.
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 30119
    relative file path references in code (specifically the pattern "../../").
    claude-4-5-sonnet
    JS↵    mod(require("../../lib/codemirror"));
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 61849
    documents that are primarily technical, legal, or formal text with specialized formatting and terminology.
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 62913
    Chinese characters or non-English (particularly Asian language) text.
    claude-4-5-sonnet
    MonitorDlg.h : å¤´æĸĩä»¶↵//↵↵#pragma
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 63973