© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.
    Recent Explanations
    text that presents or discusses arguments, positions, or perspectives on social and political issues.
    claude-4-5-sonnet
    headline, doesn't it? :o
    Neuronpedia logo
    QWEN3-14B
    20-RESID-BATCHTOPK-65K__L0-80
    INDEX 12434
    Looking at the activations, I notice that all the activation values shown are 0. This means the neuron is not activating on any of the tokens in these examples. However, based on the instruction to explain what the neuron is looking for, and noting that the examples contain technical
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 23309
    single-digit numbers, particularly in mathematical or data contexts.
    claude-4-5-sonnet
    ↵-0.01↵What is the nearest
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 64041
    line breaks or whitespace in technical/code documentation.
    claude-4-5-sonnet
    -image]][coveralls-url]↵↵An HTTP content negot
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 50115
    word fragments ending in suffixes like "-ed", "-es", "-ation", or "-ing" that form past participles or noun forms
    claude-4-5-sonnet
    ripped_N3Corrected_clone_lToads_
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 2521
    phrases introducing clarifications or additional information for readers.
    claude-4-5-sonnet
    ↵↵A:↵↵For anyone who
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 30040
    documents containing code, technical specifications, or structured data formats.
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 30119
    relative file path references in code (specifically the pattern "../../").
    claude-4-5-sonnet
    JS↵    mod(require("../../lib/codemirror"));
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 61849
    documents that are primarily technical, legal, or formal text with specialized formatting and terminology.
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 62913
    Chinese characters or non-English (particularly Asian language) text.
    claude-4-5-sonnet
    MonitorDlg.h : å¤´æĸĩ件↵//↵↵#pragma
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 63973
    whitespace characters, particularly newlines and tabs.
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 22879
    the digit '0' in numeric contexts.
    claude-4-5-sonnet
    2007/06/rich-programmer
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 42378
    the word "purpose" in formal or academic contexts.
    claude-4-5-sonnet
    the random matrix. The purpose of this paper is to
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 9006
    Looking at the activations, all values are 0 in these examples. This neuron does not activate for any tokens in the provided documents. The neuron appears to find **nothing in these particular examples** (all activations are zero).
    claude-4-5-sonnet
    "Man With the Golden Voice".↵↵When war broke out
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 57046
    periods that end sentences in technical or formal text.
    claude-4-5-sonnet
    , arachidonic acid is referred to as an
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 2787
    commas in formal or structured text, particularly after dates, technical parameters, or list items.
    claude-4-5-sonnet
    of society.↵↵First, Anselm and his
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 17637
    Looking at the activations, I notice that the neuron has very low activations (all 0 or close to 0, with only one activation of 0.4766 for "some") across all the examples shown. However, examining the content of the documents where it
    claude-4-5-sonnet
    bony structures interfere, some dosimeters in the coating
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 48346
    decimal points or periods following single digits in technical or numerical contexts.
    claude-4-5-sonnet
    software using HTML and node.↵↵~~~↵Six
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 48598
    commas separating items in lists or sequences of numbers and variables.
    claude-4-5-sonnet
    decreasing order.↵d, o
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 21733
    Looking at the activations, I notice that neuron 4 has extremely low activation values across all examples - the highest activation is only 0.6055, and almost all tokens have 0 activation. The examples span diverse content including mathematical expressions, biographical text, PHP code, medical
    claude-4-5-sonnet
    , -755663, -1
    Neuronpedia logo
    QWEN3.5-9B-PT
    15-QWENSCOPE-RES-64K
    INDEX 46619