© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    This neuron detects mentions of John Rawls’s work and key terms from his political‐liberal theory (e.g. Rawls, Political Liberalism, justice, fairness, normative principles).
    o4-mini
    of Rawls' Political Liberalism (Pl). There
    Neuronpedia logo
    QWEN2.5-7B-IT
    11-RESID-POST-AA
    INDEX 63
    The neuron is looking for past-tense or past-participial verbs (i.e. “-ed” forms).
    o4-mini
    The perversion has been developed in our own time by
    Neuronpedia logo
    GEMMA-3-12B
    24-GEMMASCOPE-2-RES-16K
    INDEX 41
    This neuron activates on numeric tokens, especially multi‐digit numbers with decimal points (i.e. floating-point measurements).
    o4-mini
    without making notes soon after the experience. Looking back a
    Neuronpedia logo
    GEMMA-3-27B
    16-GEMMASCOPE-2-RES-16K
    INDEX 30
    business and finance reporting about specific companies, especially references to corporate performance metrics, stock/share activity, and mergers or acquisitions.
    gpt-5
     sector.↵↵RIM’s current problems are well documented
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 2304
    expressions of personal wondering or questioning, typically first-person statements indicating uncertainty or curiosity.
    gpt-5
    ↵mmaunder↵I wonder if he covers front and
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 3018
    language signaling that something has been finished or brought to completion, often in temporal clauses marking “upon/when” completion of an action or process.
    gpt-5
     click ‘Save Changes’ when you are finished.<bos>
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 1194
    numeric identifiers and codes in references/metadata (digits in URLs/DOIs, catalog or gene IDs, phone/patent numbers), with a strong bias toward the sequence 17.
    gpt-5
    0.1017/CBO97
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 13453
    LaTeX-style mathematical notation referring to norms—particularly L2 norms—and related functional analysis expressions.
    gpt-5
     $\beta$ ranging from 2 to 4 and
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 6384
    text involving PostgreSQL-specific SQL and metadata, especially system catalog/schema operations and Npgsql-based connection/query code in C#.
    gpt-5
    database.datistemplate = false set.↵↵<bos>
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 11339
    HTML/XML markup tokens, especially closing tags and structural block elements within code snippets.
    gpt-5
     Button END -->↵↵</div>↵↵<br />
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 7817
    mentions of military installations and unit organizational history, especially bases/airfields, squadrons/wings, and their activations, assignments, movements, and station locations.
    gpt-5
     military uses Guantanamo Naval base in south Cuba as
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 12981
    closing curly braces that mark the end of code blocks in programming snippets.
    gpt-5
    000);↵            }↵        }↵
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 10619
    aggressive, confrontational commands or threats directed at “you,” often shouted with profanity and emphatic punctuation.
    gpt-5
     on what's mine. The slave you've
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 728
    special formatting and layout markers—especially unusual whitespace/indentation—that signal tables, section breaks, lists, or math/technical formatting in structured documents.
    gpt-5
     roots.↵↵  Nr.    $|R
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 11565
    blank lines that mark paragraph or section breaks, especially preceding headings in formal documents.
    gpt-5
     recurrence after curative resection.↵↵RESULTS {#s2}
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 3459
    quoted passages from early modern English records—especially 17th‑century entries with names, dates, and archaic orthography in publication or trial contexts.
    gpt-5
     to print "A booke called Master William Shakespeare his
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 13651
    mentions of educational resources and downloadable/printable classroom materials (like templates, worksheets, and stationery).
    gpt-5
     Day in the Classroom with these Resources↵↵Celebrate Indigenous Peoples
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 14355
    references to Austria and Vienna—people, places, treaties, institutions, and culturally German/Austrian terms (including cuisine).
    gpt-5
     is run by an Austrian, and turns out dishes from
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 1271
    references to fonts—file names/paths and formats, plus font configuration/metadata (variants, glyph info) often appearing in URLs or code snippets.
    gpt-5
    google/fonts/trunk/ofl/corm
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 1917
    long, hyphenated numeric identifiers and citation codes, especially those appearing in academic references and URLs.
    gpt-5
    00-0002-769
    Neuronpedia logo
    GEMMA-2-9B
    31-GEMMASCOPE-RES-16K
    INDEX 4833