© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    EXPLANATION TYPE
    oai_token-act-pair
    Description
    OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
    Author
    OpenAI
    URL
    https://github.com/hijohnnylin/automated-interpretability
    Settings
    Default prompts from the main branch, strategy TokenActivationPair.
    Recent Explanations
    the word "pow" or opening parentheses following mathematical function names.
    claude-4-5-sonnet
     Java such as Math.pow(x, y);
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119852
    technical terms and identifiers related to system capabilities, configuration, and information (like "capability", "capabilities", "cpuid", "info", "CONFIG", "version", "architecture", and "proc/cpuinfo").
    claude-4-5-sonnet
    ↵package capability↵↵type Capabilities interface {↵ //
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119848
    the word "TEST" in source code (variable names, function names, constants, and comments).
    claude-4-5-sonnet
    using namespace std;↵↵TEST(WBAES,
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119844
    the lambda arrow operator (=>) in programming code.
    claude-4-5-sonnet
    ↵$↵x\mapsto \mu(B_
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119839
    technical programming terms and framework names, especially related to data science and web development libraries.
    claude-4-5-sonnet
    Extremely slow model load with keras↵↵I have a set
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119838
    hyphens and dashes, particularly in technical identifiers, URLs, and formatted codes.
    claude-4-5-sonnet
    3-OTTERBOX-OBIPHONE4↵
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119837
    the `export` keyword in code, particularly at the start of declarations.
    claude-4-5-sonnet
    // models/group↵export default DS.Model.
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119832
    numeric character codes or identifiers in technical/markup contexts, particularly "1252" and similar encoding specifications.
    claude-4-5-sonnet
    lic, for instance T2A. Then, as
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119829
    loop iterator variable declarations in for loops across different programming languages.
    claude-4-5-sonnet
    ;↵            for(int k=0; k
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119828
    the arrow operator (`->`) used for accessing members of pointers in C/C++ code.
    claude-4-5-sonnet
        else if(node->key < value)↵
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119821
    proper nouns or branded terms, particularly abbreviations and names in formal or technical documents.
    claude-4-5-sonnet
    K/A DEVON KELLIE,                                                      
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 11981
    the word "block" in programming contexts, particularly in try-catch error handling code.
    claude-4-5-sonnet
     there be a single catch block?↵↵I have read
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119808
    the "#" symbol in URLs or file paths, particularly in HTML anchor links and documentation references.
    claude-4-5-sonnet
    permissions_input.html#a1a93
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119806
    the word "turn" or "Turn" (especially at the beginning of a phrase or title).
    claude-4-5-sonnet
     of measurable signal generation: turn on or turn off fluorescence
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 1198
    PHP code and technical programming content, particularly PHP version numbers, file paths, and function names.
    claude-4-5-sonnet
     server:↵  php_network_getaddresses
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119794
    the dot (period) accessor operator in programming code, particularly when accessing object properties or methods.
    claude-4-5-sonnet
     ↵    wooError.delay(400
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119793
    the dot/period character used to access object properties or methods in programming code.
    claude-4-5-sonnet
    ↵      attributes = device.attributes↵      if device
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119791
    HTML comments in code documentation and web development files.
    claude-4-5-sonnet
    <!-- HTML header for doxygen 
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 11979
    string literals or text values in code, particularly in configuration or parameter settings.
    claude-4-5-sonnet
     3), padding='same')(inputs)↵bn
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119785
    programming language or library names, particularly Lua and Python-related identifiers in source code.
    claude-4-5-sonnet
    LIB↵↵#include "lua.h"↵#
    Neuronpedia logo
    GEMMA-2-27B
    10-GEMMASCOPE-RES-131K
    INDEX 119780