© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    1. Home
    5. GPT2-Small
    gpt2-small
    OpenAI
    Jump to Source/SAE
    Jump to Feature
    INDEX

    Releases

    Feature Splitting for GPT2-Small
    July 2024
    Joseph Bloom
    gpt2sm-rfs-jb
    Sparse Autoencoder for GPT2-Small - v5
    June 2024
    OpenAI
    gpt2sm-oai-2024
    Identifying Functionally Important Features with End-to-End Sparse Dictionary Learning
    May 2024
    Apollo Research · Taylor
    gpt2sm-apollojt
    Attention SAE Research Paper
    March 2024
    Under Peer Review
    gpt2sm-kk
    Open Source Sparse Autoencoders for all Residual Stream Layers of GPT2-Small
    February 2024
    Joseph Bloom
    gpt2sm-res-jb
    Sparse Autoencoder for GPT2-Small - Dec 2023
    December 2023
    OpenAI
    gpt2sm-oai-2023

    Attention Visualizer

    HeadVis (Luger, Kamath et al.)
    Find Head By Metric
    Metric & Number of Heads
    Top 8
    Click head to select
    Layer 5
    Layer 6
    Layer 7
    Layer 8
    Select Head Manually
    Layer
    Head Index

    Search Explanations

    Search via Inference

    Run Example Search

    Browse

    Features in GPT2-SMALL@0-att_128k-oai
    1. Hover over a feature on the left to preview its details.
    2. Click a feature to lock it and interact with it.