© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    1. Home
    5. Qwen3.5-0.8B
    8. Attention Heads - HeadVis
    11. Layer 4
    13. Head 5
    Find Head By Metric
    Metric & Number of Heads
    Top 8
    Click head to select
    Layer 11
    Layer 15
    Layer 19
    Layer 23
    Select Head Manually
    Layer
    Head Index

    Activation Distribution & Metrics

    Q-K Distance Distribution

    Top Query Tokens

    Top Key Tokens

    Top Sequences by Max Attention. Hover for Keys and Queries.
    Max Attention

    No sequences for this head.