© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    1. Home
    5. Gemma-3-1B
    8. Attention Heads - HeadVis
    11. Layer 5
    13. Head 2
    Head Metrics
    Induction Score0.483
    Prev Token Score0.004
    Attention Entropy1.562
    Self Attention0.018
    Q-K Distance—
    Q-K Distance Variance—
    Max Attention Distribution

    No attention distribution available for this head.

    Q-K Distance Distribution

    No Q-K distance distribution available for this head.

    Top Query Tokens

    Top Key Tokens

    Top Sequences by Max Attention. Hover for Keys and Queries.
    Max Attention

    No sequences for this head.