Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    INDEX
    Explanations

    attention getter or "Attention Is All You Need"

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Negative Logits
    ások
    0.43
    jur
    0.40
    ပင်
    0.40
    aino
    0.40
    akk
    0.39
    urate
    0.39
    នៃការ
    0.37
    対応
    0.36
    cev
    0.36
    aci
    0.36
    POSITIVE LOGITS
     span
    0.51
     riv
    0.43
     Span
    0.43
    Nut
    0.42
     ruins
    0.42
     spans
    0.42
    ition
    0.40
     monoc
    0.40
    ሟ
    0.40
     nut
    0.39
    Act Density 0.013%

    No Known Activations