Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    INDEX
    Explanations

    attends to tokens related to the context or environment from tokens later in the sequence

    oai_attention-head · gpt-4o-miniTriggered by @bot
    New Auto-Interp
    Head Attr Weights
    0:0.11
    1:0.14
    2:0.10
    3:0.04
    4:0.05
    5:0.08
    6:0.06
    7:0.38
    Negative Logits
    ########.
    -0.41
    AndEndTag
    -0.37
    RenderAtEndOf
    -0.36
    awtextra
    -0.33
     '/';
    -0.33
    ابراین
    -0.32
    AsUp
    -0.31
    verifyException
    -0.31
    oa̍t
    -0.30
    )];
    -0.30
    POSITIVE LOGITS
    jupiter
    0.23
     effective
    0.21
    др
    0.21
     Arr
    0.21
     Sess
    0.20
    VersionUID
    0.20
     Arxivat
    0.20
     Celui
    0.20
     Kön
    0.20
     nito
    0.20
    Act Density 0.022%

    No Known Activations