© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it
    Neuronpedia
    Jacobian LensNEW
    Natural Language
    Autoencoders
    MAY 26
    Assistant AxisJAN 26Circuit TracerAPR 26SteerSAE EvalsExportsinterp-engineNEW Community BlogPrivacy & TermsContact
    1. Home
    2. Gemma-3-12B-IT
    3. 12-GEMMASCOPE-2-RES-262K
    4. 11935
    Prev
    Next
    INDEX
    Explanations

    This neuron seems to be activated by sequences that often precede Slavic surnames or names, particularly when discussing individuals. The 'MAX_ACTIVATING_TOKENS' are often parts of these names or prefixes. The 'TOKENS_AFTER_MAX_ACTIVATING_TOKEN' provide strong evidence of names like Dabkowski, Savitsky, Girkin, Busch, and Kowalczyk. The 'TOP_POSITIVE_LOGITS' list is less directly useful here for the *specific* pattern, but the overall context from the other lists points to specific entities.Considering the pattern: fragments of names or name-like sounds, followed by actual surnames, often of Slavic origin.Let's re-evaluate carefully.MAX_ACTIVATING_TOKENS: r, otr, ей, ром, gor, os, ey, i, usz, kTOKENS_AFTER_MAX_ACTIVATING_TOKEN: Dab, Sav, Б, Ле, Gir, Busch, ", ", , KowExamples from texts:Piotr DabkowskiPyotr SavitskyВладимир ЛенинIgor GirkinNikolaos BuschAlexey "Karabas" KharitonovSergei "The Shadow" PetrovHenryk KowalczykThe MAX_ACTIVATING_TOKENS are often the *initial* parts of names or surnames, or sometimes full first names (like 'i' for Antoni, or 'r' could be for 'Russian' or part of a name).'Dab' comes after 'r' (implied, not in MAX list). 'Sav' comes after 'otr'. 'Ле' comes after 'ei'. 'Gir' comes after 'rom'. 'Busch' comes after 'gor'. 'Kow' comes after 'k'.The pattern is clearly about identifying *names*. More specifically, given the Slavic context in the texts and tokens, it's likely identifying Slavic names or names in a Slavic context.Let's look at TOP_POSITIVE_LOGITS again:hers, ports, ERS, hare, ARDS, scapes, hind, alf, dues, beThese don't directly scream "Slavic names". However, "hare", "scapes" could be related to places or descriptions where names appear. "hers" and "be" are common words. "ports", "ARDS", "hind", "alf", "dues" are plural or suffixes. This list might be too general or might be related to general entity recognition rather than *just* Slavic names.However, the MAX_ACTIVATING_TOKENS and TOKENS_AFTER_MAX_ACTIVATING_TOKEN are very strong indicators.The MAX_ACTIVATING_TOKENS are often the *start* of a name or a very short name fragment from which a full name is inferred.Slavic names or name fragments

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    google/gemma-scope-2-12b-it/resid_post/layer_12_width_262k_l0_medium
    Prompts (Dashboard)
    238,145 prompts, 512 tokens each
    Dataset (Dashboard)
    lmsys + oasst1
    No Configuration Found
    Embeds
    IFrame
    Link
    Negative Logits
    o
    1.38
    en
    1.34
    ו
    1.30
    é
    1.20
    ר
    1.19
    ن
    1.17
    н
    1.14
    ע
    1.14
    oš
    1.12
    המ
    1.10
    POSITIVE LOGITS
    hers
    1.22
    ports
    1.05
    ERS
    1.05
    hare
    1.05
    ARDS
    1.02
    scapes
    0.98
    hind
    0.98
     alf
    0.97
     dues
    0.97
    be
    0.97
    Activations Density 0.001%

    No Known Activations