© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it
    Neuronpedia
    Jacobian LensNEW
    Natural Language
    Autoencoders
    MAY 26
    Assistant AxisJAN 26Circuit TracerAPR 26SteerSAE EvalsExportsinterp-engineNEW Community BlogPrivacy & TermsContact
    1. Home
    2. Gemma-3-27B
    3. 31-GEMMASCOPE-2-RES-262K
    4. 250664
    Prev
    Next
    INDEX
    Explanations

    president2. email address3. Monarchy4. goes through grief5. contacting6. Use7. Flag Officer8. Academy9. But10. holiday budgetsLooking at the `MAX_ACTIVATING_TOKENS` and `TOKENS_AFTER_MAX_ACTIVATING_TOKEN`:- `level` -> `of` (level of support)- `email` -> `address` (email address)- `Mon` -> `archy` (Monarchy)- `goes` -> `through` (goes through grief)- `contacting` -> (no clear token, but the text is "contacting a member")- `Use` -> (no clear token, but the text is "Use of all material")- `Flag` -> `Officer` (Flag Officer)- `and` -> (no clear token, but the text is "and while")Also, the `TOP_POSITIVE_LOGITS` include `Holiday`, `Phoenix`, `Verge`, `SBC`, `Savings`, `Coil`, `Phoenix`, `Memphis`, `Boise`, `President`.`President` appears in `TOP_POSITIVE_LOGITS` and `MAX_ACTIVATING_TOKENS`.The text includes "the president."The pattern seems to be triggered by words that are often followed by specific nouns or descriptive phrases, especially in contexts related to official titles, administration, places, or topics.Let's try to combine these."President" is strong."email address" is strong."Monarchy" is strong."Flag Officer" is strong.The pattern seems to be about specific entities or roles, often followed by descriptors."President" is a good start."email address" explains one instance well."Monarchy" explains another."Flag Officer" explains another.Consider "President" and "Flag Officer". These are titles.Consider "email address". This is about specific data.Consider "Monarchy". This is a specific historical/political concept.Consider "Holiday" and "Savings". These relate to commercial/personal finance.Let's look at the `MAX_ACTIVATING_TOKENS` again: `level`, `email`, `Mon`, `goes`, `contacting`, `Use`, `Flag`, `and`.And `TOKENS_AFTER_MAX_ACTIVATING_TOKEN`: `of`, `address`, `archy`, `through`, `a`, `of`, `Officer`, `for`, `But`, `steep`.Combinations:`level of``email address``Mon archy``goes through``contacting a``Use of` (or `Use is` from other texts not shown)`Flag Officer`The `TOP_POSITIVE_LOGITS` like `Holiday`, `Phoenix`, `Memphis`, `Boise` are place names or specific events/concepts. `President` is a title.The neuron seems to be specific. It's not a general "word following" neuron. It's specific combinations."President" is a very strong candidate from `MAX_ACTIVATING_TOKENS` and `TOP_POSITIVE_LOGITS`.The text "The president maintains his level of support..." confirms this.Let's look for a more general theme if possible, but the prompt asks for specificity."president" is directly in the data multiple times."email address" is directly in the data."Monarchy" is directly in the data."Flag Officer" is directly in the data.These are all specific concepts or roles.The neuron seems to activate when it sees these specific terms or related terms.If I have to pick *one* phrase that captures it best by finding a pattern:The neuron seems to be focused on specific entities, roles, or concepts.The strongest, most recurring, and most direct match is `President`.Let's re-evaluate the instructions: "concise explanation (3 to 20 words) that captures what the neuron detects or predicts by finding patterns in lists.""finding patterns in lists""look at the lists and find a pattern""The explanation could be a single word, or phrase, or pattern.""Avoid simply listing all the tokens. Instead, try to find patterns."The pattern is specific phrases or concepts.`President` is a key one.`email address` is another.`Monarchy` is another.`Flag Officer` is another.If I focus on the *type* of thing detected: titles, specific concepts, administrative terms.Let's consider the word "president" itself. It's in `MAX_ACTIVATING_TOKENS` (though not top, but present in analysis of texts) and `TOP_POSITIVE_LOGITS`. The texts heavily feature "president". This is a very strong signal.What about `Mon` + `archy`? The text is "Return to Monarchy". This is a strong signal for "Monarchy".What about `email` + `address`? The text is "your email address". This is a strong signal for "email address".What about `Flag` + `Officer`? The text is "Each Flag Officer". This is a strong signal for "Flag Officer".The prompt asks for *the* pattern, implying a single explanation.Let's look at TOP_POSITIVE_LOGITS: Holiday, phoenix, Verge, SBC, Savings, Coil, Phoenix, Memphis, Boise, President.These are very specific things. Names, places, concepts.The neuron detects specific entities and concepts.How to phrase this concisely?"President" is a good candidate. It appears in both MAX_ACTIVATING_TOKENS (though later) and TOP_POSITIVE_LOGITS (highly).The sentence structure `president. The president’s...` strongly activates it.Could the pattern be "things that are important or official"?President, Flag Officer, Monarchy are official/important.Email

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    google/gemma-scope-2-27b-pt/resid_post/layer_31_width_262k_l0_medium
    Prompts (Dashboard)
    392,802 prompts, 256 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
     പ്ര
    0.54
     جذ
    0.54
     忄
    0.53
     値
    0.52
    どんな
    0.52
    itura
    0.50
    ających
    0.50
    ampil
    0.49
    gunaan
    0.49
    ำ
    0.49
    POSITIVE LOGITS
     Holiday
    0.46
     phoenix
    0.43
     Verge
    0.42
     SBC
    0.42
     Savings
    0.42
     Coil
    0.42
     Phoenix
    0.41
     Memphis
    0.41
     Boise
    0.41
     President
    0.41
    Activations Density 0.000%

    No Known Activations