© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsinterp-engineNEWAPI Community BlogPrivacy & TermsContact
    1. Home
    2. Gemma-3-27B-IT
    3. 27-GEMMASCOPE-2-TRANSCODER-262K
    4. 120231
    Prev
    Next
    INDEX
    Explanations

    My brother is 4 times as old as I am. Six years from now, he will be twice as old as I will be.These texts heavily involve mathematical word problems, specifically those dealing with ages, quantities, comparisons (twice, four times, half, older than), and relationships between variables. The verbs "is", "am", "will be" from `MAX_ACTIVATING_TOKENS` and subsequent phrases from `TOKENS_AFTER_MAX_ACTIVATING_TOKEN` like "be", "equal", "half", "two" are components of setting up these relationships and equations.The neuron seems to be activating when the context involves calculations and comparisons, often presented as word problems.Let's try to synthesize this into a concise phrase.- **Age problems**: Too specific.- **Mathematical relationships**: Good, but maybe a bit broad.- **Comparisons and quantities**: Captures the essence well.- **Word problem setup**: Focuses on the linguistic aspect of setting up the math.- **Ratio and age problems**: Combines key elements.Considering `TOP_POSITIVE_LOGITS`:- Pix (seems unrelated)- generally (general indicator, not pattern)- THERE (common word)- 廷, ोले, Heavy, Signific, Hitchcock, 运 (These are mixed language or potentially noisy, but "Signific" hints at "significant", "Heavy" might relate to weight or problems).The core pattern seems to be about establishing numerical relationships, often in the context of word problems. The verbs are fundamental to stating these relationships.Let's look at the combination of `MAX_ACTIVATING_TOKENS` and `TOKENS_AFTER_MAX_ACTIVATING_TOKEN`:- was/is/will/be + be -> Future/passive statements, e.g., "will be twice as old"- is + equal -> "is equal to"- is + half -> "is half of"- is + two -> "is two" (e.g., "is two years older")These are all components of stating conditions or outcomes in these problems.The most striking pattern is the recurring presence of mathematical word problems focusing on:1. **Age comparisons**: "twice as old", "4 times as old", "older than"2. **Quantity comparisons**: "half as many", "twice as old"3.mathematical word problems

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    google/gemma-scope-2-27b-it/transcoder_all/layer_27_width_262k_l0_small_affine
    Prompts (Dashboard)
    238,145 prompts, 512 tokens each
    Dataset (Dashboard)
    lmsys + oasst1
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
     ছাত্র
    0.36
     branchNode
    0.36
     sorella
    0.36
     bör
    0.35
    ፴
    0.35
     nodes
    0.35
     continuity
    0.35
     स्टूडेंट
    0.35
    resión
    0.34
    amata
    0.34
    POSITIVE LOGITS
     Pix
    0.38
     generally
    0.36
    generally
    0.34
     देयर
    0.32
    廷
    0.32
    ोले
    0.32
     Heavy
    0.32
     Signific
    0.32
     Hitchcock
    0.32
    运
    0.32
    Activations Density 0.001%

    No Known Activations