© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it
    Neuronpedia
    Jacobian LensNEW
    Natural Language
    Autoencoders
    MAY 26
    Assistant AxisJAN 26Circuit TracerAPR 26SteerSAE EvalsExportsinterp-engineNEW Community BlogPrivacy & TermsContact
    1. Home
    2. Gemma-3-27B
    3. 31-GEMMASCOPE-2-RES-262K
    4. 132141
    Prev
    Next
    INDEX
    Explanations

    alone or drug and*Self-correction:* The prompt asks for 3 to 20 words. "alone or drug and" is 4 words.The provided MAX_ACTIVATING_TOKENS are: you, alone, partner, supporting, for, and, because.The TOKENS_AFTER_MAX_ACTIVATING_TOKEN are: ’, or, and, ., the, the, then, you, pillows.Let's examine some pairs from MAX_ACTIVATING_TOKENS and TOKENS_AFTER_MAX_ACTIVATING_TOKEN:- `alone` -> `or`- `partner` -> `and`- `for` -> `the`- `and` -> `the`- `because` -> `you`The `TOP_POSITIVE_LOGITS` are words like `annual`, `initial`, `villas`, `flock`, `altitude`, `planting`, `clump`. These seem to relate to discrete items, groups, or natural phenomena.Looking at `TOP_ACTIVATING_TEXTS`, we see phrases like:- "used alone or with other medications" (matches `alone` -> `or`)- "act as a project partner." (matches `partner` -> .) - This is a bit off. Let's recheck. - `partner`: The token after is `.` in the text: "project partner." - `supporting`: The token after is `.` in the text: "hours supporting the volunteers." - `for`: The token after is `the` in the text: "supporting the volunteers" - `and`: The token after is `quick` in the text: "adapter/cable (6 ft.), and quick start guide" - This is not `the`. - `because`: The token after is `I` in the text: "because I liked" - This is not `you`.The initial assumption about the specific tokens following the MAX_ACTIVATING_TOKENS might be too strict, or the lists are slightly inconsistent due to tokenization or the nature of the activations.Let's reconsider the `TOP_POSITIVE_LOGITS` and `TOP_ACTIVATING_TEXTS` for potential themes.`annual`, `flock`, `altitude`, `planting`, `clump` suggest natural groups, cycles, or discrete entities.`villas` suggests places.Let's look at the structure of phrases the neuron activates on.- "used alone or with"- "act as a project partner"- "odd hours supporting the volunteers"- "entrusted us to handle"- "turn the faucet on"- "ready to watch TV"Phrases often contain:- A subject/actor (`you`, `Metformin`, `Gazprom`, `volunteers`, `clients`, `us`)- A state, action, or role (`used alone`, `project partner`, `supporting`, `handle`, `turn on`, `ready`)- Prepositions or conjunctions (`or`, `with`, `as a`, `the`, `to`, `and`)Let's revisit the MAX_ACTIVATING_TOKENS and TOKENS_AFTER_MAX_ACTIVATING_TOKEN.`alone` -> `or``partner` -> `and` (from `partner.` and then `and`)`for` -> `the``and` -> `the` (from `and then`)`because` -> `you` (from `you`, `you` after `because`)The pattern `X or Y`, `X and Y` is common.`alone or with``partner and ...``supporting and ...``for the ...``and the ...``because you ...`If we focus on `alone or` and `partner and`, this points to conjunctions and comparisons related to roles or states.The `TOP_POSITIVE_LOGITS` like `annual`, `flock`, `clump` suggest some kind of aggregation or discrete quantity.Consider the phrases again:- "used alone or with"- "act as a project partner"- "odd hours supporting the volunteers"- "amoxicillin) is used for the treatment"- "companies and 120 financial investors"- "faucest on in spring and water leaks"- "pillows and you’re ready to watch TV"It seems to be about items/entities involved in an action or relationship, often connected by conjunctions or prepositions.The presence of `alone or` and `partner and` suggests linking entities or states.Let's consider the `TOP_POSITIVE_LOGITS`: `annual`, `flock`, `clump`. These are singular/collective nouns.The MAX_ACTIVATING_TOKENS like `you`, `partner`, `supporting`, `for`, `and`, `because` are often related to subjects, agents, or relationships.The pattern might be about entities and their association or separation."alone or" -> separation/option"partner and" -> associationThe `TOP_POSITIVE_LOGITS` can be seen as specific instances of entities that might be counted or grouped.`flock` -> group of birds`clump` -> group of trees/plants`annual` -> yearly cycle, eventPerhaps it's about counting or relating discrete entities or events.Let's look at the most frequent patterns in MAX_ACTIVATING_TOKENS and TOKENS_AFTER_MAX_ACTIVATING_TOKEN:`alone` -> `or``partner` -> `and` (or `.`)`for` -> `the``and` -> `the` (or `then`)`you` -> `’` (or `you`)`because` -> `you`The combinations `alone or`, `partner and`, `for the`, `and the` suggest relationships or roles, often with a following noun phrase.The `TOP_POSITIVE_LOGITS` (`flock`, `clump`, `villas`) are nouns.Consider the phrase: "entities associated or separate"This is

    np_acts-logits-general · gemini-2.5-flash-lite

    commerce, product, embrittlement, tail, soil, card, arms

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    google/gemma-scope-2-27b-pt/resid_post/layer_31_width_262k_l0_medium
    Prompts (Dashboard)
    392,802 prompts, 256 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    ihal
    0.48
    isTrack
    0.45
    ickers
    0.45
     ലേഖ
    0.45
    ają
    0.44
     artículo
    0.44
    铣
    0.44
    篡
    0.44
     théorème
    0.43
    軛
    0.43
    POSITIVE LOGITS
     annual
    0.50
     initial
    0.49
     villas
    0.49
     flock
    0.48
     flocks
    0.47
     altitude
    0.47
     planting
    0.47
     clump
    0.46
     phenotypic
    0.46
     veggie
    0.46
    Activations Density 0.000%

    No Known Activations