© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsinterp-engineNEWAPI Community BlogPrivacy & TermsContact
    1. Home
    2. Gemma-3-27B
    3. 31-GEMMASCOPE-2-RES-262K
    4. 179814
    Prev
    Next
    INDEX
    Explanations

    dates and descriptive terms

    np_acts-logits-general · gemini-2.5-flash-lite

    why someone* **why** is frequently activated, often followed by `someone` (from TOKENS_AFTER_MAX_ACTIVATING_TOKEN).* `create` and `Creates` are also activated, often preceding words like `economic` or `a`.* `parents` appears as a max activating token.* The TOP_POSITIVE_LOGITS contain verbs like `may`, `live`, `enjoys`, `requires`, `comes`, `is`, `provides`, which fit the context of actions, states, or reasons.* The TOP_ACTIVATING_TEXTS contain phrases like "why this mitigation is effective", "why someone might try", "create economic opportunities", "create economic opportunities", "create things", "create_cube", "parents will get".The strongest connection seems to be around the question "why" and the actions/outcomes related to it, or creation.Given `why` is the most frequent in MAX_ACTIVATING_TOKENS, and followed by `someone` in TOKENS_AFTER_MAX_ACTIVATING_TOKEN, and considering the context of explanation and reasons in the texts, "why someone" seems like a good candidate.Another strong pattern is around "create" followed by "economic" or "a".Let's re-evaluate the prompt: "concise explanation (3 to 20 words) that captures what the neuron detects or predicts by finding patterns in lists."The prompt also says: "The explanation could be about tokens following or preceding certain tokens."Considering the repetition of "why" and the very common "why someone" in the subsequent tokens, this seems like a strong pattern."create economic" is also a strong pattern."parents will" is also seen.The lists provided are:MAX_ACTIVATING_TOKENS: why, why, es, create, Creates, **, *, Why, parentsTOKENS_AFTER_MAX_ACTIVATING_TOKEN: *, someone, a, economic, **, a, Similar, many, use, willIf we focus on MAX_ACTIVATING_TOKENS first, "why" is dominant. What follows "why"? "someone" is a strong candidate from TOKENS_AFTER_MAX_ACTIVATING_TOKEN.If we focus on "create", what follows? "economic", "a".The TOP_POSITIVE_LOGITS are more general verbs.TOP_ACTIVATING_TEXTS give context for these tokens.The phrase "why someone" is 2 words. The requirement is 3 to 20 words.However, "explain the neuron above with a word or phrase, not a complete sentence." A 2-word phrase is acceptable if it captures the pattern.Let's check other combinations:"create economic opportunities" - from texts, but not directly deducible from tokens alone without much inference."parents will get" - from texts, but "get" is not in logits or tokens.The most direct and repeated pattern from MAX_ACTIVATING_TOKENS and TOKENS_AFTER_MAX_ACTIVATING_TOKEN is the presence of "why" and what follows it."why someone" is a strong pair.If we take "why" and add what it is seeking or relating to, "why someone" fits well.The explanation asks for a pattern *finding*.Let's consider the combined evidence:- `why` (MAX) -> `someone` (POST): Explicit- `create` (MAX) -> `economic` (POST): Explicit- `parents` (MAX) -> `will` (POST): ExplicitThe neuron might be focused on:1. Reasons/questions (`why`) and who they relate to (`someone`).2. Creation (`create`) and its purpose/outcome (`economic`).3. Specific entities (`parents`) and future actions (`will`).The prompt states "a majority should" match the pattern.'why' appears 3 times in MAX_ACTIVATING_TOKENS.'create'/'Creates' appear 2 times.'parents' appears 1 time.The pattern 'why someone' is very strong.Let's see if we can extend it to 3 words."why someone might" could be inferred if 'might' was present, but it's not.The prompt allows single words or phrases.Consider the most frequent token in MAX_ACTIVATING_TOKENS: 'why'.What follows 'why'?- '*'- 'someone'- 'a'- 'economic'- '**'- 'a'- 'Similar'- 'many'- 'use'- 'will''someone' is the first non-punctuation token after 'why'.'why someone' is a very strong pattern.Let's look at the TOP_POSITIVE_LOGITS: `may`, `live`, `ver`, `enjoys`, `requires`, `was`, `comes`, `is`, `provides`.These suggest a state or a question about a state. "why someone" fits.Could it be "questions about why"? No, too long and not specific enough.Could it be about "causes and effects"? Maybe, but not directly from tokens.The rule is: "Just say the pattern itself"."why someone" is directly observable.The prompt says "3 to 20 words". Is a 2 word phrase acceptable? Rule: "The explanation could be a single word, or phrase, or pattern." "Why someone" is a phrase. It adheres to length if a 2-word phrase is okay.Let's look for a 3-word pattern that is strong.Maybe focusing on 'create':'create economic' is a strong pair. From MAX and POST.'create

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    google/gemma-scope-2-27b-pt/resid_post/layer_31_width_262k_l0_medium
    Prompts (Dashboard)
    392,802 prompts, 256 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    ل
    0.53
    იკ
    0.52
    स
    0.52
    ლა
    0.47
    رش
    0.47
    م
    0.47
    ры
    0.46
    𝘴
    0.46
    લ
    0.46
    芎
    0.46
    POSITIVE LOGITS
     may
    0.58
     enjoys
    0.54
     comes
    0.52
     기본
    0.51
     ver
    0.50
     live
    0.50
     was
    0.50
     would
    0.49
     axis
    0.49
     provides
    0.49
    Activations Density 0.001%

    No Known Activations