© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it
    Neuronpedia
    Jacobian LensNEW
    Natural Language
    Autoencoders
    MAY 26
    Assistant AxisJAN 26Circuit TracerAPR 26SteerSAE EvalsExportsinterp-engineNEW Community BlogPrivacy & TermsContact
    1. Home
    2. Qwen3.5-4B
    3. 15-RES-MATRYOSHKA-65K
    4. 16808
    Prev
    Next
    INDEX
    Explanations

    This neuron seems to detect phrases that often follow common verbs or pronouns, like "have it," "go," "is," "that's," or "a". Many of these conjunctions or auxiliary verbs are followed by specific types of words or punctuation (like "it," a comma, or "exactly"), indicating a role in sentence structure or flow. The `TOP_POSITIVE_LOGITS` also contain unusual character sequences, which might hint at a linguistic function related to tokenization or character-level processing rather than pure semantic meaning. However, the specific tokens and their followers point towards grammatical structures.Given the constraints:- MAX_ACTIVATING_TOKENS: `have`, `go`, `is`, `’s`, `that`, `a`, `(`, `is`, `this`, `know`- TOKENS_AFTER_MAX_ACTIVATING_TOKEN: `it`, `,`, `.`, `exactly`, `you`, `huge`, `Building`, `<`, `is`, `what`- TOP_POSITIVE_LOGITS: `ÙĪÙħÙĬ`, `tera`, `æĿĤ`, `bras`, `Ori`, `åĪĴ`, `ä¼ł`, `ç§ĺå¯Ĩ`, `alet`, `asts`- TOP_ACTIVATING_TEXTS: show phrases containing these tokens in contexts like "So there you have it", "you have landed", "please go through", "that you have", "this with your", "is not the first", "is going to be", "This is <".The majority of `MAX_ACTIVATING_TOKENS` are common words frequently appearing as subjects, auxiliary verbs, or determiners. The `TOKENS_AFTER_MAX_ACTIV

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    decoderesearch/qwen-3.5-saes/qwen-3.5-4b
    Prompts (Dashboard)
    16,384 prompts, 128 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    elop
    -0.06
    åłµ
    -0.06
    elters
    -0.06
    ernal
    -0.06
    esty
    -0.06
    æĮī计åĪĴ
    -0.06
    dap
    -0.06
    ellis
    -0.06
     ÙħÙħتاز
    -0.05
    ernational
    -0.05
    POSITIVE LOGITS
    ÙĪÙħÙĬ
    0.05
    tera
    0.05
    æĿĤ
    0.05
    bras
    0.05
     Ori
    0.05
    åĪĴ
    0.05
    ä¼ł
    0.05
    ç§ĺå¯Ĩ
    0.05
    alet
    0.05
    asts
    0.05
    Activations Density 0.002%

    No Known Activations