© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    1. Home
    2. Google DeepMind · Exploring Gemma 2 with Gemma Scope
    3. Gemma-2-9B-IT
    4. Residual Stream - 131k
    5. 31-GEMMASCOPE-RES-131K
    6. 23549
    Prev
    Next
    INDEX
    Explanations

    references to creative professions and the act of creation

    oai_token-act-pair · gpt-4o-miniTriggered by @bot

    user<MAX_ACTIVATING_TOKENS>butandtoorathemorelessbyto</MAX_ACTIVATING_TOKENS><TOKENS_AFTER_MAX_ACTIVATING_TOKEN>theyisoftothantheofonisby</TOKENS_AFTER_MAX_ACTIVATING_TOKEN><TOP_POSITIVE_LOGITS>.andormorelessbutIfthanwithbut</TOP_POSITIVE_LOGITS><TOP_ACTIVATING_TEXTS>and they are saying that the actual result of the search would be that it would be even more difficult for them to prove that they will not be able to have this type of car the next time when the car will be more expensive than it isyour search results and the value given to the child node, the system creates the child node and links it to the parent node. The parent node is then updated and has a more extensive set of child nodesThe other half of the time, it was less common and did not seem to be related to the given conditionAnd it is important that the actual value is actually derived from the same calculation, or you should compare the twoSo the whole family will get together and they will eat for the whole morningand they will sing and they will danceThe main difference I found is that every time that the user mentioned the restaurant he was more specific and he was talking about certain restaurant , or maybe he would say “that restaurant” or “ a restaurant I have been to before”The thing is that it is more likely that the current number of sales for a particular company to be closer to the previous number of salesAnd if the condition is not met, it is less likely to occurso much better to have your own systems and not to rely on the cloudmore or less than what weThe whole system aims to make the experience for the user more meaningful and impactful</TOP_ACTIVATING_TEXTS>Explain the neuron above with a word or phrase, not a complete sentence

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Comparing With GEMMA-2-9B-IT @ 31-gemmascope-res-131k
    Configuration
    google/gemma-scope-9b-it-res/layer_31/width_131k/average_l0_109
    Prompts (Dashboard)
    24,576 prompts, 128 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    Features
    131,072
    Data Type
    float32
    Hook Name
    blocks.31.hook_resid_post
    Hook Layer
    31
    Architecture
    jumprelu
    Context Size
    1,024
    Dataset
    monology/pile-uncopyrighted
    Activation Function
    relu
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    IntoConstraints
    -0.64
    MigrationBuilder
    -0.57
    AnimationsModule
    -0.57
     MainAxisSize
    -0.56
    addCriterion
    -0.54
    QMetaType
    -0.54
     disambiguazione
    -0.51
    InputBorder
    -0.49
    AddHtmlAttribute
    -0.48
    homonymie
    -0.48
    POSITIVE LOGITS
     ModelExpression
    0.65
     hacerlo
    0.43
     eastern
    0.36
    ](#
    0.35
     Mus
    0.33
    )>>
    0.33
    ก็
    0.32
    RTGC
    0.32
     từng
    0.32
     did
    0.32
    Activations Density 0.425%

    No Known Activations