© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    1. Home
    2. Gemma-2-27B
    3. 10-GEMMASCOPE-RES-131K
    4. 127407
    Prev
    Next
    INDEX
    Explanations

    learning rate, recall, batch size

    np_acts-logits-general · gemini-2.5-flash-lite

    The neuron strongly activates on technical optimization and training terms—like “momentum,” “line search,” “schedule,” “recall,” “learning,” and “batch”—i.e. references to optimization methods or hyperparameter settings.

    oai_token-act-pair · o4-miniTriggered by @jyhe0408
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    google/gemma-scope-27b-pt-res/layer_10/width_131k
    Prompts (Dashboard)
    24,576 prompts, 128 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    and
    -1.96
    v
    -1.80
    es
    -1.78
    d
    -1.73
    but
    -1.64
    al
    -1.63
    om
    -1.62
    l
    -1.59
    E
    -1.56
    m
    -1.55
    POSITIVE LOGITS
    威力
    1.53
    賂
    1.51
     ใหม่
    1.45
    Bunch
    1.42
    王妃
    1.40
    用の
    1.39
     nim
    1.38
     veremos
    1.38
     nghiệ
    1.38
     использу
    1.36
    Activations Density 0.001%

    No Known Activations