Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    APICircuit TracerNEWSteerSAE EvalsBlogSlackPrivacy & TermsContact
    © Neuronpedia 2025
    Privacy & TermsBlogGitHubSlackTwitterContact
    1. Home
    2. OpenMOSS · Llama Scope: SAEs for Llama-3.1-8B
    3. Llama3.1-8B
    4. Residual Stream
    5. 21-LLAMASCOPE-RES-32K
    6. 17571
    Prev
    Next
    INDEX
    Explanations

    concepts related to the mind-body relationship and philosophical discussions about perception and reality

    oai_token-act-pair · gpt-4o-miniTriggered by @bot

    philosophical and scientific discussions about consciousness, mind, and perception.

    oai_token-act-pair · claude-3-5-haiku-20241022Triggered by @mattgrace134

    words and phrases related to the mind, consciousness, and the nature of reality, often in a philosophical or scientific context.

    oai_token-act-pair · gemini-1.5-flashTriggered by @mattgrace134

    concepts related to the mind, consciousness, and thought.

    oai_token-act-pair · gemini-1.5-proTriggered by @mattgrace134

    mentions of concepts related to consciousness, perception, and mind-body relation.

    oai_token-act-pair · gemini-2.0-flashTriggered by @mattgrace134

    Frequent occurrences of technical and philosophical discourse around consciousness, perception, mind, and environmental influences, often with detailed linguistic analysis of these abstract concepts.

    eleuther_acts_top20 · claude-3-5-haiku-20241022Triggered by @mattgrace134

    consciousness

    np_max-act-logits · claude-3-5-haiku-20241022Triggered by @mattgrace134

    Technical discourse about consciousness, mind, perception, and cognitive processes, often in philosophical or scientific contexts.

    eleuther_acts_top20 · claude-3-7-sonnet-20250219Triggered by @mattgrace134

    Discussions related to consciousness, perception, and the mind from scientific and philosophical perspectives, often discussing the influence of the environment and biological factors. The examples come from technical discussions.

    eleuther_acts_top20 · gemini-2.0-flashTriggered by @mattgrace134

    consciousness

    np_max-act-logits · gemini-2.0-flashTriggered by @mattgrace134

    This neuron detects core “mind and consciousness” jargon—terms like mind, conscious/consciousness, “black box,” “hard problem,” etc., that flag philosophical discussion of the mind–body problem.

    oai_token-act-pair · o4-miniTriggered by @mattgrace134
    New Auto-Interp
    Top Features by Cosine Similarity
    Comparing With LLAMA3.1-8B @ 21-llamascope-res-32k
    Configuration
    fnlp/Llama3_1-8B-Base-LXR-8x/Llama3_1-8B-Base-L21R-8x
    Prompts (Dashboard)
    24,576 prompts, 128 tokens each
    Dataset (Dashboard)
    cerebras/SlimPajama-627B
    Features
    32,768
    Data Type
    bfloat16
    Hook Name
    blocks.21.hook_resid_post
    Hook Layer
    21
    Architecture
    jumprelu
    Context Size
    1,024
    Dataset
    cerebras/SlimPajama-627B
    Activation Function
    relu
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    ocide
    -0.14
    igure
    -0.14
     vul
    -0.14
    essa
    -0.14
    068
    -0.14
     est
    -0.14
     sera
    -0.13
    636
    -0.13
     intuitive
    -0.13
     relax
    -0.13
    POSITIVE LOGITS
     Conscious
    0.28
     consciousness
    0.28
    -conscious
    0.24
    conscious
    0.24
     awareness
    0.23
     conscious
    0.22
    aware
    0.21
     Awareness
    0.21
     Brain
    0.20
    scious
    0.20
    Activations Density 0.092%

    No Known Activations