© Neuronpedia 2026
    Privacy & TermsBlogGitHubSlackTwitterContact
    Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    Jacobian LensNEW
    Natural Language
    Autoencoders
    NEW
    Assistant AxisNEWCircuit TracerUPDATESteerSAE EvalsExportsAPI Community BlogPrivacy & TermsContact
    1. Home
    2. Olmo-3-1025-7B
    3. 16-RES-MATRYOSHKA-65K
    4. 56344
    Prev
    Next
    INDEX
    Explanations

    - "Fearless and **irreverent**, she takes on adventures"- "Engaging, witty, intelligent and **fresh**.- "kind hearted, **helpful** soul."- "responsible, **analytical** mind."- "mystical and **incredibly** diverse"- "Stimulating, provocative, **often** infuriating"The pattern seems to be identifying descriptive words or adjectives, especially when they appear in a sequence, often separated by commas or "and". The key is that the neuron is likely looking for *adjectival descriptions* or *qualities* within a list.Let's try to find a concise phrase from this:- descriptive words in lists- sequence of adjectives- listing qualities- identifying descriptive terms- adjectival phrases"listing descriptive qualities" seems fitting and is 3 words."sequences of descriptive words" is also good, 4 words."adjectival descriptions in context" is 4 words.Given the dominant tokens are "and" and ",", and the following tokens are often adjectives describing a person or thing, the neuron is likely triggered by these lists of qualities.Let's check the rules:- Concise (3-20 words): Yes.- Single word, phrase, or pattern: Yes, a phrase.- About tokens following or preceding certain tokens: Yes, tokens following 'and' or ','.- About words starting with a sequence: Not directly, but about words *in* a sequence.- Avoid listing: Yes.- Just say the pattern itself: Yes.- No "words related to", "concepts related to": Yes.- No "This neuron detects/predicts": Yes.- No "tokens" or "patterns": Yes.- No capitalization unless proper noun: Yes.- Specific: Yes, "descriptive qualities" is specific.- Majority match: The majority of examples point to this.- If cannot guess, return first in MAX_ACTIVATING_TOKENS: Not needed, a pattern is clear.The phrase "listing descriptive qualities" seems to capture the essence well. Another option could be "adjectival lists". Let's go with something that emphasizes the descriptive nature."cataloging descriptive attributes" - 3 words."enumerating descriptive traits" - 3 words."listing descriptive qualities" is probably the most straightforward and accurate.Let's re-evaluate the TOP_POSITIVE_LOGITS:ðŁ, tact, PIX, enter, -Le, gastro, congratulations, regex, Greg.These don't scream "descriptive qualities" specifically, except maybe "tact". This list might be less informative or related to a different aspect. The prompt says "Not ALL top activating texts/tokens have to match the exact same pattern, but a majority should."The majority of evidence from TOKENS_AFTER_MAX_ACTIVATING_TOKEN and TOP_ACTIVATING_TEXTS strongly suggests identifying lists of descriptive words.Let's consider:- "Lists of adjectives" (3 words) - too simple?- "Describing lists" (2 words) - too short.- "Identifying lists of descriptors" (3 words)- "Sequences of descriptive words" (4 words)"Sequences of descriptive words" is a strong candidate."listing descriptive qualities" also works well.Let's test against some examples again:- "He was quite kind, gentle and loving..." -> sequences of descriptive words (kind, gentle, loving)- "Entertaining, canny, and moving..." -> sequences of descriptive words (entertaining, canny, moving)- "Fearless and irreverent..." -> sequences of descriptive words (fearless, irreverent)- "Engaging, witty, intelligent and fresh." -> sequences of descriptive words (engaging, witty, intelligent, fresh)- "kind hearted, helpful soul." -> sequences of descriptive words (kind-hearted, helpful)- "responsible, analytical mind." -> sequences of descriptive words (responsible, analytical)- "mystical and incredibly diverse" -> sequences of descriptive words (mystical, incredibly diverse)- "Stimulating, provocative, often infuriating" -> sequences of descriptive words (stimulating, provocative, infuriating)This seems to be the most consistent pattern.How about just "descriptive sequences"? (2 words - too short) or "adjective sequences"? (2 words - too short).The prompt says 3 to 20 words.Let's make it slightly more active, suggesting what the neuron *does*."identifying lists of descriptors""finding sequences of adjectives""cataloging descriptive attributes""enumerating descriptive traits"I'll go with "listing descriptive qualities" as it is clear, covers the examples well, and is 3 words.Checking again:- TOP_POSITIVE_LOGITS: Perhaps the neuron's *purpose* is to identify descriptions so that other parts of the network can use these descriptors for tasks like sentiment analysis or categorization. e.g., "tact" could be a descriptor. "congratulations" could be an outcome description. The list itself is strange but the other lists are clearer.Let's refine based on the core observation: MAX_ACTIVATING_TOKENS are conjunctions/separators, TOKENS_AFTER_MAX_ACTIVATING_TOKEN are adjectives. So, it's detecting the *structure* of lists of adjectives."recognizing lists of adjectives" - 4 words. This is very direct."adjective list detection" - 3 words."adjective listing" - 2 words (too short)."recognizing lists of adjectives" is good."identifying descriptive adjectives" - 3 words."detecting descriptive lists" - 3 words.Considering the prompt's examples of explanations like "unique words". My proposed explanation needs to be a "pattern itself"."adjectives in lists" - 3 words."lists of descriptive words" - 4 words.I think "adjectives in lists" is concise, specific, and directly describes the pattern.Let's reconsider the TOP_POSITIVE_LOGITS:ðŁ, tact, PIX, enter, -Le, gastro, congratulations, regex, Greg.If the neuron is about "adjectives in lists", maybe it's looking for context where this structure appears.- "tact" can be an adjective.- "congratulations" is a noun, but can be associated with positive descriptions.- "Greg" is a name, potentially part of a list of people or characteristics.- "regex" could be very specific, maybe looking for pattern descriptions.- "enter" is a verb, less likely.The pattern of 'and' / ',' followed by adjectives is very strong. "adjectives in lists" captures this.Final choice: "adjectives in lists" (3 words).Alternatively: "listing descriptive terms".The term 'qualities' is good. "listing descriptive qualities".Let's re-read the example provided in the prompt: "unique words". This is a very general pattern.My pattern is more specific: adjectives, within lists.The prompt says "explaining the behavior of a neuron".What *behavior* does it exhibit? It fires when it sees adjectives in sequences."finding sequences of adjectives" - 4 words."adjective sequence detection

    np_acts-logits-general · gemini-2.5-flash-lite
    New Auto-Interp
    Top Features by Cosine Similarity
    Configuration
    decoderesearch/olmo-3-saes/olmo-3-1025-7b
    Prompts (Dashboard)
    24,576 prompts, 128 tokens each
    Dataset (Dashboard)
    monology/pile-uncopyrighted
    No Configuration Found
    Embeds
    IFrame
    Link
    Not in Any Lists

    No Comments

    Negative Logits
    achu
    -0.10
     rekl
    -0.10
    anke
    -0.10
    zhou
    -0.09
    ffee
    -0.09
    esz
    -0.09
     Merrill
    -0.09
    aza
    -0.09
    ora
    -0.09
    ftware
    -0.09
    POSITIVE LOGITS
    ðŁ
    0.09
     tact
    0.09
    PIX
    0.08
    enter
    0.08
    -Le
    0.07
     gastro
    0.07
     congratulations
    0.07
     regex
    0.07
       
    0.07
     Greg
    0.07
    Activations Density 0.047%

    No Known Activations