Neuronpedia logo - a computer chip with a rounded viewfinder border around it

    Neuronpedia

    APICircuit TracerNEWSteerSAE EvalsExportsSlackBlogPrivacy & TermsContact
    © Neuronpedia 2025
    Privacy & TermsBlogGitHubSlackTwitterContact
    EXPLANATION TYPE
    eleuther_acts_top20
    Description
    Eleuther's "Default" Explainer, which shows the auto-interp model a sample from activating texts (with max activations highlighted) and asks the model to think through possible patterns, and then provide the explanation. This is an alternate version that doesn't use quantiles.
    Author
    EleutherAI
    URL
    https://github.com/EleutherAI/sae-auto-interp
    Settings
    Default prompts from the main branch. The model is shown top 20 examples, with a threshold of 60% of the max activation to consider highlighting. Temperature is set to 0.7.
    Recent Explanations
    Narrative text describing characters, their actions, and relationships, particularly focusing on royalty, authority figures, and social interactions in formal settings.
    claude-3-7-sonnet-20250219
    , and handed it to the queen, and then took
    Neuronpedia logo
    GEMMA-2B-IT
    12-RES-JB
    INDEX 1468
    Connecting words and phrases (prepositions, conjunctions, verbs) that establish relationships between concepts, particularly in informational or academic text.
    claude-3-7-sonnet-20250219
    Reiki promises a positive effect on all forms of illness
    Neuronpedia logo
    GEMMA-2B-IT
    12-RES-JB
    INDEX 15055
    Transitional phrases that connect ideas or introduce new information in text, often at the beginning of sentences or paragraphs.
    claude-3-7-sonnet-20250219
     new survey.↵↵As expected, it is the western
    Neuronpedia logo
    GEMMA-2B-IT
    12-RES-JB
    INDEX 8170
    Conjunctions, transitions, and punctuation that connect clauses in explanatory text, particularly when describing relationships between ideas, making comparisons, or providing additional context about a subject.
    claude-3-7-sonnet-20250219
     role of an enforcer. In sum: fighting mitig
    Neuronpedia logo
    GEMMA-2B-IT
    12-RES-JB
    INDEX 13573
    Subword tokenization patterns where words are segmented into smaller linguistic units by a tokenizer, visible as partial syllables and morphemes across diverse text contexts.
    claude-3-7-sonnet-20250219
    ­pec­tedly large num­ber of states that
    Neuronpedia logo
    GEMMA-2B-IT
    12-RES-JB
    INDEX 2917
    Variety of words representing animals, natural phenomena, and specific objects enclosed in delimiters, often indicating key terms or important concepts in scientific or descriptive text.
    claude-3-5-haiku-20241022
     green woodpecker, great spotted woodpecker and
    Neuronpedia logo
    GEMMA-2-2B
    8-GEMMASCOPE-TRANSCODER-16K
    INDEX 875
    Technical discussions predominantly referencing software development, automotive systems, or computational tools, where "engine" typically refers to a computational or mechanical system powering a process.
    claude-3-5-haiku-20241022
     of SoInterpolateFloat engine, play around ;;;;;
    Neuronpedia logo
    GEMMA-2-2B
    0-GEMMASCOPE-TRANSCODER-16K
    INDEX 7224
    Text highlights specific food and drink items typically associated with dining experiences, focusing on various cuisines and the availability of beverages in restaurants and online settings.
    gpt-4o-mini
     the temptations of the extensive wine list. It also does
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 10
    Contextual mentions of education, challenges, and parental involvement in children's activities and learning.
    gpt-4o-mini
    , the 'Come to school using a means of transport
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 9
    The term "rich" frequently appears to describe abundance, depth, or quality across diverse contexts, including culture, history, and biodiversity. It is used to convey a sense of value and significance in various narratives.
    gpt-4o-mini
    , it's the rich background information behind sites,
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 8
    The text showcases various technical specifications and features of consumer electronics and other devices, often highlighting their performance aspects through numerical values, comparisons, and specific terminology related to technology.
    gpt-4o-mini
     7-inch touchscreen display with 102
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 7
    Various narrative styles highlighting personal experiences, legal discussions, and character developments, often containing key names or sentiments that add emotional weight to the passages.
    gpt-4o-mini
     a wonderful day for Susy and Geno and for their
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 6
    Frequent use of prepositions and conjunctions suggests a focus on relationships between ideas and detailed descriptions in various contexts.
    gpt-4o-mini
     Jew discuss the moral implications of the Nazi Holocaust. In
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 5
    Frequent use of idiomatic expressions, qualifiers, and comparative language that shape meaning and sentiment in diverse contexts, including conversational, narrative, and scientific settings.
    gpt-4o-mini
     at all↵Sometimes the greatest way to say something is
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 4
    The presence of scientific terminology and references, indicating formal academic or technical writing.
    gpt-4o-mini
     A. Stössl: Studies in the biochemistry of micro
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 3
    Varied expressions of sentiment, technical language, and complex ideas across different contexts, often accompanied by detailed conceptual discussions and specific terms to illustrate points.
    gpt-4o-mini
     a temple sealing) over principle (building a strong,
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 2
    The text features a formal academic tone, discussing medical topics related to mechanical ventilation and its effects, indicating the use of domain-specific vocabulary and references to studies and findings.
    gpt-4o-mini
    ) has been used in critical care patients for decades.
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 1
    The text features code snippets interspersed with mathematical notation and discussions about programming and formulations in different languages, indicating a technical context focused on programming, math problems, and algorithm implementation. Common patterns include embedded code formatting and comparisons in algorithms, alongside commentary on potential issues and concepts.
    gpt-4o-mini
     begin() + M*N; }↵  //
    Neuronpedia logo
    GEMMA-2-9B
    20-GEMMASCOPE-RES-16K
    INDEX 0
    The highlighted sequences predominantly consist of proper nouns, place names, organizations, and specific entities—often including geographic locations, institutional names, and branded terms. They frequently appear in contexts indicating attribution, location, or formal titles. The patterns show a tendency to mark multi-word and compound named entities, especially those combining place identifiers with organizations or events.
    gpt-4.1-mini-2025-04-14
     Show↵in the gaming hotspot of Las Vegas, the
    Neuronpedia logo
    GEMMA-2-2B
    25-GEMMASCOPE-RES-16K
    INDEX 10391
    The token consistently appears as an initial capitalized adjective referring to organizations, associations, institutions, programs, or descriptors affiliated with the United States. It commonly precedes formal group names, titles, or proper nouns indicating national identity or origin. This pattern occurs across diverse domains including healthcare, education, scientific societies, historical and cultural references, and professional bodies.
    gpt-4.1-mini-2025-04-14
     senior vice president at the American Hospital Association (AHA
    Neuronpedia logo
    GEMMA-2-2B
    25-GEMMASCOPE-RES-16K
    INDEX 6064