Neuronpedia

EXPLANATION TYPE

oai_token-act-pair

Description

OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.

Author

OpenAI

URL

https://github.com/hijohnnylin/automated-interpretability

Settings

Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.

Recent Explanations

pirate-style speech patterns or dialectical language (words like "mate", "savvy", "be" as auxiliary verb, "Arrr").

claude-4-5-sonnet

matey! Monotheism be a belief in one

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 34737

German text or technical/formal language with prepositions and relational words.

claude-4-5-sonnet

Es ist nicht identisch mit NAME_1, das

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 54319

numbered name placeholders, particularly "NAME_2" and "NAME_3".

claude-4-5-sonnet

assistant<|end_header_id|>\n\nNAME_2. Please try again.

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 1505

definitional or explanatory clauses that describe what something is or means.

claude-4-5-sonnet

ism, which be a belief in many gods. Mono

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 33234

informal conversational language, particularly casual speech patterns and direct address to "you".

claude-4-5-sonnet

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 9981

word suffixes, particularly "-ained", "-ate", "-hood", and "-able".

claude-4-5-sonnet

Soil type: Well-drained, fertile\n* Climate

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 18012

transitions between conversational turns or speakers, particularly in chat or dialogue formats.

claude-4-5-sonnet

also act like a friend. Without further ado, let

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 39556

the beginning of assistant responses in multilingual conversational contexts.

claude-4-5-sonnet

Quelles sont vos responsabilitÃ©s?<|eot_id|><|start_header_id|>user

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 28412

tokens that appear immediately before special end-of-turn markers or system prompts in conversational AI training data.

claude-4-5-sonnet

2 is from Austin, Texas, Answer in German.

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 8662

line breaks and code formatting characters in technical or programming contexts.

claude-4-5-sonnet

type f | wc -l\n```\nThe `

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 46787

sentence-ending punctuation followed by line breaks, particularly at the end of messages or sections.

claude-4-5-sonnet

es Neuigkeiten gibt.\n\nVielen Dank.\n"""\n

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 35449

nouns that represent basic concepts or categories (colors, outcomes, genders, objects).

claude-4-5-sonnet

`geom_line()` to red in R using tidyverse

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 40363

the end of questions or statements followed by conversational turn markers or end-of-text tokens.

claude-4-5-sonnet

5. SÃŃ - Yes\n\nWould you like me

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 44498

technical or scientific terminology, particularly related to tools, devices, code, or technical objects.

claude-4-5-sonnet

instruments: These are handheld devices that can be taken to

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 9453

words related to specificity, distinction, or precision (like "distinct", "detailed", "specific", "appropriate", or Italian words about rights and individuality).

claude-4-5-sonnet

itÃł di esercitare i diritti e le

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 1608

variable assignments and definitions in code.

claude-4-5-sonnet

self.api_key = api_key\n \n def predict(self

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 34204

non-English text or structured data markers like colons, URLs, and code formatting.