Neuronpedia

EXPLANATION TYPE

oai_token-act-pair

Description

OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.

Author

OpenAI

URL

https://github.com/hijohnnylin/automated-interpretability

Settings

Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.

Recent Explanations

legal and technical text related to software licensing and copyright notices.

deepseek-v3

'Julio','AÅŃgusto','

QWEN3-4B

33-TRANSCODER-HP

INDEX 53675

casual, informal vocabulary and colloquial expressions used to reference vague collections or groups of things.

claude-4-5-haiku

was people and travel related stuff..... with some nature photos

QWEN3.5-9B-PT

15-QWENSCOPE-RES-64K

INDEX 1598

terms related to error messages or warnings in technical contexts.

deepseek-v3

branches by performing another checkout.↵↵But then I just checkout

QWEN3-4B

32-TRANSCODER-HP

INDEX 43098

code snippets and technical file extensions (like `.txt`, `.php`, `.json`, etc.) in programming-related queries.

deepseek-v3

of a SQL Server database. The MDF and

QWEN3-4B

31-TRANSCODER-HP

INDEX 18863

dates (numerical values representing years, days, or months) in the text.

deepseek-v3

the full moon with vampires?↵↵One association has to do

QWEN3-4B

30-TRANSCODER-HP

INDEX 96026

the final word or phrase before a punctuation mark.

deepseek-v3

Ð½ÑĭÐ¼. Ð£Ð½Ð¸Ð²ÐµÑĢÑģ

QWEN3-4B

22-TRANSCODER-HP

INDEX 87885

syntax elements and formatting characters in code and technical documentation, such as punctuation, symbols, file extensions, license information, and programming language constructs.

deepseek-v3

**↵** 1. The origin of this software

QWEN3-4B

35-TRANSCODER-HP

INDEX 39692

error messages and system/technical issues.

deepseek-v3

, err: "Set data is not valid"}))↵

QWEN3-4B

22-TRANSCODER-HP

INDEX 112022

phrases indicating negations or exceptions, particularly words like "not," "without," "but," and "never" that introduce contrasting or limiting statements.

deepseek-v3

DependencyTestProto {↵ private DependencyTestProto() {}↵

QWEN3-4B

22-TRANSCODER-HP

INDEX 98126

words related to quantities, amounts, and metrics.

deepseek-v3

al guidance: this review contains strong language (and some

QWEN3-4B

27-TRANSCODER-HP

INDEX 8821

strong contrasts (either through conjunctions like "but" or through conceptual/medical opposites) that indicate a divergence from expectation or norm.

deepseek-v3

the atrial lead, but not the ventricular lead

QWEN3-4B

23-TRANSCODER-HP

INDEX 24510

browser or website notifications that inform users about unsupported configurations (like disabled JavaScript, using an outdated browser, ad-blocker warnings, or guest access limitations).

deepseek-v3

latest version of Internet Explorer. You'll still be able

QWEN3-4B

20-TRANSCODER-HP

INDEX 63733

transitional or contrasting phrases that introduce exceptions or counterpoints in academic/scientific writing (words like "but", "however", "yet", "while" that signal exceptions to the preceding statement).

deepseek-v3

tumorigenesis but the mechanisms are unclear. A

QWEN3-4B

24-TRANSCODER-HP

INDEX 150274

technical or academic terminology, particularly in specialized domains like technology, medicine, and science. The neuron seems particularly tuned to identifying jargon, complex concepts, and domain-specific language that appears in formal or technical writing.

deepseek-v3

and watch videos, etc. In essence the cell phone

QWEN3-4B

14-TRANSCODER-HP

INDEX 40595

periods at the end of answer statements in Q&A formatting (. after a declarative response to a question).

deepseek-v3

to?↵↵We ship worldwide. We have thousands of happy

QWEN3-4B

22-TRANSCODER-HP

INDEX 130065

prefixes and words related to the concept of "co-" or "com-" indicating togetherness or combination, particularly in medical/scientific contexts (e.g., coinfection, comorbidity, coexisting, concomitant).

deepseek-v3

-1-coinfected patients.↵Sera from

QWEN3-4B

12-TRANSCODER-HP

INDEX 23094

code blocks and code-related syntax (brackets, semicolons, method definitions, etc.) in technical documentation or programming-related queries.

deepseek-v3

httpClient = new OkHttpClient.Builder(); ↵↵httpClient.addInterceptor(logging

QWEN3-4B

27-TRANSCODER-HP

INDEX 57492

comma tokens within software license/copyright headers, particularly ones appearing in standardized boilerplate sections about legal compliance or licensing terms.

deepseek-v3

v. 2.0 which is available at↵

QWEN3-4B

32-TRANSCODER-HP

INDEX 41995

numerical tokens and quantities in various contexts

deepseek-r1

2, q: 2}.↵1/6

QWEN3-4B

25-TRANSCODER-HP

INDEX 108254

numbers and mathematical sequences.

deepseek-v3

2, q: 2}.↵1/6

QWEN3-4B

25-TRANSCODER-HP

INDEX 108254