Neuronpedia

EXPLANATION TYPE

oai_token-act-pair

Description

OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.

Author

OpenAI

URL

https://github.com/hijohnnylin/automated-interpretability

Settings

Default prompts from the main branch, strategy TokenActivationPair. Uses top 10 deduplicated activations.

Recent Explanations

browser or website notifications that inform users about unsupported configurations (like disabled JavaScript, using an outdated browser, ad-blocker warnings, or guest access limitations).

deepseek-v3

latest version of Internet Explorer. You'll still be able

QWEN3-4B

20-TRANSCODER-HP

INDEX 63733

transitional or contrasting phrases that introduce exceptions or counterpoints in academic/scientific writing (words like "but", "however", "yet", "while" that signal exceptions to the preceding statement).

deepseek-v3

tumorigenesis but the mechanisms are unclear. A

QWEN3-4B

24-TRANSCODER-HP

INDEX 150274

technical or academic terminology, particularly in specialized domains like technology, medicine, and science. The neuron seems particularly tuned to identifying jargon, complex concepts, and domain-specific language that appears in formal or technical writing.

deepseek-v3

and watch videos, etc. In essence the cell phone

QWEN3-4B

14-TRANSCODER-HP

INDEX 40595

periods at the end of answer statements in Q&A formatting (. after a declarative response to a question).

deepseek-v3

to?↵↵We ship worldwide. We have thousands of happy

QWEN3-4B

22-TRANSCODER-HP

INDEX 130065

prefixes and words related to the concept of "co-" or "com-" indicating togetherness or combination, particularly in medical/scientific contexts (e.g., coinfection, comorbidity, coexisting, concomitant).

deepseek-v3

-1-coinfected patients.↵Sera from

QWEN3-4B

12-TRANSCODER-HP

INDEX 23094

code blocks and code-related syntax (brackets, semicolons, method definitions, etc.) in technical documentation or programming-related queries.

deepseek-v3

httpClient = new OkHttpClient.Builder(); ↵↵httpClient.addInterceptor(logging

QWEN3-4B

27-TRANSCODER-HP

INDEX 57492

comma tokens within software license/copyright headers, particularly ones appearing in standardized boilerplate sections about legal compliance or licensing terms.

deepseek-v3

v. 2.0 which is available at↵

QWEN3-4B

32-TRANSCODER-HP

INDEX 41995

numerical tokens and quantities in various contexts

deepseek-r1

2, q: 2}.↵1/6

QWEN3-4B

25-TRANSCODER-HP

INDEX 108254

numbers and mathematical sequences.

deepseek-v3

2, q: 2}.↵1/6

QWEN3-4B

25-TRANSCODER-HP

INDEX 108254

code-related syntax markers and programming environments, particularly Jupyter and command formatting.

claude-4-5-sonnet

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 21484

formatting elements like spaces, punctuation, and numbers in formal documents and legal/corporate text.

claude-4-5-sonnet

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 25506

technical descriptions of automotive or mechanical components and their installation locations.

claude-4-5-sonnet

plate is installed in the engine compartment.\n* The

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 36995

code or technical documentation, particularly related to hardware programming and configuration.

claude-4-5-sonnet

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 40000

technical documentation about machine learning workflows and data science operations.

claude-4-5-sonnet

machine learning model and create a job run using the H

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 16505

HTML/CSS syntax, particularly style attributes and tag opening sequences.

claude-4-5-sonnet

HTML code:\n<div style="background-color: green;padding

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 4232

JavaScript function declarations and definitions.

claude-4-5-sonnet

\nbutton.addEventListener("click", function() {\n //

LLAMA3.3-70B-IT

50-RESID-POST-GF

INDEX 20660

technical terms and concepts in DynamoDB documentation or Q&A format, particularly activating on database terminology and structured question-answer formatting.

claude-4-5-sonnet