Neuronpedia

EXPLANATION TYPE

oai_token-act-pair

Description

OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.

Author

OpenAI

URL

https://github.com/hijohnnylin/automated-interpretability

Settings

Default prompts from the main branch, strategy TokenActivationPair.

Recent Explanations

language indicating progression, advancement, improvement, or dominance of a subject over time or in comparison to alternatives.

claude-4-5-haiku

Gradual mainstream adoption continues. Institutional investors (hedge

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 11

encoded hexadecimal strings, hashes, and other long alphanumeric sequences.

claude-4-5-haiku

7Xl08T6_r0](

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 211

domain-specific and technical terminology across professional and specialized contexts.

claude-4-5-haiku

repeated use in a cooking environment. Here are the most

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 68

month names and date-related terminology across multiple languages.

claude-4-5-haiku

[ 'p'='π' ]↵ [

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 59

limitations, problems, and negative aspects or challenges associated with a topic.

claude-4-5-haiku

execute Python bytecode at a time. This limits true parallelism

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 58

professional business and technical content related to operations, industries, and organizational processes.

claude-4-5-sonnet

.) – focus on fleet modernization, pilot proficiency, and

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 51

phrases that describe quantities or sizes.

gemini-2.5-flash-lite

(25in x 20in). However

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 54

comparative language and analogies used to explain or relate one concept to another.

claude-4-5-haiku

read. This is similar to `scanf()`.

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 53

Python code that imports the `sys` module and defines a `main` function.

gemini-2.5-flash-lite

logging↵import sys↵↵from slack_bolt import App

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 55

import statements and library/module references in code.

claude-4-5-haiku

logging↵import sys↵↵from slack_bolt import App

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 55

markers of analytical/expository writing—transitions, section labels, and abstract technical terms that signal formal explanation or instruction.

gpt-5

have* emotions. It can *analyze* them,

GEMMA-3-27B-IT

31-GEMMASCOPE-2-RES-262K

INDEX 93762

This neuron detects long runs of alphanumeric/ASCII-encoded data (e.g., base64 or other long encoded/code-like token sequences).

gpt-5-mini

pppp/8/3p4/3NP3

GEMMA-3-27B-IT

31-GEMMASCOPE-2-RES-262K

INDEX 57163

the model's responses that provide factual information with external resource links and structured references.

claude-4-5-haiku

.wikipedia.org/wiki/Hitomi_Tan

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 1

temporal sequence markers, particularly "prior to" and "pre-" constructions that indicate time-related ordering or before-and-after relationships.

claude-4-5-haiku

.[2]↵↵Prior to the development of crash test

GEMMA-3-4B-IT

2-GEMMASCOPE-2-TRANSCODER-16K

INDEX 0

mentions of the Fibonacci sequence or mathematical concept.

claude-4-5-haiku

↵```python↵def fibonacci(n):↵

GEMMA-3-4B-IT

2-GEMMASCOPE-2-TRANSCODER-16K

INDEX 1

closing parentheses, brackets, and braces that terminate code expressions or grouped structures.

claude-4-5-haiku

$LogEntry↵ }↵}↵↵# ---

GEMMA-3-4B-IT

9-GEMMASCOPE-2-RES-16K

INDEX 0

text that is formatted with bolding and asterisks.

gemini-2.5-flash-lite

-10:** Initial observation of unusual vehicle traffic

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 6

prime numbers.

gemini-2.5-flash-lite

+ 9. Not divisible by 17.

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 2

words related to academic or scholarly writing.

gemini-2.5-flash-lite

00 words:↵↵---↵↵**The Seed of

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 0

English words related to location.

gemini-2.5-flash-lite

.wikipedia.org/wiki/Hitomi_Tan

GEMMA-3-4B-IT

12-GEMMASCOPE-2-TRANSCODER-16K

INDEX 1