INDEX

Explanations

The neuron fires almost exclusively on the “<bos>” token (and other markers of new segments), so it’s detecting the start-of-sequence or sentence/document boundary.

oai_token-act-pair · o4-mini Triggered by @jyhe0408

prepositions indicating relationships, particularly "of" and "to", in formal or technical writing.

oai_token-act-pair · claude-4-5-sonnet Triggered by @jyhe0408

prepositions and related function words that mark relationships between ideas or actions (e.g., “of,” “on,” “to,” “in,” “for,” “between”).

oai_token-act-pair · gpt-5 Triggered by @jyhe0408

New Auto-Interp

Configuration

google/gemma-scope-2-12b-pt/resid_post/layer_31_width_16k_l0_medium

Prompts (Dashboard)

392,802 prompts, 256 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

Ammo

0.46

Cache

0.38

TAX

0.36

also

0.36

Rail

0.36

RootDir

0.36

0.35

Trailer

0.34

ﻤ

0.34

 ตุลาคม

0.34

POSITIVE LOGITS

 these

0.93

 aceste

0.83

 this

0.80

 such

0.79

这类

0.78

 acest

0.78

 이러한

0.73

こうした

0.70

 diesen

0.65

 thefe

0.65

Activations Density 14.067%

The neuron fires almost exclusively on the “<bos>” token (and other markers of new segments), so it’s detecting the start-of-sequence or sentence/document boundary.

prepositions indicating relationships, particularly "of" and "to", in formal or technical writing.

prepositions and related function words that mark relationships between ideas or actions (e.g., “of,” “on,” “to,” “in,” “for,” “between”).

No Comments

No Known Activations

The neuron fires almost exclusively on the “<bos>” token (and other markers of new segments), so it’s detecting the start-of-sequence or sentence/document boundary.

prepositions indicating relationships, particularly "of" and "to", in formal or technical writing.

prepositions and related function words that mark relationships between ideas or actions (e.g., “of,” “on,” “to,” “in,” “for,” “between”).

No Comments

No Known Activations