INDEX

Explanations

instances of initial actions or beliefs that are later reconsidered or changed

oai_token-act-pair · gpt-4o-mini Triggered by @bot

phrases expressing initial thoughts or reactions, particularly those starting with "at first".

oai_token-act-pair · claude-3-5-haiku-20241022 Triggered by @neilrathi

phrases marking an initial stage or first reaction in a sequence or narrative.

oai_token-act-pair · gpt-5 Triggered by @jyhe0408

The neuron activates strongly for the phrase "at first" followed by expressions of initial reactions, beliefs, or states that later changed or were reconsidered.

oai_token-act-pair · claude-4-5-sonnet Triggered by @jyhe0408

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GEMMA-2-9B @ 20-gemmascope-res-16k

Configuration

google/gemma-scope-9b-pt-res/layer_20/width_16k/average_l0_68

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.20.hook_resid_post

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

UnusedPrivate

-0.63

DockStyle

-0.56

NameInMap

-0.54

RenderAtEndOf

-0.53

WebElementEntity

-0.53

 resourceCulture

-0.53

 linkovi

-0.53

tagHelperRunner

-0.52

ftagPool

-0.50

DataAnnotations

-0.49

POSITIVE LOGITS

 initially

1.20

 Initially

1.05

Initially

1.03

 anfangs

0.97

 inicialmente

0.95

 originally

0.84

 awalnya

0.82

 initial

0.81

 zunächst

0.78

 począ

0.76

Activations Density 0.167%

instances of initial actions or beliefs that are later reconsidered or changed

phrases expressing initial thoughts or reactions, particularly those starting with "at first".

phrases marking an initial stage or first reaction in a sequence or narrative.

The neuron activates strongly for the phrase "at first" followed by expressions of initial reactions, beliefs, or states that later changed or were reconsidered.

No Comments

No Known Activations