INDEX

Explanations

the word "head"

oai_token-act-pair · gemini-2.0-flash

head

np_max-act · gemini-2.0-flash

New Auto-Interp

Configuration

google/gemma-scope-2b-pt-transcoders/layer_3/width_16k/average_l0_54

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.3.ln2.hook_normalized

Architecture

jumprelu_transcoder

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 head

-3.17

 Head

-2.88

head

-2.86

Head

-2.83

HEAD

-2.48

 HEAD

-2.47

 heads

-2.30

heads

-2.20

 Heads

-2.05

Heads

-1.93

POSITIVE LOGITS

expandindo

0.62

ymce

0.58

 NSCoder

0.52

CORBA

0.51

aph

0.50

Aph

0.50

GEBURTSDATUM

0.50

 مواليد

0.49

tamount

0.49

 Valenci

0.48

Activations Density 0.378%

the word "head"

head

No Comments

No Known Activations