INDEX

Explanations

attends to the token "Ep" from various content tokens labeled with "Eq" and "Ex."

oai_attention-head · gpt-4o-mini Triggered by @bot

New Auto-Interp

Configuration

google/gemma-scope-9b-pt-att/layer_0/width_16k/average_l0_61

Prompts (Dashboard)

16,384 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.0.attn.hook_z

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Head Attr Weights

0:0.01

1:0.01

2:0.03

3:0.05

4:0.00

5:0.00

6:0.05

7:0.05

8:0.01

9:0.01

10:0.01

11:0.01

12:0.02

13:0.08

14:0.55

15:0.02

Negative Logits

 ciudadana

-0.19

 navideña

-0.19

 apropiado

-0.17

 środków

-0.16

 negociación

-0.16

 échelle

-0.16

）：

-0.16

 esclavos

-0.15

 ciudadano

-0.15

 realización

-0.15

POSITIVE LOGITS

 للمعارف

0.51

 الحره

0.49

rungsseite

0.46

matchCondition

0.43

ſſung

0.43

󠁢

0.42

 AsyncTask

0.41

ſicht

0.41

帖最后由

0.41

⦊

0.41

Activations Density 1.448%

attends to the token "Ep" from various content tokens labeled with "Eq" and "Ex."

No Comments

No Known Activations