INDEX

Explanations

attends to the mention of "Handler" from instances of "close," "Builder," or "get" found later in the text

oai_attention-head · gpt-4o-mini Triggered by @bot

New Auto-Interp

Configuration

google/gemma-scope-9b-pt-att/layer_0/width_16k/average_l0_61

Prompts (Dashboard)

16,384 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.0.attn.hook_z

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Head Attr Weights

0:0.03

1:0.03

2:0.02

3:0.08

4:0.01

5:0.01

6:0.06

7:0.09

8:0.01

9:0.02

10:0.02

11:0.02

12:0.08

13:0.26

14:0.18

15:0.01

Negative Logits

WebElementEntity

-0.77

 好文分享

-0.74

 Dieſe

-0.74

 パンチラ

-0.74

 geweſen

-0.73

MethodManager

-0.73

bildtitel

-0.73

 ſeyn

-0.73

 nahil

-0.73

<unused22>

-0.73

POSITIVE LOGITS

</em>

0.30

↵

0.28

0.22

}}}$

0.21

])+

0.21

">)</

0.20

']):

0.19

the

0.19

Activations Density 0.199%

attends to the mention of "Handler" from instances of "close," "Builder," or "get" found later in the text

No Comments

No Known Activations