INDEX

Explanations

the repeated use of the term "again"

oai_token-act-pair · gpt-4o-mini Triggered by @bot

the word "again" as a discourse marker or transitional device.

oai_token-act-pair · claude-4-5-haiku Triggered by @emiglarou

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GEMMA-2-9B @ 31-gemmascope-res-16k

Configuration

google/gemma-scope-9b-pt-res/layer_31/width_16k/average_l0_114

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.31.hook_resid_post

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 vyst

-0.34

-0.32

{~

-0.30

𝒞

-0.29

사

-0.28

 remaining

-0.28

 demás

-0.28

間に

-0.28

His

-0.28

</em>

-0.28

POSITIVE LOGITS

AndEndTag

0.79

featureID

0.65

RegressionTest

0.61

NewReader

0.61

 betweenstory

0.60

AxisAlignment

0.59

RectangleBorder

0.59

bootstrapcdn

0.58

 BorderSide

0.57

征詢我

0.57

Activations Density 0.066%

the repeated use of the term "again"

the word "again" as a discourse marker or transitional device.

No Comments

No Known Activations