INDEX

Explanations

code-related tokens, in particular, characters that start code blocks and indicate parameters

oai_token-act-pair · gemini-2.0-flash

formatting or markup syntax

np_token-act-pair-logits · gpt-4o-mini

HTML/code

np_max-act-logits · gemini-2.0-flash

New Auto-Interp

Configuration

google/gemma-scope-2b-pt-transcoders/layer_21/width_16k/average_l0_13

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.21.ln2.hook_normalized

Architecture

jumprelu_transcoder

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 '\\;'

-0.72

IsContent

-0.65

 tartalomajánló

-0.65

 "}";

-0.64

 виправивши

-0.63

 الحره

-0.62

 AssemblyCulture

-0.62

bootstrapcdn

-0.57

بوابة

-0.52

=`

-0.52

POSITIVE LOGITS

<strong>

1.68

<b>

1.66

//

1.18

**

0.79

mathbf

0.75

//

0.69

<!--

0.64

IsMutable

0.63

**

0.61

0.60

Activations Density 0.197%

code-related tokens, in particular, characters that start code blocks and indicate parameters

formatting or markup syntax

HTML/code

No Comments

No Known Activations