INDEX

Explanations

mathematical operations and expressions in various forms

oai_token-act-pair · gpt-4o-mini Triggered by @bot

Fractions and sequences

np_acts-logits-general · gemini-2.0-flash

ordinal numbers twelve and thirteen

np_acts-logits-general · gemini-2.5-flash-lite

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GEMMA-2-2B @ 20-gemmascope-res-16k

Configuration

google/gemma-scope-2b-pt-res/layer_20/width_16k/average_l0_71

Prompts (Dashboard)

36,864 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.20.hook_resid_post

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

IRST

-0.57

mers

-0.52

quiera

-0.52

ONE

-0.51

impl

-0.49

ignty

-0.48

 FIRST

-0.47

One

-0.46

One

-0.46

 vuông

-0.45

POSITIVE LOGITS

 thirteenth

0.90

 twelfth

0.89

 Thirteen

0.87

 Twelve

0.83

 Thirteenth

0.82

Thirteen

0.82

 Fourteenth

0.81

Twelve

0.81

 fourteenth

0.80

 twelve

0.80

Activations Density 0.515%

mathematical operations and expressions in various forms

Fractions and sequences

ordinal numbers twelve and thirteen

No Comments

No Known Activations