INDEX

Explanations

information about historical places or events

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Configuration

jbloom/Gemma-2b-IT-Residual-Stream-SAEs/gemma_2b_it_blocks.12.hook_resid_post_16384

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

HuggingFaceFW/fineweb

Features

16,384

Data Type

float32

Hook Name

blocks.12.hook_resid_post

Hook Layer

Architecture

standard

Context Size

1,024

Dataset

Skylion007/openwebtext

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 lapto

-0.94

 solidar

-0.89

 toal

-0.86

 demen

-0.85

 notor

-0.85

 utop

-0.82

 hamburg

-0.81

hoj

-0.79

hek

-0.76

 ideolog

-0.76

POSITIVE LOGITS

 Hence

0.64

 Thus

0.63

 Therefore

0.62

 Thereafter

0.61

The

0.61

 Later

0.60

Now

0.60

 Subsequently

0.60

 This

0.60

 Centuries

0.59

Activations Density 0.577%

information about historical places or events

No Comments

No Known Activations