INDEX

Explanations

sentences that end with a comma followed by a numerical activation, potentially focusing on a specific type of syntactic structure

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Configuration

jbloom/Gemma-2b-IT-Residual-Stream-SAEs/gemma_2b_it_blocks.12.hook_resid_post_16384

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

HuggingFaceFW/fineweb

Features

16,384

Data Type

float32

Hook Name

blocks.12.hook_resid_post

Hook Layer

Architecture

standard

Context Size

1,024

Dataset

Skylion007/openwebtext

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 sappi

-1.20

 milano

-1.13

 deleter

-1.10

mef

-1.08

 légiti

-1.05

 embodi

-1.03

 renou

-1.03

obb

-1.01

 dises

-1.01

 lancia

-1.00

POSITIVE LOGITS

it

0.88

 they

0.87

he

0.79

she

0.76

 there

0.75

we

0.72

you

0.63

they

0.63

0.60

 everyone

0.60

Activations Density 0.266%

sentences that end with a comma followed by a numerical activation, potentially focusing on a specific type of syntactic structure

No Comments

No Known Activations