INDEX

Explanations

computer code snippets including errors and functions

oai_token-act-pair · gpt-3.5-turbo

JSON structure elements or null values

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 2-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.2.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.2.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

ividual

-0.45

halla

-0.39

 Suit

-0.35

abus

-0.34

elvet

-0.34

itialized

-0.33

hower

-0.33

gins

-0.33

iversary

-0.32

ulous

-0.32

POSITIVE LOGITS

etheless

0.44

ĵĺ

0.39

 suspic

0.38

NetMessage

0.37

pse

0.34

 dissatisf

0.34

 cryst

0.34

Ĥİ

0.33

 exha

0.33

Ĥª

0.32

Activations Density 5.384%

computer code snippets including errors and functions

JSON structure elements or null values

No Comments

No Known Activations