INDEX

Explanations

terms related to breaking, such as "break" with different contexts like "taking a break," "jump in the bear," and "break from the game."

oai_token-act-pair · gpt-3.5-turbo

instances of the word "break."

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 1-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.1.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.1.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

metics

-0.73

ulp

-0.71

minist

-0.70

cussion

-0.67

ammy

-0.66

iband

-0.64

apixel

-0.64

ifice

-0.63

omorphic

-0.63

Reviewer

-0.61

POSITIVE LOGITS

break

1.06

 break

1.00

breakers

0.95

 breaks

0.91

breaks

0.87

downs

0.85

away

0.84

neck

0.84

down

0.81

ers

0.80

Activations Density 0.016%

terms related to breaking, such as "break" with different contexts like "taking a break," "jump in the bear," and "break from the game."

instances of the word "break."

No Comments

No Known Activations