INDEX

Explanations

the word "then" in sentences

oai_token-act-pair · gpt-3.5-turbo

the repetitive use of the word "then."

oai_token-act-pair · gpt-4o-mini

Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 6-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.6.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Negative Logits

 impossibility

-0.68

 Bout

-0.64

 Venezuel

-0.64

 belief

-0.63

tery

-0.62

crazy

-0.61

 Presence

-0.59

 Duff

-0.59

 believers

-0.59

toe

-0.59

POSITIVE LOGITS

 proceeded

1.21

 proceeds

0.97

 proceed

0.89

veland

0.86

Ń·

0.84

ļéĨĴ

0.82

 promptly

0.81

 conclud

0.81

ŃĶ

0.81

Ļ½

0.79

Activations Density 0.041%

the word "then" in sentences

the repetitive use of the word "then."

No Known Activations