INDEX

Explanations

keywords and phrases related to specific requirements or provisions

oai_token-act-pair · gpt-3.5-turbo

key points and requirements laid out in lists or structured formats

oai_token-act-pair · gpt-4o-mini

Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 7-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.7.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.7.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Negative Logits

 Wander

-0.78

 Thornton

-0.68

 Gaal

-0.66

cules

-0.65

sburgh

-0.65

yan

-0.63

 Wrestle

-0.62

Mad

-0.62

 merry

-0.62

Kre

-0.62

POSITIVE LOGITS

âĹı

1.23

âĸł

1.00

âĢ¢

1.00

âľ

0.97

Â·

0.93

âĺħ

0.92

generation

0.80

ÂłÂłÂłÂł

0.80

Educ

0.80

ÂłÂłÂłÂłÂłÂłÂłÂł

0.79

Activations Density 0.135%

keywords and phrases related to specific requirements or provisions

key points and requirements laid out in lists or structured formats

No Known Activations