INDEX

Explanations

numbers and quantities

oai_token-act-pair · gpt-3.5-turbo

cardinal numbers (two, three, four, eight, ten, etc.) at the beginning of phrases or sentences.

oai_token-act-pair · claude-3-5-sonnet-20240620 Triggered by @aserino3

numerical values, especially those indicating quantities or measurements.

oai_token-act-pair · gpt-4o Triggered by @459865181

numerical data and statistics related to counts or quantities

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 8-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.8.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.8.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

•all features

•CS444

No Comments

Negative Logits

geist

-0.67

AMI

-0.63

othal

-0.60

ovan

-0.59

Kun

-0.56

 totality

-0.55

iatus

-0.55

ablishment

-0.54

normal

-0.54

jo

-0.54

POSITIVE LOGITS

etheless

0.82

thirds

0.74

 thirds

0.71

doms

0.70

 times

0.70

tions

0.65

 fold

0.63

 Weir

0.62

taboola

0.62

pecially

0.61

Activations Density 0.136%

numbers and quantities

cardinal numbers (two, three, four, eight, ten, etc.) at the beginning of phrases or sentences.

numerical values, especially those indicating quantities or measurements.

numerical data and statistics related to counts or quantities

No Comments

No Known Activations