INDEX

Explanations

sentences that elaborate on historical events, literary works, and political discussions

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 8-res_fs6144-jb

Configuration

jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8/blocks.8.hook_resid_pre_6144

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

6,144

Data Type

torch.float32

Hook Point

blocks.8.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

chell

-0.71

untarily

-0.71

iny

-0.70

lees

-0.65

izens

-0.62

weet

-0.60

keyes

-0.59

¿

-0.59

iple

-0.59

lift

-0.59

POSITIVE LOGITS

 namely

1.36

 albeit

1.31

 whereby

1.29

 consisting

1.27

 wherein

1.24

 which

1.22

 preferably

1.08

 comprising

1.08

aka

1.05

 akin

0.99

Activations Density 0.913%

sentences that elaborate on historical events, literary works, and political discussions

No Comments

No Known Activations