INDEX

Explanations

phrases related to continuations or transitions in text

oai_token-act-pair · gpt-3.5-turbo

the presence of the word "still" indicating continuity or contrast in a statement

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 4-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.4.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.4.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 courier

-0.66

oline

-0.58

minster

-0.58

 breakup

-0.56

SourceFile

-0.56

-+

-0.56

 initiative

-0.54

MpServer

-0.54

assed

-0.54

 landfill

-0.53

POSITIVE LOGITS

 despite

0.85

tons

0.83

 however

0.82

 although

0.82

 alas

0.80

let

0.79

 beware

0.77

 there

0.77

 anecd

0.77

 unlike

0.77

Activations Density 0.091%

phrases related to continuations or transitions in text

the presence of the word "still" indicating continuity or contrast in a statement

No Comments

No Known Activations