INDEX

Explanations

the word "whim" or similar words related to sudden desires or impulses

oai_token-act-pair · gpt-3.5-turbo

references to whims and spontaneous decisions

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 0-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.0.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.0.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 Detect

-0.74

ells

-0.69

Detect

-0.66

 acknow

-0.66

Connection

-0.63

ociate

-0.63

ansen

-0.63

aucus

-0.62

archives

-0.61

nsic

-0.61

POSITIVE LOGITS

 whim

3.91

 whims

3.08

 behest

1.18

 sway

1.09

 rant

1.03

 mercy

1.01

 swoop

0.99

 beck

0.97

 pleading

0.95

vag

0.93

Activations Density 0.041%

the word "whim" or similar words related to sudden desires or impulses

references to whims and spontaneous decisions

No Comments

No Known Activations