INDEX

Explanations

words or phrases related to following instructions

oai_token-act-pair · gpt-3.5-turbo

instances of the word "follow"

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 0-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.0.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.0.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

enery

-0.80

inventoryQuantity

-0.67

cloth

-0.64

oles

-0.63

 Lots

-0.63

alloc

-0.62

hetic

-0.61

tons

-0.61

Library

-0.60

eki

-0.60

POSITIVE LOGITS

 follow

3.70

follow

2.06

 Follow

1.96

 follows

1.92

 followed

1.76

Follow

1.51

 obey

1.37

 accompany

1.34

 adhere

1.29

 sequel

1.18

Activations Density 0.019%

words or phrases related to following instructions

instances of the word "follow"

No Comments

No Known Activations