INDEX

Explanations

references to music albums

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 10-res_post_32k-oai

Configuration

jbloom/GPT2-Small-OAI-v5-32k-resid-post-SAEs/v5_32k_layer_10.pt

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

32,768

Data Type

torch.float32

Hook Name

blocks.10.hook_resid_post

Hook Layer

Architecture

standard

Context Size

Dataset

Skylion007/openwebtext

Activation Function

topk

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

FTWARE

-0.75

nces

-0.73

dit

-0.72

 Lanka

-0.69

bilt

-0.69

nir

-0.67

pire

-0.67

 Leone

-0.66

SPONSORED

-0.65

MpServer

-0.65

POSITIVE LOGITS

ographies

1.10

ography

1.04

 covers

0.87

ographic

0.85

 cover

0.85

ographers

0.83

ographer

0.82

 artwork

0.82

alog

0.80

osite

0.79

Activations Density 0.084%

references to music albums

No Comments

No Known Activations