INDEX

Explanations

HTML or XML tags indicating attributes or values

oai_token-act-pair · gpt-3.5-turbo

HTML and markup syntax, particularly closing tags and attributes

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 6-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.6.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

etheless

-0.82

 Rutherford

-0.78

ĪĴ

-0.71

 whistle

-0.69

 weary

-0.69

cius

-0.68

aido

-0.65

 Crow

-0.64

ounty

-0.64

 veter

-0.63

POSITIVE LOGITS

 <!--

0.95

âĸĳ

0.94

PIN

0.87

âĸĴ

0.87

TPS

0.86

)</

0.86

!--

0.83

Insert

0.82

"},{"

0.77

=>

0.77

Activations Density 0.007%

HTML or XML tags indicating attributes or values

HTML and markup syntax, particularly closing tags and attributes

No Comments

No Known Activations