INDEX

Explanations

proper nouns, particularly names of people or organizations, along with verbs like "pointed", "referenced", "referred"

oai_token-act-pair · gpt-3.5-turbo

phrases indicating citations or references

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 6-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.6.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

thood

-0.76

vic

-0.74

Torrent

-0.72

orld

-0.70

Â¯Â¯Â¯Â¯

-0.68

Ont

-0.68

ire

-0.68

cum

-0.66

 glim

-0.65

itialized

-0.65

POSITIVE LOGITS

 phrases

0.93

 excerpts

0.91

 passages

0.82

 anecdotes

0.79

 similarities

0.78

 examples

0.77

 quotes

0.74

 inconsistencies

0.71

 references

0.71

 suggestions

0.70

Activations Density 0.213%

proper nouns, particularly names of people or organizations, along with verbs like "pointed", "referenced", "referred"

phrases indicating citations or references

No Comments

No Known Activations