INDEX

Explanations

references to events, people, and places associated with the 20th century

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

ĸļ

-0.67

ãĥ£

-0.63

etsk

-0.60

gha

-0.60

Äĩ

-0.58

 istg

-0.54

 constitu

-0.53

 Janeiro

-0.53

char

-0.52

vic

-0.52

POSITIVE LOGITS

ruary

0.84

ish

0.69

something

0.61

 Spartans

0.60

owship

0.57

ishes

0.56

ancers

0.56

 anniversary

0.54

STE

0.52

Activations Density 13.731%

references to events, people, and places associated with the 20th century

No Comments

No Known Activations