INDEX

Explanations

numbers related to citations and references in academic literature

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

ongs

-0.84

venge

-0.82

ety

-0.80

imer

-0.77

 regiment

-0.75

arnaev

-0.75

isner

-0.73

panic

-0.73

ongh

-0.72

iqu

-0.72

POSITIVE LOGITS

å¹

0.96

pp

0.82

).

0.81

published

0.80

),

0.75

 Highlights

0.75

PhD

0.74

)).

0.72

)—

0.71

 reprint

0.71

Activations Density 5.840%

numbers related to citations and references in academic literature

No Comments

No Known Activations