INDEX

Explanations

scientific and astronomical terms and concepts

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

plings

-0.64

isode

-0.63

incerity

-0.61

ividual

-0.61

Interstitial

-0.61

inki

-0.58

idation

-0.58

lain

-0.57

xit

-0.56

igan

-0.56

POSITIVE LOGITS

 astronomers

0.99

 astronomer

0.89

omical

0.88

 telescope

0.85

 astroph

0.85

 Telescope

0.83

 telescopes

0.82

 Astron

0.78

omy

0.75

 Observatory

0.74

Activations Density 6.446%

scientific and astronomical terms and concepts

No Comments

No Known Activations