INDEX

Explanations

Proper nouns, specifically locations, and potentially names of people or organizations

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scefr-ajt/6-res_scefr-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

Cro

-0.29

 overhe

-0.27

HDR

-0.26

 breat

-0.26

ockey

-0.26

 kingdom

-0.25

 smokes

-0.24

anie

-0.24

 Isles

-0.24

ously

-0.24

POSITIVE LOGITS

roma

0.31

ilon

0.31

itudes

0.30

alion

0.30

nai

0.29

alions

0.29

Tau

0.29

atu

0.29

ribes

0.28

mers

0.28

Activations Density 0.004%

Proper nouns, specifically locations, and potentially names of people or organizations

No Comments

No Known Activations