INDEX

Explanations

topics or subjects being discussed or mentioned

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

ramid

-0.70

ardo

-0.67

hovah

-0.67

othy

-0.65

ignt

-0.65

igned

-0.64

arus

-0.64

alty

-0.63

 Zimmer

-0.61

xon

-0.61

POSITIVE LOGITS

matter

0.89

 topics

0.89

 Topics

0.79

Topic

0.77

 topic

0.76

Topics

0.75

 debated

0.74

afety

0.73

topic

0.73

TextColor

0.71

Activations Density 8.701%

topics or subjects being discussed or mentioned

No Comments

No Known Activations