INDEX

Explanations

text related to programming and technical instructions

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 juggling

-0.64

 Juda

-0.62

 incorpor

-0.60

 velvet

-0.57

rons

-0.56

 stuffing

-0.55

 spiral

-0.55

 rotating

-0.54

 remission

-0.53

vom

-0.52

POSITIVE LOGITS

*/

0.63

ï¸

0.59

¬

0.58

 Mumbai

0.57

DT

0.57

ãĢĳ

0.57

>>

0.55

 CONT

0.55

 âĢ

0.54

audi

0.54

Activations Density 11.875%

text related to programming and technical instructions

No Comments

No Known Activations