INDEX

Explanations

predictions about the future

oai_token-act-pair · gpt-3.5-turbo

keywords associated with conditional and temporal transitions, often involving "then" and auxiliary verbs like "can", "have", and "would"

oai_token-act-pair · gpt-3.5-turbo Triggered by @danbraun

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

urse

-0.25

overty

-0.24

pes

-0.23

urses

-0.22

uddle

-0.22

kHz

-0.22

ixon

-0.21

tty

-0.21

omal

-0.21

rongh

-0.20

POSITIVE LOGITS

èª

0.24

 Ital

0.23

enegger

0.22

Reloaded

0.21

 interven

0.21

 awakening

0.21

whel

0.20

 disapp

0.20

 exha

0.20

 confir

0.20

Activations Density 6.512%

predictions about the future

keywords associated with conditional and temporal transitions, often involving "then" and auxiliary verbs like "can", "have", and "would"

No Comments

No Known Activations