INDEX

Explanations

mentions of specific months

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

ortium

-0.76

 looph

-0.74

Documents

-0.68

 patents

-0.66

 unpublished

-0.65

ioch

-0.64

 sche

-0.60

 testim

-0.60

 confidential

-0.59

ellectual

-0.59

POSITIVE LOGITS

 Feast

0.86

 Celebration

0.84

 festivities

0.81

 celebration

0.81

Eve

0.81

 Month

0.80

 holidays

0.78

 Calendar

0.78

eve

0.77

 holiday

0.77

Activations Density 22.712%

mentions of specific months

No Comments

No Known Activations