INDEX

Explanations

a specific pattern of characters that might be related to a particular language or script

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scefr-ajt/6-res_scefr-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

zees

-0.69

swick

-0.62

zee

-0.61

abase

-0.61

ormal

-0.57

ittens

-0.56

sole

-0.56

ilateral

-0.56

ongs

-0.56

rish

-0.55

POSITIVE LOGITS

Ö

0.77

Ö¼

0.75

ÙĲ

0.70

×Ļ

0.67

×Ĳ

0.64

×Ķ

0.62

Ù

0.61

Ùĩ

0.61

×ķ

0.60

ÙĬ

0.59

Activations Density 0.070%

a specific pattern of characters that might be related to a particular language or script

No Comments

No Known Activations