INDEX

Explanations

numbers or quantifiers related to significant quantities

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

igion

-0.78

inventoryQuantity

-0.63

LAND

-0.62

 Situation

-0.61

vest

-0.61

llor

-0.60

 Manifest

-0.60

 Syndicate

-0.60

GEN

-0.60

actor

-0.60

POSITIVE LOGITS

 thousand

1.07

eenth

0.95

 thous

0.93

ourcing

0.90

 thousands

0.89

uous

0.83

uously

0.82

ourced

0.80

ousands

0.79

 Thousand

0.79

Activations Density 6.299%

numbers or quantifiers related to significant quantities

No Comments

No Known Activations