INDEX

Explanations

various snippets of code and text related to programming, including terms like "SQL", "Node", "React", "CPU", "registers", "assembly", "Go", "compiler", "scaffolding", "dependencies", "method", "parameters", "variables", "channels", "sync

oai_token-act-pair · gpt-3.5-turbo

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_scl-ajt/6-res_scl-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 ashes

-0.57

 polio

-0.57

Times

-0.56

Hours

-0.54

 Notting

-0.54

TY

-0.52

 Typhoon

-0.52

 Newsp

-0.51

 Britann

-0.50

POSITIVE LOGITS

 assume

0.78

ird

0.78

aves

0.75

 automate

0.74

 initialize

0.71

 configure

0.70

eding

0.70

're

0.69

arers

0.69

 need

0.68

Activations Density 9.462%

various snippets of code and text related to programming, including terms like "SQL", "Node", "React", "CPU", "registers", "assembly", "Go", "compiler", "scaffolding", "dependencies", "method", "parameters", "variables", "channels", "sync

No Comments

No Known Activations