INDEX

Explanations

syntactic elements typical in programming languages, particularly related to method and function definitions

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Configuration

neuronpedia/gpt2-small__res_slefr-ajt/2-res_slefr-ajt

Prompts (Dashboard)

12,288 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

46,080

Data Type

torch.float32

Hook Point

blocks.2.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

apollo-research/Skylion007-openwebtext-tokenizer-gpt2

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 è£ıè¦ļéĨĴ

-0.29

roth

-0.27

nil

-0.27

ogly

-0.26

ordan

-0.26

cludes

-0.26

nil

-0.25

ãĥĨ

-0.25

osure

-0.25

 istg

-0.25

POSITIVE LOGITS

uay

0.30

 Vietnamese

0.26

cano

0.25

Process

0.25

 Vietnam

0.24

ctor

0.23

Machine

0.22

 Simulator

0.22

 Machine

0.21

iste

0.21

Activations Density 0.118%

syntactic elements typical in programming languages, particularly related to method and function definitions

No Comments

No Known Activations