INDEX

Explanations

code-related syntax and data types in programming language snippets

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Configuration

ctigges/pythia-70m-deduped__mlp-sm_processed/2-mlp-sm

Prompts (Dashboard)

32,768 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

32,768

Data Type

torch.float32

Hook Name

blocks.2.hook_mlp_out

Hook Layer

Architecture

standard

Context Size

128

Dataset

EleutherAI/the_pile_deduplicated

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 spraying

-1.75

liness

-1.58

 advance

-1.57

ities

-1.56

 intervene

-1.53

 attitudes

-1.46

 analges

-1.46

 sprayed

-1.42

vity

-1.42

feld

-1.41

POSITIVE LOGITS

Ļª

2.17

Ķ

2.08

ħ

2.05

ı

2.01

ĺ

1.97

ĵ

1.95

Ĩ

1.91

İ

1.89

ĻĤ

1.88

«

1.84

Activations Density 0.604%

code-related syntax and data types in programming language snippets

No Comments

No Known Activations