INDEX

Explanations

instances of punctuation, particularly commas, indicating pauses or separations in thoughts

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Configuration

Juliushanhanhan/llama-3-8b-it-res/blocks.25.hook_resid_post

Features

65,536

Data Type

float32

Hook Name

blocks.25.hook_resid_post

Hook Layer

Architecture

gated

Context Size

1,024

Dataset

Juliushanhanhan/openwebtext-1b-llama3-tokenized-cxt-1024

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

...\

-0.15

 ifndef

-0.14

bersome

-0.14

éĺħè¯»æ¬¡æķ°

-0.13

Ã¨o

-0.13

-chan

-0.13

ymoon

-0.13

ldkf

-0.13

ROM

-0.13

nam

-0.13

POSITIVE LOGITS

but

0.24

0.21

 which

0.19

it

0.17

0.16

he

0.16

we

0.16

and

0.15

as

0.15

if

0.14

Activations Density 0.256%

instances of punctuation, particularly commas, indicating pauses or separations in thoughts

No Comments

No Known Activations