INDEX

Explanations

terms related to bit error rates and atomic structures in technical contexts

oai_token-act-pair · gpt-4o-mini

Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GEMMA-2-2B @ 19-gemmascope-mlp-16k

Configuration

google/gemma-scope-2b-pt-mlp/layer_19/width_16k/average_l0_109

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.19.hook_mlp_out

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

IFrame

Link

Negative Logits

sizeCache

-0.96

 Monfieur

-0.79

estacks

-0.79

 pleaſure

-0.77

 CanadaChoose

-0.77

 Италијани

-0.75

 myſelf

-0.75

 poffible

-0.74

 RIPRODUZIONE

-0.74

fillType

-0.74

POSITIVE LOGITS

順

0.45

te

0.44

byt

0.43

配

0.42

pr

0.40

tici

0.40

 force

0.40

com

0.39

by

0.38

sm

0.37

Activations Density 0.523%

terms related to bit error rates and atomic structures in technical contexts

No Known Activations