INDEX

Explanations

references, citations, and external documents in a scientific context

oai_token-act-pair · gpt-4o-mini Triggered by @bot

References with numbers (e.g., @CR8, @bib48)

np_acts-logits-general · gemini-2.0-flash

citations or references

np_acts-logits-general · gemini-2.5-flash-lite

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GEMMA-2-2B @ 20-gemmascope-res-16k

Configuration

google/gemma-scope-2b-pt-res/layer_20/width_16k/average_l0_71

Prompts (Dashboard)

36,864 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.20.hook_resid_post

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 Seven

-0.73

Seven

-0.69

 Seventeen

-0.68

-0.67

seven

-0.63

 Seventh

-0.61

 seven

-0.60

Seventh

-0.59

VII

-0.59

july

-0.58

POSITIVE LOGITS

IndentedString

0.82

⑧

0.77

 AssemblyCulture

0.76

ThroughAttribute

0.72

 tartalomajánló

0.70

GEBURTSDATUM

0.70

 eighth

0.69

 viii

0.67

adaptiveStyles

0.64

RegressionTest

0.64

Activations Density 0.420%

references, citations, and external documents in a scientific context

References with numbers (e.g., @CR8, @bib48)

citations or references

No Comments

No Known Activations