INDEX

Explanations

themes related to broader contexts and general concepts

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GEMMA-2-2B @ 4-gemmascope-res-16k

Configuration

google/gemma-scope-2b-pt-res/layer_4/width_16k/average_l0_124

Prompts (Dashboard)

36,864 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

16,384

Data Type

float32

Hook Name

blocks.4.hook_resid_post

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

toir

-0.59

WebpackPlugin

-0.51

 lyder

-0.47

mobileqq

-0.46

cmath

-0.46

chene

-0.46

 terbukti

-0.44

 स्टार

-0.43

ESTAMP

-0.43

CardContent

-0.42

POSITIVE LOGITS

 general

1.36

general

1.26

 generale

1.20

 generales

1.16

overall

1.14

 broader

1.14

 geral

1.12

General

1.11

总体

1.11

 overall

1.09

Activations Density 0.812%

themes related to broader contexts and general concepts

No Comments

No Known Activations