INDEX

Explanations

instances of numbers being mentioned with a reference to frequency

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Configuration

jbloom/Gemma-2b-Residual-Stream-SAEs/gemma_2b_blocks.6.hook_resid_post_16384_anthropic_fast_lr

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

HuggingFaceFW/fineweb

Features

16,384

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_post

Architecture

standard

Context Size

1,024

Dataset

HuggingFaceFW/fineweb

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

<bos>

-3.08

-0.91

ⓧ

-0.86

<?

-0.84

lateinit

-0.78

///**

-0.75

int

-0.73

arr

-0.72

public

-0.72

const

-0.70

POSITIVE LOGITS

 jaya

1.94

Juf

1.81

 haup

1.79

 chrysler

1.78

 eiffel

1.77

 stockholm

1.75

hcm

1.74

 sovere

1.73

 bangkok

1.73

 bandung

1.73

Activations Density 0.160%

instances of numbers being mentioned with a reference to frequency

No Comments

No Known Activations