INDEX

Explanations

superlatives and intensifiers, such as "extremely" and "ultra."

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Configuration

jbloom/Gemma-2b-Residual-Stream-SAEs/gemma_2b_blocks.6.hook_resid_post_16384_anthropic_fast_lr

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

HuggingFaceFW/fineweb

Features

16,384

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_post

Architecture

standard

Context Size

1,024

Dataset

HuggingFaceFW/fineweb

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

<bos>

-2.24

ⓧ

-1.34

/***

-1.04

///**

-0.92

//});

-0.87

Vegeu

-0.79

 encomp

-0.79

//*/

-0.78

/**

-0.78

/**

-0.77

POSITIVE LOGITS

 extremely

0.90

 incredibly

0.88

 sappi

0.85

 riva

0.83

 montagna

0.81

 VERY

0.81

 Vergine

0.80

 mezza

0.76

Extremely

0.76

VERY

0.76

Activations Density 0.325%

superlatives and intensifiers, such as "extremely" and "ultra."

No Comments

No Known Activations