INDEX

Explanations

the beginning of a document

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Configuration

jbloom/Gemma-2b-IT-Residual-Stream-SAEs/gemma_2b_it_blocks.12.hook_resid_post_16384

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

HuggingFaceFW/fineweb

Features

16,384

Data Type

float32

Hook Name

blocks.12.hook_resid_post

Hook Layer

Architecture

standard

Context Size

1,024

Dataset

Skylion007/openwebtext

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 reluct

-5.40

 shenan

-5.32

 disagre

-5.22

 unspeak

-5.19

 increa

-5.11

 impra

-5.09

 indestru

-4.91

 maneu

-4.82

 apprehen

-4.81

 depic

-4.80

POSITIVE LOGITS

<bos>

13.78

 betweenstory

2.52

 Paglinawan

2.46

Autoritní

2.42

expandindo

2.41

GEBURTSDATUM

2.40

 Italijani

2.32

 Walkover

2.26

Panamoan

2.18

 '\\;'

2.16

Activations Density 0.088%

the beginning of a document

No Comments

No Known Activations