INDEX

Explanations

references to document types and their accompanying attributes in a programming context

oai_token-act-pair · gpt-4o-mini

Triggered by @bot

New Auto-Interp

Configuration

google/gemma-scope-9b-pt-res/layer_20/width_131k/average_l0_114

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

monology/pile-uncopyrighted

Features

131,072

Data Type

float32

Hook Name

blocks.20.hook_resid_post

Hook Layer

Architecture

jumprelu

Context Size

1,024

Dataset

monology/pile-uncopyrighted

Activation Function

relu

Embeds

IFrame

Link

Negative Logits

 desemple

-0.55

 ſte

-0.53

 leaſt

-0.53

 Galloway

-0.52

 myſelf

-0.52

 stället

-0.50

 getName

-0.49

 calentamiento

-0.48

eastern

-0.48

pern

-0.47

POSITIVE LOGITS

Doc

1.04

doc

0.99

doc

0.99

DOC

0.98

Doc

0.96

 Docs

0.88

DOC

0.88

 Document

0.85

 docs

0.79

Docs

0.77

Activations Density 0.013%

references to document types and their accompanying attributes in a programming context

No Known Activations