INDEX

Explanations

the plural form of nouns

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Configuration

ckkissane/attn-saes-gpt2-small-all-layers/gpt2-small_L9_Hcat_z_lr1.20e-03_l11.20e+00_ds24576_bs4096_dc1.00e-06_rsanthropic_rie25000_nr4_v9.pt

Prompts (Dashboard)

36,864 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

float32

Hook Name

blocks.9.attn.hook_z

Hook Layer

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Head Attr Weights

0:0.08

1:0.07

2:0.08

3:0.07

4:0.07

5:0.08

6:0.07

7:0.08

8:0.08

9:0.08

10:0.08

11:0.09

Negative Logits

htar

-3.17

 Babe

-2.99

hma

-2.75

galitarian

-2.74

 monarchy

-2.65

peat

-2.65

enment

-2.65

MpServer

-2.64

 Debt

-2.63

 Auckland

-2.61

POSITIVE LOGITS

 cancell

2.96

oute

2.88

 inaccur

2.85

Exception

2.73

 responders

2.61

 restroom

2.56

 inaccurate

2.51

 summ

2.50

 crews

2.49

 insensitive

2.49

Activations Density 0.000%

the plural form of nouns

No Comments

No Known Activations