INDEX

Explanations

sex-specific terms, particularly related to both genders

oai_token-act-pair · gpt-3.5-turbo

references to gender and sex-related topics

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 0-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.0.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.0.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 Chapter

-0.66

 Typhoon

-0.62

 anti

-0.61

 rolling

-0.61

 Article

-0.58

 Section

-0.58

Ley

-0.57

roll

-0.57

 Illust

-0.56

 Operation

-0.56

POSITIVE LOGITS

 sexes

3.18

 genders

2.48

 Americas

2.06

 Clintons

1.47

 sciences

1.33

 extremes

1.24

 halves

1.14

ospels

1.10

 spouses

1.05

 faiths

1.03

Activations Density 0.039%

sex-specific terms, particularly related to both genders

references to gender and sex-related topics

No Comments

No Known Activations