INDEX

Explanations

countries, mostly in Central America, with a particular focus on Guatemala and Honduras

oai_token-act-pair · gpt-3.5-turbo

mentions of Central American countries

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 0-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.0.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.0.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

dra

-0.83

 Saber

-0.65

stro

-0.65

 Crow

-0.64

math

-0.61

Wolf

-0.61

 shar

-0.60

die

-0.60

elight

-0.58

nt

-0.58

POSITIVE LOGITS

 Guatemala

3.09

 Honduras

3.03

 Nicaragua

2.97

 Haiti

2.57

 Bolivia

2.49

 Peru

2.43

 Ecuador

2.36

 Panama

2.36

 Cambodia

2.34

 Colombia

2.22

Activations Density 0.028%

countries, mostly in Central America, with a particular focus on Guatemala and Honduras

mentions of Central American countries

No Comments

No Known Activations