INDEX

Explanations

concepts related to political, legal, and social issues, especially regarding controversial topics like drug policy, healthcare, and civil rights

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 8-res_fs3072-jb

Configuration

jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8/blocks.8.hook_resid_pre_3072

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

3,072

Data Type

torch.float32

Hook Point

blocks.8.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 charm

-0.66

RAD

-0.65

 scatter

-0.64

 polyg

-0.64

nod

-0.63

 decomp

-0.63

 board

-0.62

 sacrific

-0.62

 Droid

-0.62

 beaut

-0.61

POSITIVE LOGITS

Â¢

1.01

¬

0.99

¡

0.96

¹

0.95

Ĵ

0.95

perhaps

0.95

especially

0.94

particularly

0.93

ı

0.93

£

0.92

Activations Density 1.075%

concepts related to political, legal, and social issues, especially regarding controversial topics like drug policy, healthcare, and civil rights

No Comments

No Known Activations