INDEX

Explanations

mentions of different types of plants, especially focusing on their characteristics like growth forms, roots, and strains

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 8-res_fs3072-jb

Configuration

jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8/blocks.8.hook_resid_pre_3072

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

3,072

Data Type

torch.float32

Hook Point

blocks.8.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

DOS

-0.77

ourge

-0.72

xus

-0.72

cffffcc

-0.71

ß

-0.69

POST

-0.69

ROR

-0.68

Þ

-0.67

nels

-0.67

oice

-0.66

POSITIVE LOGITS

 gardens

1.04

 foliage

1.00

 trees

0.99

 plants

0.95

 vegetation

0.95

 vegetables

0.91

 planted

0.91

bud

0.90

 seeds

0.90

 garden

0.90

Activations Density 0.979%

mentions of different types of plants, especially focusing on their characteristics like growth forms, roots, and strains

No Comments

No Known Activations