INDEX

Explanations

terms related to technology products and systems

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 8-res_fs24576-jb

Configuration

jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8/blocks.8.hook_resid_pre_24576

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.8.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

rahim

-0.74

minecraft

-0.73

itness

-0.65

ufact

-0.64

leneck

-0.64

stown

-0.63

raped

-0.62

 Huss

-0.62

enthal

-0.61

letcher

-0.61

POSITIVE LOGITS

Ĥİ

0.87

Ń·

0.79

ioxide

0.77

æĸ¹

0.74

Windows

0.73

0.72

Linux

0.72

WINDOWS

0.71

BSD

0.70

ħ

0.70

Activations Density 0.086%

terms related to technology products and systems

No Comments

No Known Activations