This neuron isn’t looking for any semantic content at all but for where a token sits in the context window – it peaks on the earliest tokens and then steadily decays as you move further on in the sequence.