The neuron is spotting unusually rare or out‐of‐vocabulary tokens (i.e. low‐frequency, “odd” words that don’t occur in most inputs).