The neuron fires strongly only on unusually rare or out-of-vocabulary tokens (e.g. odd proper names or punctuation-heavy tokens) that produce abnormally large activations.