OpenAI's Automated Interpretability from paper "Language models can explain neurons in language models". Modified by Johnny Lin to add new models/context windows.
The neuron detects tokens that appear at the start of the model/assistant's responses—especially the conversational acknowledgement "Okay" or other assistant-turn opening tokens.
descriptions of hotel or lodging amenities and room/property features, especially “with”-phrased facilities, bathrooms, electronics, and on-site services (often including measurements or availability/cost details).
key, high‑salience content words that carry a sentence’s main focus—especially emphasized terms, negations, and core subject nouns/verbs (e.g., “hard,” “no,” “over,” primary topic keywords).