2025
Investigating Neurons and Heads in Transformer-based LLMs for Typographical Errors
EMNLP 2025
This paper investigates how LLMs encode inputs with typos. We hypothesize that specific neurons and attention heads recognize typos and fix them internally using local and global contexts. We introduce a method to identify typo neurons and typo heads that work actively when inputs contain typos. Our