2024
Revisiting subword tokenization: A case study on affixal negation in large language models
NAACL 2024long
In this work, we measure the impact of affixal negation on modern English large language models (LLMs). In affixal negation, the negated meaning is expressed through a negative morpheme, which is potentially challenging for LLMs as their tokenizers are often not morphologically plausible. We conduct…