2024
To Learn or Not to Learn: Replaced Token Detection for Learning the Meaning of Negation
COLING 2024main
State-of-the-art language models perform well on a variety of language tasks, but they continue to struggle with understanding negation cues in tasks like natural language inference (NLI). Inspired by Hossain et al. (2020), who show under-representation of negation in language model pretraining data…