2023
Understanding the Role of Input Token Characters in Language Models: How Does Information Loss Affect Performance?
EMNLP 2023long main
Understanding how and what pre-trained language models (PLMs) learn about language is an open challenge in natural language processing. Previous work has focused on identifying whether they capture semantic and syntactic information, and how the data or the pre-training objective affects their perfo…