Marta Sartor

Beyond the Spelling Miracle: Investigating Substring Awareness in Character-Blind Language Models

Correctly identifying characters and substrings of words should be a basic but essential ability of any Language Model that aims to proficiently understand and produce language. Despite so, the majority of Pre-trained Language Models (PLMs) are “character-blind” and struggle in spelling tasks, altho…