Carlos Aguirre

Bernice: A Multilingual Pre-trained Encoder for Twitter

The language of Twitter differs significantly from that of other domains commonly included in large language model training. While tweets are typically multilingual and contain informal language, including emoji and hashtags, most pre-trained language models for Twitter are either monolingual, adapt…