Refael Greenfeld

AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level

Large Pre-trained Language Models (PLMs) have become ubiquitous in the development of language understanding technology and lie at the heart of many artificial intelligence advances. While advances reported for English using PLMs are unprecedented, reported advances using PLMs for Hebrew are few and…