2025
LLäMmlein: Transparent, Compact and Competitive German-Only Language Models from Scratch
ACL 2025long
We transparently create two German-only decoder models, LLäMmlein 120M and 1B, from scratch and publish them, along with the training data, for the (German) NLP research community to use. The model training involved several key steps, including data preprocessing/filtering, the creation of a German…