Marek Kadlcik

Soft Alignment Objectives for Robust Adaptation of Language Generation

Domain adaptation allows generative language models to address specific flaws caused by the domain shift of their application. However, the traditional adaptation by further training on in-domain data rapidly weakens the model’s ability to generalize to other domains, making the open-ended deploymen…