2024
Evolutionary Contrastive Distillation for Language Model Alignment
EMNLP 2024finding
The ability of large language models (LLMs) to execute complex instructions is essential for their real-world applications. However, several recent studies indicate that LLMs struggle with challenging instructions. In this paper, we propose Evolutionary Contrastive Distillation (ECD), a novel method…