Yuan Shao

UniPCM: Universal Pre-trained Conversation Model with Task-aware Automatic Prompt

Recent researches have shown that multi-task instruction tuning after pre-training greatly improves the model’s robustness and transfer ability, which is crucial for building a high-quality dialog system. However, most previous works on multi-task instruction tuning rely heavily on human-defined inp…