Yimin Ou

Effective Integration of Text Diffusion and Pre-Trained Language Models with Linguistic Easy-First Schedule

Diffusion models have become a powerful generative modeling paradigm, achieving great success in continuous data patterns. However, the discrete nature of text data results in compatibility issues between continuous diffusion models (CDMs) and pre-trained language models (PLMs). That is, the perform…