2026
Beyond Masks: Efficient, Flexible Diffusion Language Models via Deletion-Insertion Processes
ICLR 2026poster
While Masked Diffusion Language Models (MDLMs) relying on token masking and unmasking have shown promise in language modeling, their computational efficiency and generation flexibility remain constrained by the masking paradigm. In this paper, we propose Deletion-Insertion Diffusion language models…