2026
Improving Discrete Diffusion Unmasking Policies Beyond Explicit Reference Policies
ICLR 2026poster
Masked diffusion models (MDMs) have recently emerged as a novel framework for language modeling. MDMs generate sentences by iteratively denoising masked sequences, filling in [MASK] tokens step by step. Although MDMs support any-order sampling, performance is highly sensitive to the choice of which…