2026
From Bits to Rounds: Parallel Decoding with Exploration for Diffusion Language Models
ICML 2026poster
Diffusion Language Models (DLMs) have recently emerged as a strong alternative to autoregressive language models (AR-LMs), due to their comparable accuracy and faster inference speed via parallel decoding. However, standard DLM decoding strategies, which rely on unmasking only high-confidence tokens…