← Search

Coleman Hooper

2 accepted papers

2026

LoSA: Locality Aware Sparse Attention in Diffusion Language Models

ICML 2026poster

Block-wise diffusion language models (DLMs) generate multiple tokens in parallel, offering a promising alternative to autoregressive decoding. However, their inference efficiency remains bottlenecked by memory-bound attention in long-context scenarios. Naïve sparse attention is ineffective for DLMs …

Cited by 0SourceScholar
2026

Residual Context Diffusion Language Models

ICML 2026poster

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to purely autoregressive language models because they can decode multiple tokens in parallel. However, state-of-the-art block-wise dLLMs rely on a ``remasking" mechanism that decodes only the most confident tokens and di…

Cited by 0SourceScholar