Yue Cai

d$^2$Cache: Accelerating Diffusion-Based LLMs via Dual Adaptive Caching

Diffusion-based large language models (dLLMs), despite their promising performance, still suffer from inferior inference efficiency. This is because dLLMs rely on bidirectional attention and cannot directly benefit from the standard key-value (KV) cache as autoregressive models (ARMs) do. To tackle…