2026
AMS-KV: Adaptive KV Caching in Multi-Scale Visual Autoregressive Transformers
AAAI 2026technical
Visual autoregressive modeling (VAR) via next-scale prediction has emerged as a scalable image generation paradigm. While Key and Value (KV) caching in large language models (LLMs) has been extensively studied, next-scale prediction presents unique challenges, and KV caching design for next-scale ba