Seonggeun Kim

WAVE: Window-Aware Vocabulary-Efficient Early-Exit for Training-Free LLM Acceleration

Large language models (LLMs) incur substantial inference latency due to autoregressive decoding, in which each token requires a full forward pass through all transformer layers. Early-exit methods that terminate computation at intermediate layers offer a promising remedy, yet existing approaches suf…