2025
Adaptive Draft-Verification for Efficient Large Language Model Decoding
AAAI 2025technical
Large language model (LLM) decoding involves generating a sequence of tokens based on a given context, where each token is predicted one at a time using the model's learned probabilities. The typical autoregressive decoding method requires a separate forward pass through the model for each token g…