2025
CORAL: Learning Consistent Representations across Multi-step Training with Lighter Speculative Drafter
ACL 2025long
Speculative decoding is a powerful technique that accelerates Large Language Model (LLM) inference by leveraging a lightweight speculative draft model. However, existing designs suffers in performance due to misalignment between training and inference. Recent methods have tried to solve this issue b…