Xiaomin Dong

SpecForge: A Flexible and Efficient Open-Source Training Framework for Speculative Decoding

Speculative decoding mitigates the memory-bound nature of LLM decoding by using a lightweight draft model to propose multiple tokens for parallel verification. However, its adoption has been limited by the lack of high-quality draft models and scalable training infrastructure. We introduce SpecForge…