LeiQuan Zheng

LEAP: Zone-Aware MCTS for LLM Self-Speculative Decoding

Self-speculative decoding accelerates LLM inference by using a lightweight draft model for generation and a target model for verification, where the draft model is constructed by a subset of the target model’s layers, and the key challenge lies in layer configuration strategies. To address this chal…