Zhanbo Jin

E$^2$-SCI: Elastic Edge-Cloud Speculative Decoding via Credit Inertia

In edge-cloud environments, efficiency of speculative decoding is heavily constrained by uplink transmission and cloud-side verification. In this work, we identify a phenomenon we term credit inertia, where acceptance rates of adjacent token windows exhibit strong temporal consistency. Tokens follow