2026
HybridFlow: Resource-Adaptive Subtask Routing for Efficient Edge-Cloud LLM Inference
ICML 2026poster
Edge-cloud collaborative inference is crucial for LLM-powered edge devices, as on-device models often lack the required reasoning capability, while cloud-only inference can be costly and slow under strict latency and token/API budgets. However, existing edge-cloud collaboration methods typically rou…