Junchao Wang

DeepWeave: Accelerating Job Completion Time with Deep Reinforcement Learning-based Coflow Scheduling

To improve the processing efficiency of jobs in distributed computing, the concept of coflow is proposed. A coflow is a collection of flows that are semantically correlated in a multi-stage computation task. A job consists of multiple coflows and can be usually formulated as a Directed-Acyclic Graph…