Title
Efficient Coflow Scheduling of Multi-Stage Jobs with Isolation Guarantee
Abstract
Coflow scheduling is critical for data-parallel computing performance in datacenters. Performance and isolation guarantee have become two major objectives for coflow scheduling. However, in the context of multi-stage jobs, existing coflow scheduling frameworks only focus on minimizing the average job completion time (JCT) while overlooking the isolation guarantee. To address this problem, in this paper we propose the first coflow scheduling scheme that aims to achieve both objectives. We show that our scheduler outperforms existing alternatives significantly in minimizing average JCT while guaranteeing that no job will be delayed beyond a constant time than its JCT in a fair scheme. Our evaluation results show that our scheduler reduces the average JCT by at least 86\% compared with state-of-the-art schedulers.
Year
DOI
Venue
2018
10.1109/BDCloud.2018.00053
2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom)
Keywords
Field
DocType
datacenter network, coflow scheduler, multi stage jobs
Computer science,Scheduling (computing),Multimedia,Distributed computing
Conference
ISSN
ISBN
Citations 
2158-9178
978-1-7281-1141-4
0
PageRank 
References 
Authors
0.34
0
5
Name
Order
Citations
PageRank
Zifan Liu100.68
Dai Haipeng241955.44
Bingchuan Tian3124.22
Wajid Rafique4266.39
Wanchun Dou587896.01