Title
Rapier: Integrating routing and scheduling for coflow-aware data center networks
Abstract
In the data flow models of today's data center applications such as MapReduce, Spark and Dryad, multiple flows can comprise a coflow group semantically. Only completing all flows in a coflow is meaningful to an application. To optimize application performance, routing and scheduling must be jointly considered at the level of a coflow rather than individual flows. However, prior solutions have significant limitation: they only consider scheduling, which is insufficient. To this end, we present Rapier, a coflow-aware network optimization framework that seamlessly integrates routing and scheduling for better application performance. Using a small-scale testbed implementation and large-scale simulations, we demonstrate that Rapier significantly reduces the average coflow completion time (CCT) by up to 79.30% compared to the state-of-the-art scheduling-only solution, and it is readily implementable with existing commodity switches.
Year
DOI
Venue
2015
10.1109/INFOCOM.2015.7218408
2015 IEEE Conference on Computer Communications (INFOCOM)
Keywords
Field
DocType
coflow-aware network optimization framework,RAPIER,coflow-aware data center networks
Spark (mathematics),Fair-share scheduling,Computer science,Scheduling (computing),Computer network,Testbed,Two-level scheduling,Dynamic priority scheduling,Data center,Data flow diagram,Distributed computing
Conference
ISSN
Citations 
PageRank 
0743-166X
32
1.16
References 
Authors
24
9
Name
Order
Citations
PageRank
Yangming Zhao112412.45
Kai Chen274459.02
Wei Bai 0001319013.46
Minlan Yu41855107.25
Chen Tian5111984.93
Yanhui Geng6888.65
zhang7674.46
Dan Li8144188.77
Sheng Wang924033.31