Title
Towards shorter task completion time in datacenter networks.
Abstract
Datacenters are now used as the underlying infrastructure of many modern commercial operations, powering both large Internet services and a growing number of data-intensive scientific applications. The tasks in these applications always consist of rich and complex flows which require different resources at different time slots. The existing data center scheduling frameworks are however base on either task or flow level metrics. This simplifies the design and deployment, but hardly unleashes the potentials of obtaining low task completion time for delay sensitive applications. In this paper, we show that the performance (e.g., tail and average task completion time) of existing flow-aware and task-aware network scheduling is far from being optimal. To address such a problem, we carefully examine the possibility to consider both task and flow level metrics together and present the design of TAFA (Task-Aware and Flow-Aware) in data center networks. This approach seamlessly combines the existing flow and task metrics together while successfully avoids their problems as flow-isolation and flow indiscrimination. The evaluation result shows that TAFA can obtain a near-optimal performance and reduce over 35% task completion time for the existing data center systems.
Year
DOI
Venue
2015
10.1109/PCCC.2015.7410278
IPCCC
Keywords
Field
DocType
task completion time reduction,near-optimal performance,flow indiscrimination,flow isolation,task-aware and flow-aware design,TAFA design,task level metrics,flow level metrics,task-aware network scheduling,flow-aware network scheduling,delay sensitive applications,data center scheduling frameworks,data-intensive scientific applications,Internet services,datacenter networks
Software deployment,Computer science,Scheduling (computing),Computer network,Real-time computing,Task completion,Data center,The Internet,Distributed computing
Conference
ISSN
Citations 
PageRank 
1097-2641
0
0.34
References 
Authors
15
4
Name
Order
Citations
PageRank
Yuchao Zhang15612.88
Ke Xu21392171.73
Haiyang Wang357373.18
Meng Shen427134.80