Title
Calibers: A bandwidth calendaring paradigm for science workflows.
Abstract
Many scientific workflows require large data transfers between distributed instrument facilities, storage and computing resources. To ensure that these resources are maximally utilized, R&E networks connecting these resources must ensure that an inherently unpredictable network behaves predictably. In practice, this amounts to the per-application over-provisioning of network resources in an attempt to guarantee that adequate throughput is provided to users. This often results in resource under-utilization over time. One promising solution is the use of deadlines and bandwidth calendaring. In this approach, “fair” resource allocation is replaced with deadline-based resource allocation. However, these approaches often suffer from issues in efficiently regulating resource allocation and failure modes. Therefore, our solution, Calibers, approaches bandwidth calendaring and deadline-awareness in a different way. Calibers uses shaping, metering, and pacing at the edge of the network and end-system to provide participating clients the ability to schedule bandwidth reservations without having to worry about network noise from non-participating clients. Calibers can also fail back to the fair resource allocation of underlying transport protocols if necessary. For example, if a non-participating flow somehow enters the core of the network, or a sudden network change causes the available bandwidth to be exceeded, the underlying transport protocol congestion avoidance implementation will be able to handle the congestion as it normally would. Furthermore, Calibers provides a novel simulation method and resource allocation algorithm.
Year
DOI
Venue
2018
10.1016/j.future.2018.07.030
Future Generation Computer Systems
Keywords
Field
DocType
Bandwidth calendaring,Flow pacing,Software defined network (SDN),TCP,Dynamic flow pacing,Simulation analysis,Traffic shaping
Pace,Control theory,Data transmission,Computer science,Heuristics,Bandwidth (signal processing),Resource allocation,Throughput,Workflow,Distributed computing
Journal
Volume
ISSN
Citations 
89
0167-739X
1
PageRank 
References 
Authors
0.36
13
9
Name
Order
Citations
PageRank
Fatma Alali122.07
Nathan Hanford2112.33
Eric Pouyoul38210.27
Raj Kettimuthu4223.76
Mariam Kiran512117.83
Ben Mack-Crane610.36
Brian Tierney710.36
Yatish Kumar810.36
Dipak Ghosal92848163.40