Title
Online Scheduling of Spark Workloads with Mesos using Different Fair Allocation Algorithms.
Abstract
In the following, we present example illustrative and experimental results comparing fair schedulers allocating resources from multiple servers to distributed application frameworks. Resources are allocated so that at least one resource is exhausted in every server. Schedulers considered include DRF (DRFH) and Best-Fit DRF (BF-DRF), TSF, and PS-DSF. We also consider server selection under Randomized Round Robin (RRR) and based on their residual (unreserved) resources. In the following, we consider cases with frameworks of equal priority and without server-preference constraints. We first give typical results of a illustrative numerical study and then give typical results of a study involving Spark workloads on Mesos which we have modified and open-sourced to prototype different schedulers.
Year
Venue
Field
2018
arXiv: Performance
Residual,Spark (mathematics),Scheduling (computing),Computer science,Server,Parallel computing
DocType
Volume
Citations 
Journal
abs/1803.00922
1
PageRank 
References 
Authors
0.35
0
6
Name
Order
Citations
PageRank
Yuquan Shan195.03
Aman Jain221.73
George Kesidis329338.77
Bhuvan Urgaonkar42309158.10
Jalal Khamse-Ashari511.03
Ioannis Lambadaris650278.37