Title
Join the Best Queue: Reducing Performance Variability in Heterogeneous Systems
Abstract
Cloud computing is a well known paradigm, featuring on-demand provisioning of virtual machines (VMs) with different sizes and images. Systems deployed in the cloud can thus be heterogeneous, i.e., using multiple different types of VM instances. The immediate performance challenge arises: how to best use heterogeneous VM instances such that the experienced performance, i.e., response times, on different VMs are similar. In this paper, we first show to what extent deployed systems are heterogeneous in clouds by collecting data from operational data centers. We also show that response times suffer from high variance across replicas hosted on different VMs. We develop a novel plug&play workload controller, Join-the-Best-Queue (JBQ), which aims to reduce the variance and higher percentile of response-times in heterogeneous environments. With the aid of a testbed hosting part of wikipedia in an operational cloud, we show that JBQ can significantly reduce performance variability across different VMs, compared to prevailing load distributing policies in the Apache web server.
Year
DOI
Venue
2013
10.1109/CLOUD.2013.89
IEEE CLOUD
Keywords
Field
DocType
wikipedia,operational cloud,heterogeneous environment,response time,ondemand provisioning,apache web server,virtual machine,jbq,heterogeneous systems,different vms,multiple different type,virtual machines,heterogeneous system,queueing theory,heterogeneous vm instance,load control algorithms,best queue,different size,performance variability,join-the-best-queue,experienced performance,cloud computing,immediate performance challenge
Virtual machine,Workload,Computer science,Queue,Testbed,Real-time computing,Provisioning,Queueing theory,Web server,Cloud computing,Distributed computing
Conference
ISSN
ISBN
Citations 
2159-6182
978-0-7695-5028-2
6
PageRank 
References 
Authors
0.44
14
3
Name
Order
Citations
PageRank
Sebastiano Spicuglia1141.94
Lydia Y. Chen243252.24
Walter Binder3107792.58