Title
Affinity-aware Virtual Cluster Optimization for MapReduce Applications
Abstract
Infrastructure-as-a-Service clouds are becoming ubiquitous for provisioning virtual machines on demand. Cloud service providers expect to use least resources to deliver best services. As users frequently request virtual machines to build virtual clusters and run MapReduce-like jobs for big data processing, cloud service providers intend to place virtual machines closely to minimize network latency and subsequently reduce data movement cost. In this paper we focus on the virtual machine placement issue for provisioning virtual clusters with minimum network latency in clouds. We define distance as the latency between virtual machines and use it to measure the affinity of virtual clusters. Such metric of distance indicates the considerations of virtual machine placement and topology of physical nodes in clouds. Then we formulate our problem as the classical shortest distance problem and solve it by modeling to integer programming problem. A greedy virtual machine placement algorithm is designed to get a compact virtual cluster. Furthermore, an improved heuristic algorithm is also presented for achieving a global resource optimization. The simulation results verify our algorithms and the experiment results validate the improvement achieved by our approaches.
Year
DOI
Venue
2012
10.1109/CLUSTER.2012.13
CLUSTER
Keywords
Field
DocType
optimisation,cloud service provider,shortest distance,infrastructure-as-a-service clouds,resource optimization,pattern clustering,physical nodes topology,virtual machine,classical shortest distance problem,integer programming,data movement cost reduction,virtual machines,network topology,mapreduce applications,affinity-aware virtual cluster optimization,mapreduce programming model,resource allocation,cloud service providers,virtual machine placement,provisioning,ubiquitous computing,network latency,greedy algorithms,minimum network latency,virtual cluster,global resource optimization,cloud computing,compact virtual cluster,greedy virtual machine placement,virtual machine placement issue,integer programming problem,clustering algorithms,vectors,nickel,optimization,resource management
Virtual machine,Computer science,Temporal isolation among virtual machines,Heuristic (computer science),Real-time computing,Greedy algorithm,Provisioning,Network topology,Kernel virtual address space,Distributed computing,Cloud computing
Conference
ISSN
ISBN
Citations 
1552-5244
978-1-4673-2422-9
3
PageRank 
References 
Authors
0.39
20
7
Name
Order
Citations
PageRank
Cairong Yan1199.25
Ming Zhu241.45
Xin Yang315318.24
Ze Yu4353.74
Min Li5487.59
Youqun Shi6115.04
Xiaolin Li740537.36