Title
ParaOpt: Automated Application Parameterization and Optimization for the Cloud
Abstract
The variety of instance types available on cloud platforms offers enormous flexibility to match the requirements of applications with available resources. However, selecting the most suitable instance type and configuring an application to optimally execute on that instance type can be complicated and time-consuming. For example, application parallelism flags must match available cores and problem sizes must be tuned to match available memory. As the search space of application configurations can be enormous, we propose an automated approach, called ParaOpt, to automatically explore and tune application configurations on arbitrary cloud instances. ParaOpt supports arbitrary applications, enables use of custom optimization methods, and can be configured with different optimization targets such as runtime and cost. We evaluate ParaOpt by optimizing genomics, molecular dynamics, and machine learning applications with four types of optimizers. We show with as few as 15 parameterized executions of an application, representing between 1.2%-26.7% of the search space, that ParaOpt is able to identify the optimal configuration in 32.7% of experiments and a near-optimal configuration in 83.2% of cases. As a result of using near-optimal configurations, ParaOpt reduces overall execution time by up to 85.8% when compared with using the default configuration.
Year
DOI
Venue
2019
10.1109/CloudCom.2019.00045
2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom)
Keywords
Field
DocType
parameter optimization,cloud profiling,optimal configuration
Parameterized complexity,Parametrization,Computer science,Execution time,Cloud computing,Distributed computing
Conference
ISSN
ISBN
Citations 
2330-2194
978-1-7281-5012-3
0
PageRank 
References 
Authors
0.34
13
10
Name
Order
Citations
PageRank
Chaofeng Wu100.34
Foster Ian2229382663.24
Ted Summer300.34
Zhuozhao Li400.34
Anna Woodard5142.72
Ryan Chard600.34
Matt Baughman762.80
Yadu Babuji8253.02
Kyle Chard951556.70
Jason Pitt1000.34