Title
Catching the response time tail in the cloud
Abstract
As modern service systems are pressured to provide competitive prices via cost-effective capacity planning, especially in the paradigm of cloud computing, service level agreements (SLAs) end up becoming ever more sophisticated, i.e., fulfilling targets of different percentiles of response times. However, it is no mean feat to predict even the average response times of real systems, or even abstracted queueing systems that typically simplify system details, and it gets even more complicated when trying to manage SLAs defined by various percentiles of response times. To efficiently capture these different percentiles, we first develop a novel and autonomic methodology — termed Burst Based Simulation, which combines burst profiling on real systems with complex, state-dependent simulations. Moreover, based on our methodology, we construct an analysis on SLA management: the prediction of SLA violations given a certain request pattern. We evaluate our approach on two types of service systems, virtualized and bare-metal, with wide ranges of SLAs and traffic loads. Our evaluation results show that our methodology is able to achieve an average error below 15% when predicting different response time percentiles, and accurately capture SLA violations.
Year
DOI
Venue
2015
10.1109/INM.2015.7140339
2015 IFIP/IEEE International Symposium on Integrated Network Management (IM)
Keywords
Field
DocType
response time tail,cloud computing,service level agreements,abstracted queueing systems,burst based simulation,burst profiling,SLA violation prediction,virtualized service systems,bare-metal service systems
Service level,Type of service,Profiling (computer programming),Computer science,Server,Response time,Computer network,Real-time computing,Capacity planning,Queueing theory,Distributed computing,Cloud computing
Conference
ISSN
Citations 
PageRank 
1573-0077
0
0.34
References 
Authors
18
4
Name
Order
Citations
PageRank
Sebastiano Spicuglia1141.94
Mathias Bjorkqvist2968.85
Lydia Y. Chen343252.24
Walter Binder4107792.58