Title
On a Catalogue of Metrics for Evaluating Commercial Cloud Services
Abstract
Given the continually increasing amount of commercial Cloud services in the market, evaluation of different services plays a significant role in cost-benefit analysis or decision making for choosing Cloud Computing. In particular, employing suitable metrics is essential in evaluation implementations. However, to the best of our knowledge, there is not any systematic discussion about metrics for evaluating Cloud services. By using the method of Systematic Literature Review (SLR), we have collected the de facto metrics adopted in the existing Cloud services evaluation work. The collected metrics were arranged following different Cloud service features to be evaluated, which essentially constructed an evaluation metrics catalogue, as shown in this paper. This metrics catalogue can be used to facilitate the future practice and research in the area of Cloud services evaluation. Moreover, considering metrics selection is a prerequisite of benchmark selection in evaluation implementations, this work also supplements the existing research in benchmarking the commercial Cloud services.
Year
DOI
Venue
2012
10.1109/Grid.2012.15
GRID '12 Proceedings of the 2012 ACM/IEEE 13th International Conference on Grid Computing
Keywords
DocType
Volume
evaluation implementation,commercial cloud service,cloud service,metrics catalogue,different cloud service feature,commercial cloud services,cloud services evaluation,cloud computing,existing cloud services evaluation,evaluation metrics catalogue,metrics selection,availability,throughput,benchmark testing,scalability,software metrics
Conference
abs/1302.1954
Citations 
PageRank 
References 
42
1.53
44
Authors
4
Name
Order
Citations
PageRank
Zheng Li11159.88
Liam O'Brien236730.01
He Zhang381765.63
Rainbow Cai4834.83