Title
Benchmarking Private Cloud Performance with User-Centric Metrics
Abstract
Cloud computing is a new paradigm for the delivery of IT services. It has enabled many promising opportunities for features that cannot be easily implemented in traditional IT environments, such as elastic scalability, self-service deployment, resiliency and recovery, and so forth. Benchmarking the cloud requires a well-defined set of cloud performance metrics that should be able to sensitively distinguish the capabilities of cloud systems that enable those features. One way of defining benchmark metrics is based on observations of the internal mechanisms in a cloud. For example, an elasticity evaluation may be based on measuring a resource provisioning interval in the cloud. However, a more meaningful evaluation should be based on user-centric metrics. In this article, we will introduce a set of performance metrics that can be directly measured, calculated and compared by the cloud users, including workload consumers and the users who deploy and manage the workload life cycles. We will also discuss ways to organize the user-centric metrics, with different emphasis, into a benchmark that represents different use cases.
Year
DOI
Venue
2014
10.1109/IC2E.2014.74
IC2E
Keywords
Field
DocType
cloud computing, performance metrics, benchmark, sla, use case, performance evaluation,use case,data privacy,user-centric metrics,resource provisioning interval,information technology,cloud performance metrics,workload life cycles,it service delivery,resource allocation,private cloud performance,performance evaluation,cloud computing,cloud benchmarking,performance metrics,sla,benchmark,elasticity,measurement,throughput,benchmark testing
Use case,Computer science,Workload,Provisioning,Database,Benchmarking,Cloud testing,User-centered design,Cloud computing,Scalability,Distributed computing
Conference
ISSN
Citations 
PageRank 
2373-3845
1
0.36
References 
Authors
11
5
Name
Order
Citations
PageRank
Bin Sun110.36
Brian Hall2495.94
Hu Wang310.36
Da Wei Zhang410.36
Kai Ding513816.64