Name
Title | ||
|---|---|---|
Boosting Metrics for Cloud Services Evaluation -- The Last Mile of Using Benchmark Suites |
Abstract | ||
|---|---|---|
Benchmark suites are significant for evaluating various aspects of Cloud services from a holistic view. However, there is still a gap between using benchmark suites and achieving holistic impression of the evaluated Cloud services. Most Cloud service evaluation work intended to report individual benchmarking results without delivering summary measures. As a result, it could be still hard for customers with such evaluation reports to understand an evaluated Cloud service from a global perspective. Inspired by the boosting approaches to machine learning, we proposed the concept Boosting Metrics to represent all the potential approaches that are able to integrate a suite of benchmarking results. This paper introduces two types of preliminary boosting metrics, and demonstrates how the boosting metrics can be used to supplement primary measures of individual Cloud service features. In particular, boosting metrics can play a summary Response role in applying experimental design to Cloud services evaluation. Although the concept Boosting Metrics was refined based on our work in the Cloud Computing domain, we believe it can be easily adapted to the evaluation work of other computing paradigms. |
Year | Venue | Keywords |
|---|---|---|
2013 | Advanced Information Networking and Applications | benchmark suite,cloud services evaluation,cloud service,learning (artificial intelligence),software metrics,cloud computing domain,cloud service evaluation work,benchmark suites,boosting metrics,software performance evaluation,experimental design,individual cloud service feature,evaluation work,cloud service evaluation,boosting metric,evaluation report,benchmarking result,last mile,design of experiments,cloud computing,machine learning,holistic impression,measurement,boosting,radar,learning artificial intelligence,mathematical model,benchmark testing |
Field | DocType | Volume |
Data science,Suite,Last mile,Computer science,Boosting (machine learning),Software metric,Benchmarking,Cloud testing,Cloud computing | Conference | abs/1708.01414 |
Citations | PageRank | References |
1 | 0.36 | 19 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Zheng Li | 1 | 1 | 0.36 |
| Liam O'Brien | 2 | 367 | 30.01 |
| He Zhang | 3 | 817 | 65.63 |
| Rainbow Cai | 4 | 83 | 4.83 |