Abstract | ||
---|---|---|
In a power-aware scheduling system, power models are leveraged as the basis of estimating the effect of scheduling tasks. Previous studies showed that power consumption of servers is a non-linear function of resource usage, and a single set of parameters in one model can't accurately estimate power consumption at different usage levels. Gaussian Mixture Model (GMM) is a unsupervised machine learning model, which contains multiple GMM clusters. These clusters can be used to co-relate power consumption with resource features at different usage levels. In this paper we further adapt GMM for power estimation in a distributed computing cluster. We use basic OS-reported resource features (CPU utilization, memory utilization etc.) of a server in our GMM, and this makes operators easily monitor and control the state of the server once scheduling decision is made. In addition, our GMM uses conditional probability to obtain fine-grained regression. We train the model using full features, which has the higher accuracy comparing with that only using CPU or part of features. In the end, we evaluate the power models in terms of not only accuracy but also usability. Compare to other linear or non-linear models, GMM has the highest accuracy but requires the longest training time. |
Year | DOI | Venue |
---|---|---|
2017 | 10.1109/CANDAR.2017.44 | 2017 Fifth International Symposium on Computing and Networking (CANDAR) |
Keywords | Field | DocType |
Power Model,Workload Characterization,Power~Estimation,Machine Learning | Data mining,Conditional probability,Scheduling (computing),CPU time,Computer science,Usability,Server,Unsupervised learning,Operator (computer programming),Mixture model | Conference |
ISSN | ISBN | Citations |
2379-1888 | 978-1-5386-2088-5 | 0 |
PageRank | References | Authors |
0.34 | 15 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Hao Zhu | 1 | 1 | 2.03 |
Huadong Dai | 2 | 4 | 2.77 |
Shazhou Yang | 3 | 0 | 0.68 |
Yuejin Yan | 4 | 0 | 0.34 |
Bin Lin | 5 | 27 | 3.21 |