Name
Abstract | ||
|---|---|---|
Data centers are centralized facilities where computing and networking hardware are aggregated to handle large amounts of data and computation. In a data center, computing resources such as CPU and memory are usually managed by a resource manager. The resource manager accepts resource requests from users and allocates resources to their applications. A commonly known problem in resource management is that users often request more resources than their applications actually use. This leads to the degradation of overall resource utilization in a data center. This paper aims to improve resource utilization in data centers by predicting the required resource for each application. We designed and implemented a neural network model based on Long Short-Term Memory (LSTM) to predict more efficient resource allocation for a job based on historical data. Our model has two LSTM layers each of which learns the relationship between: (1) allocation and usage, and (2) CPU and memory. We used Googles cluster-usage trace, which contains a trace of resource allocation and usage for each job executed on a Google data center, to train our neural network. Googles cluster scheduler simulator was used to evaluate our proposed method. Our simulation indicated that the proposed method improved the CPU utilization and memory utilization by 10.71% and 47.36%, respectively, compared to a conventional resource manager. Moreover, we discovered that increasing the memory cell size of our LSTM model improves the accuracy of the prediction in return for longer training time. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/CLUSTER.2019.8891022 | 2019 IEEE International Conference on Cluster Computing (CLUSTER) |
Keywords | Field | DocType |
Long Short-Term Memory,Resource Utilization,Computing Resources,Resource Management | Resource management,Central processing unit,Computer science,Networking hardware,Resource allocation,Artificial neural network,Data center,Computation,Distributed computing,Memory cell | Conference |
ISSN | ISBN | Citations |
1552-5244 | 978-1-7281-4735-2 | 0 |
PageRank | References | Authors |
0.34 | 5 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Kundjanasith Thonglek | 1 | 0 | 2.03 |
| Kohei Ichikawa | 2 | 69 | 19.79 |
| Keichi Takahashi | 3 | 7 | 3.53 |
| Hajimu Iida | 4 | 286 | 31.95 |
| Chawanat Nakasan | 5 | 8 | 1.26 |