Name
Abstract | ||
|---|---|---|
Neural networks have been widely applied to various research and production fields. However, most recent research is focused on the establishment and selection of a specific neural network model. Less attention is paid to their system overhead despite of their massive computing and storage resource demand. This research focuses on a relatively new research direction that models the system-level memory and cache demand of neural networks. We utilize a neural network to learn and predict hit ratio curve and memory footprint of neural networks with their hyper-parameters as input. The prediction result is used to drive cache partitioning and memory partitioning to optimize co-execution of multiple neural networks. To demonstrate effectiveness of our approach, we model four common networks, BP neural network, convolutional neural network, recurrent neural network, and autoencoder. We investigate the influence of hyper-parameters of each model on the last level cache and memory demand. We resort to the BP algorithm as the learning tool to predict last level cache hit ratio curve and memory usage. Our experimental results show that cache and memory allocation schemes guided by our prediction optimize for a wide range of performance targets. © 2018 IEEE. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/BDCloud.2018.00142 | Proceedings - 16th IEEE International Symposium on Parallel and Distributed Processing with Applications, 17th IEEE International Conference on Ubiquitous Computing and Communications, 8th IEEE International Conference on Big Data and Cloud Computing, 11th IEEE International Conference on Social Computing and Networking and 8th IEEE International Conference on Sustainable Computing and Communications, ISPA/IUCC/BDCloud/SocialCom/SustainCom 2018 |
Keywords | Field | DocType |
Cache,Memory,Neural network model | Resource management,Autoencoder,Convolutional neural network,Computer science,Cache,Recurrent neural network,Human–computer interaction,Memory management,Artificial intelligence,Memory footprint,Artificial neural network | Conference |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Sai Sha | 1 | 1 | 2.05 |
| Yingwei Luo | 2 | 315 | 41.30 |
| Zhenlin Wang | 3 | 150 | 15.89 |
| Xiaolin Wang | 4 | 17 | 6.26 |