Title
PM3: Power Modeling and Power Management for Processing-in-Memory
Abstract
Processing-in-Memory (PIM) has been proposed as a solution to accelerate data-intensive applications, such as real-time Big Data processing and neural networks. The acceleration of data processing using a PIM relies on its high internal memory bandwidth, which always comes with the cost of high power consumption. Consequently, it is important to have a comprehensive quantitative study of the power modeling and power management for such PIM architectures. In this work, we first model the relationship between the power consumption and the internal bandwidth of PIM. This model not only provides a guidance for PIM designs but also demonstrates the potential of power management via bandwidth throttling. Based on bandwidth throttling, we propose three techniques, Power-Aware Subtask Throttling (PAST), Processing Unit Boost (PUB), and Power Sprinting (PS), to improve the energy efficiency and performance. In order to demonstrate the universality of the proposed methods, we applied them to two kinds of popular PIM designs. Evaluations show that the performance of PIM can be further improved if the power consumption is carefully controlled. Targeting at the same performance, the peak power consumption of HMC-based PIM can be reduced from 20W to 15W. The proposed power management schemes improve the speedup of prior RRAM-based PIM from 69 × to 273 ×, after pushing the power usage from about 1W to 10W safely. The model also shows that emerging RRAM is more suitable for large processing-in-memory designs, due to its low power cost to store the data.
Year
DOI
Venue
2018
10.1109/HPCA.2018.00054
2018 IEEE International Symposium on High Performance Computer Architecture (HPCA)
Keywords
Field
DocType
Processing in Memory,Non volatile Memory,Power Management
Power management,Data processing,Efficient energy use,Computer science,Real-time computing,Electronic engineering,Memory management,Bandwidth (signal processing),Non-volatile memory,Bandwidth throttling,Speedup
Conference
ISSN
ISBN
Citations 
1530-0897
978-1-5386-3660-2
0
PageRank 
References 
Authors
0.34
33
3
Name
Order
Citations
PageRank
Chao Zhang142338.17
Tong Meng200.34
Guangyu Sun31920111.55