Title
Fine-grained DRAM: energy-efficient DRAM for extreme bandwidth systems.
Abstract
Future GPUs and other high-performance throughput processors will require multiple TB/s of bandwidth to DRAM. Satisfying this bandwidth demand within an acceptable energy budget is a challenge in these extreme bandwidth memory systems. We propose a new high-bandwidth DRAM architecture, Fine-Grained DRAM (FGDRAM), which improves bandwidth by 4× and improves the energy efficiency of DRAM by 2× relative to the highest-bandwidth, most energy-efficient contemporary DRAM, High Bandwidth Memory (HBM2). These benefits are in large measure achieved by partitioning the DRAM die into many independent units, called grains, each of which has a local, adjacent I/O. This approach unlocks the bandwidth of all the banks in the DRAM to be used simultaneously, eliminating shared buses interconnecting various banks. Furthermore, the on-DRAM data movement energy is significantly reduced due to the much shorter wiring distance between the cell array and the local I/O. This FGDRAM architecture readily lends itself to leveraging existing techniques to reducing the effective DRAM row size in an area efficient manner, reducing wasteful row activate energy in applications with low locality. In addition, when FGDRAM is paired with a memory controller optimized to exploit the additional concurrency provided by the independent grains, it improves GPU system performance by 19% over an iso-bandwidth and iso-capacity future HBM baseline. Thus, this energy-efficient, high-bandwidth FGDRAM architecture addresses the needs of future extreme-bandwidth memory systems.
Year
DOI
Venue
2017
10.1145/3123939.3124545
MICRO-50: The 50th Annual IEEE/ACM International Symposium on Microarchitecture Cambridge Massachusetts October, 2017
Keywords
Field
DocType
DRAM, Energy-Efficiency, High Bandwidth, GPU
Dram,Dynamic random-access memory,Efficient energy use,Computer science,Parallel computing,High Bandwidth Memory,Universal memory,Real-time computing,Bandwidth (signal processing),CAS latency,Memory controller,Embedded system
Conference
ISSN
ISBN
Citations 
1072-4451
978-1-4503-4952-9
14
PageRank 
References 
Authors
0.54
10
7
Name
Order
Citations
PageRank
Mike O'Connor11555.03
Niladrish Chatterjee226711.53
Dong-Hyuk Lee3125448.26
John M. Wilson4172.33
Aditya Agrawal554634.80
Stephen W. Keckler63404201.71
William J. Dally7117821460.14