Title
Survey of Machine Learning Accelerators
Abstract
New machine learning accelerators are being announced and released each month for a variety of applications from speech recognition, video object detection, assisted driving, and many data center applications. This paper updates the survey of of AI accelerators and processors from last year's IEEE-HPEC paper. This paper collects and summarizes the current accelerators that have been publicly announced with performance and power consumption numbers. The performance and power values are plotted on a scatter graph and a number of dimensions and observations from the trends on this plot are discussed and analyzed. For instance, there are interesting trends in the plot regarding power consumption, numerical precision, and inference versus training. This year, there are many more announced accelerators that are implemented with many more architectures and technologies from vector engines, dataflow engines, neuromorphic designs, flash-based analog memory processing, and photonic-based processing.
Year
DOI
Venue
2020
10.1109/HPEC43674.2020.9286149
2020 IEEE High Performance Extreme Computing Conference (HPEC)
Keywords
DocType
ISSN
Machine learning,GPU,TPU,dataflow,accelerator,embedded inference,computational performance
Conference
2377-6943
ISBN
Citations 
PageRank 
978-1-7281-9220-8
4
0.43
References 
Authors
22
6
Name
Order
Citations
PageRank
Albert Reuther133537.32
Peter Michaleas220120.93
Michael J. Jones311341927.21
Vijay Gadepally444950.53
Siddharth Samsi520124.09
Jeremy Kepner640.43