Title
Design Exploration of IoT centric Neural Inference Accelerators.
Abstract
Neural networks have been successfully deployed in a variety of fields like computer vision, natural language processing, pattern recognition, etc. However most of their current deployments are suitable for cloud-based high-performance computing systems. As the computation of neural networks is not suited to traditional Von-Neumann CPU architectures, many novel hardware accelerator designs have been proposed in literature. In this paper we present the design of a novel, simplified and extensible neural inference engine for IoT systems. We present a detailed analysis on the impact of various design choices like technology node, computation block size, etc on overall performance of the neural inference engine. The paper demonstrates the first design instance of a power-optimized ELM neural network using ReLU activation. Comparison between learning performance of simulated hardware against the software model of the neural network shows a variation of ~ 1% in testing accuracy due to quantization. The accelerator compute blocks manage to achieve a performance per Watt of ~ 290 MSPS/W (Million samples per second per Watt) with a network structure of size: 8 x 32 x 2. Minimum energy of 40 pJ is acheived per sample processed for a block size of 16. Further, we show through simulations that an added power-saving of ~ 30 % can be acheived if SRAM based main memory is replaced with emerging STT-MRAM technology.
Year
DOI
Venue
2018
10.1145/3194554.3194614
ACM Great Lakes Symposium on VLSI
Keywords
Field
DocType
Neural networks, Accelerator, Neuromorphic computing, IoT, Inference engine, STT-MRAM
Block size,Computer science,Neuromorphic engineering,Real-time computing,Software,Inference engine,Hardware acceleration,Performance per watt,Artificial neural network,Computer engineering,Cloud computing
Conference
ISSN
ISBN
Citations 
1066-1395
978-1-4503-5724-1
3
PageRank 
References 
Authors
0.41
11
2
Name
Order
Citations
PageRank
vivek parmar185.42
manan suri2107.84