Title
Photonic Processor for Fully Discretized Neural Networks
Abstract
Machine learning is now moving towards, and will become prevalent in, fog-computing and real-time computing environments. To this end, much machine-learning-at-the-edge research has focused on efficient neural network architectures, giving rise to efficient approximations of fixed-point neural networks, called discretized neural networks. While higher performing than their fixed and floating-point counterparts, discretized neural networks still have an existing bottleneck at the neuron's accumulation of products, called the popcount. This bottleneck sets an upper bound on performance regardless of neural network architecture. We address the popcount bottleneck by introducing a photonic discretized neural network processor. This processor minimizes the popcount bottleneck, thereby maximizing neural network computational throughput. Additionally, it offers potential for performance enhancement through simultaneous convolution operations enabled by wavelength division multiplexing. We show that the photonic architecture is capable of increasing performance by 700% and 100% when compared to state-of-the-art digital and analog architectures, respectively.
Year
DOI
Venue
2019
10.1109/ASAP.2019.00-41
2019 IEEE 30th International Conference on Application-specific Systems, Architectures and Processors (ASAP)
Keywords
Field
DocType
Photonic integrated circuits, Neural network hardware, Parallel architectures, Analog computers
Wavelength-division multiplexing,Bottleneck,Upper and lower bounds,Convolution,Computer science,Parallel computing,Photonic integrated circuit,Throughput,Analog computer,Artificial neural network
Conference
Volume
ISSN
ISBN
2160-052X
2160-0511
978-1-7281-1602-0
Citations 
PageRank 
References 
0
0.34
13
Authors
5
Name
Order
Citations
PageRank
Jeff Anderson1234.05
Shuai Sun211.76
Yousra Alkabani323122.79
J Sorger4789.98
Tarek El-Ghazawi542744.88