Title
Efficient Matrix Multiplication: The Sparse Power-of-2 Factorization
Abstract
We present an algorithm to reduce the computational effort for the multiplication of a given matrix with an unknown column vector. The algorithm decomposes the given matrix into a product of matrices whose entries are either zero or integer powers of two utilizing the principles of sparse recovery. While classical low resolution quantization achieves an accuracy of 6 dB per bit, our method can achieve many times more than that for large matrices. Numerical and analytical evidence suggests that the improvement actually grows unboundedly with matrix size. Due to sparsity, the algorithm even allows for quantization levels below 1 bit per matrix entry while achieving highly accurate approximations for large matrices. Applications include, but are not limited to, neural networks, as well as fully digital beam-forming for massive MIMO and millimeter wave applications.
Year
DOI
Venue
2020
10.1109/ITA50056.2020.9244952
2020 Information Theory and Applications Workshop (ITA)
Keywords
DocType
ISSN
matrix size,quantization levels,matrix entry,efficient matrix multiplication,sparse power-of-2 factorization,computational effort,given matrix,unknown column vector,zero powers,sparse recovery,classical low resolution quantization,neural networks,fully digital beamforming,massive MIMO,millimeter wave applications
Conference
2641-8150
ISBN
Citations 
PageRank 
978-1-7281-8825-6
0
0.34
References 
Authors
6
3
Name
Order
Citations
PageRank
R. Muller11206124.92
Gäde Bernhard200.34
Ali Bereyhi33714.09