Title
Block Randomized Singular Value Decomposition On Gpus
Abstract
Fast computation of singular value decomposition (SVD) is of great interest in various machine learning tasks. Recently, SVD methods based on randomized linear algebra have shown significant speedup in this regime. For processing large-scale data, computing systems with accelerators like GPUs have become the mainstream approach. In those systems, access to the input data dominates the overall process time; therefore, it is needed to design an out-of-core algorithm to dispatch the computation into accelerators. This paper proposes an accurate two-pass randomized SVD, named block randomized SVD (BRSVD), designed for matrices with a slow-decay singular spectrum that is often observed in image data. BRSVD fully utilizes the power of modern computing system architectures and efficiently processes large-scale data in a parallel and out-of-core fashion. Our experiments show that BRSVD effectively moves the performance bottleneck from data transfer to computation, so that outperforms existing randomized SVD methods in terms of speed with retaining similar accuracy.
Year
DOI
Venue
2020
10.1587/transinf.2019EDP7265
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS
Keywords
DocType
Volume
randomized singular value decomposition, GPU
Journal
E103D
Issue
ISSN
Citations 
9
1745-1361
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Yuechao Lu110.70
Yasuyuki Matsushita22046113.32
Fumihiko Ino331738.63