Name
Title | ||
|---|---|---|
GPUSGD: A GPU-accelerated stochastic gradient descent algorithm for matrix factorization. |
Abstract | ||
|---|---|---|
Matrix factorization is one of the leading techniques for many applications such as social network-based recommendation systems. As of today, many parallel stochastic gradient descent SGD methods have been proposed to address the matrix factorization issue on shared-memory multi-core systems and distributed systems. However, these methods cannot be improved significantly on graphics processing unit GPU because the serious over-writing problem and thread divergence may occur. The fundamental reason for such undesired results is that GPU is a parallel single instruction multiple data device, which only can greatly improve the applications with fine-grained parallelism. In this paper, we propose an efficient GPU algorithm, named GPUSGD, to solve the matrix factorization problem based on SGD method. The major advantage of the proposed GPUSGD is that such method not only can handle the over-writing problem but also can avoid the performance loss caused by the thread divergence. The experimental results show that GPUSGD performs much better in accelerating the matrix factorization compared with the existing state-of-the-art parallel methods. To the best of our knowledge, this is the first work that develops a parallel SGD method to improve the matrix factorization on GPU. Copyright © 2015 John Wiley & Sons, Ltd. |
Year | DOI | Venue |
|---|---|---|
2016 | 10.1002/cpe.3722 | Concurrency and Computation: Practice and Experience |
Keywords | Field | DocType |
parallel matrix factorization,GPU computing,over-writing problem,thread divergence,stochastic gradient descent | Recommender system,Stochastic gradient descent,Computer science,Parallel computing,Matrix decomposition,Algorithm,SIMD,Thread (computing),Non-negative matrix factorization,General-purpose computing on graphics processing units,Graphics processing unit,Distributed computing | Journal |
Volume | Issue | ISSN |
28 | 14 | 1532-0626 |
Citations | PageRank | References |
3 | 0.42 | 16 |
Authors | ||
5 | ||