Title
A CUDA implementation of the Continuous Space Language Model
Abstract
The training phase of the Continuous Space Language Model (CSLM) was implemented in the NVIDIA hardware/software architecture Compute Unified Device Architecture (CUDA). A detailed explanation of the CSLM algorithm is provided. Implementation was accomplished using a combination of CUBLAS library routines, NVIDIA NPP functions, and CUDA kernel calls on three different CUDA enabled devices of varying compute capability and a time savings over the traditional CPU approach demonstrated. The efficiency of the CUDA version of the open source implementation is analyzed and compared to that using the Intel Math Kernel Libraries (MKL) on a variety of CUDA enabled and multi-core CPU platforms. It is demonstrated that substantial performance benefit can be obtained using CUDA, even with nonoptimal code. Techniques for optimizing performance are then provided. Furthermore, an analysis is performed to determine the conditions in which the performance of CUDA exceeds that of the multi-core MKL realization.
Year
DOI
Venue
2014
10.1007/s11227-013-1023-7
The Journal of Supercomputing
Keywords
Field
DocType
CUDA,CSLM,GPU,Statistical signal processing,CUBLAS,Math Kernel Library,BLAS,High performance computing
Kernel (linear algebra),Supercomputer,Computer science,CUDA,Parallel computing,Computational science,Statistical signal processing,Software architecture,Language model
Journal
Volume
Issue
ISSN
68
1
0920-8542
Citations 
PageRank 
References 
1
0.38
14
Authors
2
Name
Order
Citations
PageRank
Elizabeth A. Thompson1205.47
Timothy R. Anderson2419.92