Title
Offline Permutation On The Cuda-Enabled Gpu
Abstract
The Hierarchical Memory Machine (HMM) is a theoretical parallel computing model that captures the essence of computation on CUDA-enabled GPUs. The offline permutation is a task to copy numbers stored in an array a of size n to an array b of the same size along a permutation P given in advance. A conventional algorithm can complete the offline permutation by executing b[p[i]]<- a[i] for all i in parallel, where an array p stores the permutation P. We first present that the conventional algorithm runs D-w(P) + 2 n/w + 3L - 3 time units using n threads on the HMM with width w and latency L, where D-w(P) is the distribution of P. We next show that important regular permutations including transpose, shuffle, and bit-reversal permutations run 2 n/w + 2 n/kw + 2L - 2 time units on the HMM with k DMMs. We have implemented permutation algorithms for these regular permutations on GeForce GTX 680 GPU. The experimental results show that these algorithms run much faster than the conventional algorithm. We also present an offline permutation algorithm for any permutation running in 16 n/w + 16 n/kw + 16L - 16 time units on the HMM with k DMMs. Quite surprisingly, our offline permutation algorithm on the GPU achieves better performance than the conventional algorithm in random permutation, although the running time has a large constant factor. We can say that the experimental results provide a good example of GPU computation showing that a complicated but ingenious implementation with a larger constant factor in computing time can outperform a much simpler conventional algorithm.
Year
DOI
Venue
2014
10.1587/transinf.2014PAP0010
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS
Keywords
Field
DocType
memory machine models, offline permutation, GPU, CUDA
Computer science,CUDA,Permutation,Parallel computing
Journal
Volume
Issue
ISSN
E97D
12
1745-1361
Citations 
PageRank 
References 
0
0.34
10
Authors
3
Name
Order
Citations
PageRank
Akihiko Kasagi1284.29
Koji Nakano21165118.13
Yasuaki Ito351160.47