Title
Efficient Parallel Random Sampling - Vectorized, Cache-Efficient, and Online.
Abstract
We consider the problem of sampling n numbers from the range { 1,… ,N} without replacement on modern architectures. The main result is a simple divide-and-conquer scheme that makes sequential algorithms more cache efficient and leads to a parallel algorithm running in expected time O(n/p+log p) on p processors, i.e., scales to massively parallel machines even for moderate values of n. The amount of communication between the processors is very small (at most O(log p)) and independent of the sample size. We also discuss modifications needed for load balancing, online sampling, sampling with replacement, Bernoulli sampling, and vectorization on SIMD units or GPUs.
Year
Venue
Keywords
2018
ACM Trans. Math. Softw.
Hypergeometric random deviates, communication efficient algorithms, parallel algorithms
DocType
Volume
Issue
Journal
44
3
Citations 
PageRank 
References 
1
0.41
14
Authors
5
Name
Order
Citations
PageRank
Peter Sanders1225.45
sebastian lamm2344.10
Lorenz Hübschle-Schneider3214.22
Emanuel Schrade410.41
Carsten Dachsbacher5139693.20