Title
Using 1000+ GPUs and 10000+ CPUs for Sedimentary Basin Simulations
Abstract
In cutting-edge CPU/GPU hybrid clusters, such as Tianhe-1A, the aggregate CPU computing capability may amount to up to 1/3 of the aggregate GPU computing capability. It thus goes without saying that the CPUs and GPUs should jointly carry out the computational work. However, to effectively and simultaneously use both the hardware components requires great care when developing the parallel implementations. The challenges include (1) finding a balanced division of the workload between the CPU and GPU sides, and (2) hiding various overheads by overlapping computations with CPU-GPU data transfers and/or MPI communications. We study these issues in the context of real-world sedimentary basin simulations. Numerical experiments show that an appropriately devised CPU-GPU hybrid implementation is able to handle a global mesh resolution of 131,072*131,072, and a double-precision rate of 62 TFlops is achieved by using 1024 GPUs and 12288 CPU cores on Tianhe-1A. Such an extreme computing capability will be of great importance for carrying out high-resolution and continental-scale stratigraphic simulations in future.
Year
DOI
Venue
2012
10.1109/CLUSTER.2012.37
CLUSTER
Keywords
Field
DocType
cutting-edge cpu,global mesh resolution,sediments,sedimentary basin simulations,geophysics computing,parallel implementations,cpu core,cpu-gpu hybrid implementation,gpu side,gpu hybrid cluster,cpu-gpu data transfers,great care,graphics processing units,cpu-gpu data transfer,seafloor phenomena,continental-scale stratigraphic simulation,tianhe-1a,multiprocessing systems,extreme computing capability,cpu-gpu hybrid computing,tianhe-1a hunan solution,high-resolution stratigraphic simulation,aggregate gpu computing capability,aggregate cpu computing capability,cpu/gpu hybrid clusters,mpi communications,mpi/openmp/cuda,dual-lithology sedimentary basin simulation,computational modeling,multicore processing,kernel,instruction sets,mathematical model,hardware
Kernel (linear algebra),Central processing unit,Computer science,Instruction set,Parallel computing,Computational science,General-purpose computing on graphics processing units,Graphics processing unit,Multi-core processor,CPU shielding,Computation
Conference
ISSN
ISBN
Citations 
1552-5244
978-1-4673-2422-9
5
PageRank 
References 
Authors
0.58
7
6
Name
Order
Citations
PageRank
Mei Wen116033.46
Huayou Su25211.84
Wenjie Wei3122.33
Nan Wu48914.65
Xing Cai5519.54
Chunyuan Zhang621343.86