Name
Title | ||
|---|---|---|
Mimir+ - An Optimized Framework of MapReduce on Heterogeneous High-Performance Computing System. |
Abstract | ||
|---|---|---|
In this paper, we present an optimized data processing framework: Mimir+. Mimir+ is an implementation of MapReduce over MPI. In order to take full advantage of heterogeneous computing system, we propose the concept of Pre-acceleration to reconstruct a heterogeneous workflow and implement the interfaces of GPU so that Mimir+ can facilitate data processing through reasonable tasks and data scheduling between CPU and GPU. We evaluate Mimir+ via two benchmarks (i.e. the WordCount and large-scale matrix multiplication) on the Tianhe-2 supercomputing system. Experimental results demonstrate that Mimir+ achieves excellent acceleration effect compared with original Mimir. |
Year | DOI | Venue |
|---|---|---|
2018 | 10.1007/978-3-030-05677-3_18 | NPC |
Field | DocType | Citations |
Data processing,Supercomputer,Computer science,Parallel computing,Symmetric multiprocessor system,Acceleration,Data scheduling,Workflow,Matrix multiplication,Distributed computing | Conference | 0 |
PageRank | References | Authors |
0.34 | 6 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Nan Hu | 1 | 23 | 7.95 |
| Zhiguang Chen | 2 | 79 | 18.83 |
| Yunfei Du | 3 | 72 | 14.62 |
| Yutong Lu | 4 | 307 | 53.61 |