Name
Abstract | ||
|---|---|---|
Data analytics is undergoing a revolution in many scientific domains, and demands cost-effective parallel data analysis techniques. Traditional Java-based Big Data processing tools like Hadoop MapReduce are designed for commodity CPUs. In contrast, emerging manycore processors like the Xeon Phi have an order of magnitude greater computation power and memory bandwidth. To harness their computing capabilities, we propose the Harp-DAAL framework. We show that enhanced versions of MapReduce can be replaced by Harp, a Hadoop plug-in, that offers useful data abstractions for both high-performance iterative computation and MPI-quality communication, as well as drive Intel's native DAAL library. We select a subset of three machine learning algorithms and implement them within Harp-DAAL. Our scalability benchmarks ran on Knights Landing (KNL) clusters and achieved up to 2.5 times speedup of performance over the HPC solution in NOMAD and 15 to 40 times speedup over Java-based solutions in Spark. We further quantify the workloads on single node KNL with a performance breakdown at the micro-architecture level. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1109/CLOUD.2017.19 | 2017 IEEE 10th International Conference on Cloud Computing (CLOUD) |
Keywords | Field | DocType |
HPC,Xeon Phi,BigData | Data structure,Memory bandwidth,Spark (mathematics),Computer science,Xeon Phi,Parallel computing,Java,Big data,Operating system,Scalability,Speedup | Conference |
ISSN | ISBN | Citations |
2159-6182 | 978-1-5386-1994-0 | 1 |
PageRank | References | Authors |
0.35 | 9 | 13 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Langshi Chen | 1 | 2 | 0.69 |
| Bo Peng | 2 | 9 | 2.91 |
| Bingjing Zhang | 3 | 521 | 25.17 |
| Bingjing Zhang | 4 | 521 | 25.17 |
| Tony Liu | 5 | 1 | 0.35 |
| Yiming Zou | 6 | 1 | 0.35 |
| Lei Jiang | 7 | 12 | 1.69 |
| Robert Henschel | 8 | 106 | 10.85 |
| Craig A. Stewart | 9 | 259 | 42.68 |
| Emily McCallum | 10 | 1 | 0.35 |
| Zahniser Tom | 11 | 1 | 0.35 |
| Omer Jon | 12 | 1 | 0.35 |
| Judy Qiu | 13 | 3 | 2.07 |