Name
Abstract | ||
|---|---|---|
This work presents an optimization of MPI communications, called Dynamic-CoMPI, which uses two techniques in order to reduce the impact of communications and non-contiguous I/O requests in parallel applications.
These techniques are independent of the application and complementaries to each other. The first technique is an optimization
of the Two-Phase collective I/O technique from ROMIO, called Locality aware strategy for Two-Phase I/O (LA-Two-Phase I/O). In order to increase the locality of the file accesses, LA-Two-Phase I/O employs the Linear Assignment Problem (LAP) for finding an optimal I/O data communication schedule. The main purpose of this
technique is the reduction of the number of communications involved in the I/O collective operation. The second technique,
called Adaptive-CoMPI, is based on run-time compression of MPI messages exchanged by applications. Both techniques can be applied on every application,
because both of them are transparent for the users. Dynamic-CoMPI has been validated by using several MPI benchmarks and real HPC applications. The results show that, for many of the considered
scenarios, important reductions in the execution time are achieved by reducing the size and the number of the messages. Additional
benefits of our approach are the reduction of the total communication time and the network contention, thus enhancing, not
only performance, but also scalability. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1007/s11227-010-0440-0 | The Journal of Supercomputing |
Keywords | Field | DocType |
MPI library,Parallel techniques,Clusters architectures,Compression algorithms,Collective I/O,Adaptive systems,Heuristics | Locality,Adaptive system,Computer science,Parallel computing,Heuristics,Assignment problem,Execution time,Data compression,Distributed computing,Scalability | Journal |
Volume | Issue | ISSN |
53 | 3 | 0920-8542 |
Citations | PageRank | References |
13 | 0.79 | 30 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Rosa Filgueira | 1 | 150 | 13.20 |
| Jesús Carretero | 2 | 552 | 69.87 |
| David E. Singh | 3 | 191 | 23.13 |
| Alejandro Calderón | 4 | 176 | 17.28 |
| Alberto Núñez | 5 | 147 | 7.74 |