Name
Abstract | ||
|---|---|---|
Load balancing is a widely accepted technique for performance optimization of scientific applications on parallel architectures. Indeed, balanced applications do not waste processor cycles on waiting at points of synchronization and data exchange, maximizing this way the utilization of processors. In this paper, we challenge the universality of the load-balancing approach to optimization of the performance of parallel applications. First, we formulate conditions that should be satisfied by the performance profile of an application in order for the application to achieve its best performance via load balancing. Then we use a real-life scientific application, EULAG MPDATA kernel, to demonstrate that its performance profile on a modern parallel architecture, Intel Xeon Phi, significantly deviates from these conditions. Based on this observation, we propose a method of performance optimization of scientific applications through load imbalancing. In the case of data parallel application, the method uses functional performance models of the application to find partitioning that minimizes its computation time but not necessarily balances the load of processors. We apply this method to optimization of MPDATA on Intel Xeon Phi. Experimental results demonstrate that the performance of this carefully optimized load-balanced application can be further improved by 15percent using the proposed load-imbalancing technique. |
Year | DOI | Venue |
|---|---|---|
2017 | 10.1109/TPDS.2016.2599527 | IEEE Trans. Parallel Distrib. Syst. |
Keywords | Field | DocType |
Optimization,Load management,Heuristic algorithms,Partitioning algorithms,Load modeling,Parallel architectures,Computational modeling | Load management,Kernel (linear algebra),Synchronization,Data exchange,Load balancing (computing),Xeon Phi,Computer science,Parallel computing,Computation,Parallel architecture | Journal |
Volume | Issue | ISSN |
28 | 3 | 1045-9219 |
Citations | PageRank | References |
10 | 0.59 | 31 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Alexey Lastovetsky | 1 | 763 | 84.50 |
| Lukasz Szustak | 2 | 113 | 12.52 |
| Roman Wyrzykowski | 3 | 721 | 90.65 |