Title
Dynamic load balancing on heterogeneous multi-GPU systems
Abstract
The advent of multicore systems, joined to the potential acceleration of the graphics processing units, alleviates some well known important architectural problems at the expense of a considerable increment of the programmability wall. The heterogeneity, both at architectural and programming level at the same time, raises the programming difficulties. Adapting existing code and libraries to such systems is a fundamental problem. The performance of this code is affected by the large interdependence between the code and the parallel architecture. We have developed a dynamic load balancing library that allows parallel code to be adapted to a wide variety of heterogeneous systems. The overhead introduced by our system is minimal and the cost to the programmer negligible. This system has been applied to solve load imbalance problems appearing in homogeneous and heterogeneous multi-GPU platforms. As case studies, we consider matrix multiply and resource allocation problems, in different heterogeneous scenarios in multi-GPU systems. The unbalanced nature of these algorithms and heterogeneous systems allowed us to test the success of our load balancing approach.
Year
DOI
Venue
2013
10.1016/j.compeleceng.2013.08.004
Computers & Electrical Engineering
Keywords
Field
DocType
load imbalance problem,dynamic load,actual hpc system,existing code,multigpu system,heterogeneous system,heterogeneous multigpu platform,dynamic load balancing,parallel code,new system,heterogeneous multi-gpu system,different heterogeneous scenario
Graphics,Dynamic programming,Programmer,Homogeneous,Computer science,Parallel computing,Real-time computing,Imbalance problems,Dynamic load balancing,Multi-core processor,Parallel architecture,Distributed computing
Journal
Volume
Issue
ISSN
39
8
0045-7906
ISBN
Citations 
PageRank 
978-1-4673-1631-6
15
0.63
References 
Authors
18
3
Name
Order
Citations
PageRank
Alejandro Acosta1558.98
Vicente Blanco2415.64
F. Almeida334349.54