Title
LeWI: A Runtime Balancing Algorithm for Nested Parallelism
Abstract
We present LeWI: a novel load balancing algorithm, that can balance applications with very different patterns of imbalance. Our algorithm can balance fine grain imbalances, non iterative applications and applications with irregular imbalance. To achieve this LeWI reassigns the computational resources of blocked processes to other processes more loaded. We have implemented LeWI within DLB a Dynamic Load Balancing Library developed by us. DLB helps parallel programming models to make the most of the computational power available with the minimum effort. It solves the imbalance among processes in applications with two levels of parallelism using the malleability of the inner level. The performance evaluation shows that LeWI, the novel balancing algorithm we are presenting in this paper, together with DLB is able to improve the performance of a different range of unbalanced applications and when applied to well balanced applications it does not introduce significant overhead. Therefore we present a mechanism that can be used with any hybrid application without needing a programmer to analyze the application nor modify it.
Year
DOI
Venue
2009
10.1109/ICPP.2009.56
Vienna
Keywords
Field
DocType
irregular imbalance,nested parallelism,computational resource,balanced application,different pattern,novel load,different range,non iterative application,computational power,runtime balancing algorithm,hybrid application,fine grain imbalance,parallel programming model,mpi,load balancing,parallel processing,load balance,resource allocation,parallel programming
Load management,Programmer,Yarn,Load balancing (computing),Computer science,Nested parallelism,Parallel computing,Algorithm,Parallel programming model,Resource allocation,Malleability,Distributed computing
Conference
ISSN
ISBN
Citations 
0190-3918 E-ISBN : 978-0-7695-3802-0
978-0-7695-3802-0
6
PageRank 
References 
Authors
0.58
14
3
Name
Order
Citations
PageRank
Marta Garcia1111.36
Julita Corbalan217412.00
Jesus Labarta3138992.33