Paper Info
Title
The Importance of Dynamic Load Balancing among OpenMP Thread Teams for Irregular Workloads
Abstract
Recently, massively-parallel many-core processors such as Intel Xeon Phi coprocessors have attracted researchers' attentions because various applications are significantly accelerated with those processors. In the field of high-performance computing, OpenMP is a standard programming model commonly used to parallelize a kernel loop for many-core processors. For hierarchical parallel processing, OpenMP version 4.0 or later allows programmers to group threads into multiple thread teams. In this paper, we first show the performance gain of using multiple thread teams even for one many-core processor. Then, we demonstrate that dynamic load balancing among those thread teams has a potential of significantly improving the performance of irregular workloads on a many-core processor. Although the current OpenMP specification does not offer such a dynamic load balancing mechanism, we discuss possible benefits of dynamic load balancing among thread teams through experiments using the Intel Xeon Phi coprocessor.
Year
DOI
Venue
2016
10.1109/CANDAR.2016.0097
2016 Fourth International Symposium on Computing and Networking (CANDAR)
Keywords
Field
DocType
dynamic load balancing,OpenMP thread teams,irregular workloads,massively-parallel many-core processors,Intel Xeon Phi coprocessors,high-performance computing,standard programming model,kernel loop parallelization,hierarchical parallel processing,OpenMP version 4.0,multiple thread teams
Kernel (linear algebra),Load management,Programming paradigm,Instruction set,Xeon Phi,Computer science,Parallel computing,Thread (computing),Coprocessor,Dynamic priority scheduling,Operating system
Conference
ISSN
ISBN
Citations 
2379-1888
978-1-5090-2656-2
1
PageRank 
References 
Authors
0.38
14
4
Name
Order
Citations
PageRank
Xiong Xiao128134.97
Shoichi Hirasawa2218.38
Hiroyuki Takizawa327346.54
Hiroaki Kobayashi49816.62