Title
Visual Performance Analysis of Memory Behavior in a Task-Based Runtime on Hybrid Platforms
Abstract
Programming parallel applications for heterogeneous HPC platforms is much more straightforward when using the task-based programming paradigm. The simplicity exists because a runtime takes care of many activities usually carried out by the application developer, such as task mapping, load balancing, and memory management operations. In this paper, we present a visualization-based performance analysis methodology to investigate the CPU-GPU-Disk memory management of the StarPU runtime, a popular task-based middleware for HPC applications. We detail the design of novel graphical strategies that were fundamental to recognize performance problems in four study cases. We first identify poor management of data handles when GPU memory is saturated, leading to low application performance. Our experiments using the dense tiled-based Cholesky factorization show that our fix leads to performance gains of 66% and better scalability for larger input sizes. In the other three cases, we study scenarios where the main memory is insufficient to store all the application's data, forcing the runtime to store data out-of-core. Using our methodology, we pin-point different behavior among schedulers and how we have identified a crucial problem in the application code regarding initial block placement, which leads to poor performance.
Year
DOI
Venue
2019
10.1109/CCGRID.2019.00025
2019 19th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID)
Keywords
Field
DocType
HPC,Task based,Performance analysis,Memory
Middleware,Programming paradigm,Computer science,Load balancing (computing),CUDA,Visualization,Memory management,Distributed computing,Cholesky decomposition,Scalability
Conference
ISSN
ISBN
Citations 
2376-4414
978-1-7281-0913-8
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Lucas Leandro Nesi100.34
Samuel Thibault271635.58
Luka Stanisic3323.49
Lucas Mello Schnorr49615.10