Title
Learning Cost-Effective Sampling Strategies for Empirical Performance Modeling
Abstract
Identifying scalability bottlenecks in parallel applications is a vital but also laborious and expensive task. Empirical performance models have proven to be helpful to find such limitations, though they require a set of experiments in order to gain valuable insights. Therefore, the experiment design determines the quality and cost of the models. Extra-P is an empirical modeling tool that uses small-scale experiments to assess the scalability of applications. Its current version requires an exponential number of experiments per model parameter. This makes the creation of empirical performance models very expensive, and in some situations even impractical. In this paper, we propose a novel parameter-value selection heuristic, which functions as a guideline for the experiment design, leveraging sparse performance-modeling, a technique that only needs a polynomial number of experiments per model parameter. Using synthetic analysis and data from three different case studies, we show that our solution reduces the average modeling costs by about 85% while retaining 92% of the model accuracy.
Year
DOI
Venue
2020
10.1109/IPDPS47924.2020.00095
2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS)
Keywords
DocType
ISSN
Performance analysis,performance modeling,reinforcement learning,high-performance computing,parallel processing
Conference
1530-2075
ISBN
Citations 
PageRank 
978-1-7281-6876-0
1
0.35
References 
Authors
0
6
Name
Order
Citations
PageRank
Marcus Ritter110.35
Alexandru Calotoiu2798.04
Sebastian Rinke3163.45
Thorsten Reimann410.35
Torsten Hoefler52197163.64
Felix Wolf610.35