Paper Info
Title
Algorithm Selection of MPI Collectives Using Machine Learning Techniques
Abstract
Autotuning is a well established method to improve software performance for a given system, and it is especially important in High Performance Computing. The goal of autotuning is to find the best possible algorithm and its best parameter settings for a given instance. Autotuning can also be applied to MPI libraries, such as Open MPI or Intel MPI. These MPI libraries provide numerous parameters that allow users to adapt them to a given system. Some of these tunable parameters enable users to select a specific algorithm that should be used internally by an MPI collective operation. For the purpose of automatically tuning MPI collectives on a given system, the Intel MPI library is shipped with mpitune. The drawback of tools like mpitune is that results can only be applied to cases (e.g., number of processes, message size) for which the tool has performed the optimization. To overcome this limitation, we present a first step towards tuning MPI libraries also for unseen instances by applying machine learning techniques. Our goal is to create a classifier that takes the collective operation, the message size and communicator characteristics (number of compute nodes, number of processes per node) as an input and gives the predicted best algorithm for this problem as an output. We show how such a model can be constructed and what pitfalls should be avoided. We demonstrate by thorough experimentation that our proposed prediction model is able to outperform the default configuration of Intel MPI or Open MPI on recent computer clusters.
Year
DOI
Venue
2018
10.1109/PMBS.2018.8641622
2018 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS)
Keywords
Field
DocType
MPI,Intel mpitune,performance prediction,autotuning,MPI benchmarks,collective communication operations,machine learning
Drawback,Supercomputer,Computer science,Software performance testing,Artificial intelligence,Algorithm Selection,Classifier (linguistics),Performance prediction,Machine learning,Computer cluster,Message size
Conference
ISBN
Citations 
PageRank 
978-1-7281-0182-8
2
0.37
References 
Authors
0
2
Name
Order
Citations
PageRank
Sascha Hunold112120.11
Alexandra Carpen-Amarie221315.89