Title
Performance Modeling of MPI Applications Using Model Selection Techniques
Abstract
A new method for obtaining models of the performance of parallel applications based on statistical analysis is presented in this paper. This method is based on the Akaike’s information criterion (AIC) that provides an objective mechanism to rank different models by means of an experimental data fit. The input of the modeling process is a set of variables and parameters that can a priori influence the performance of the application. This set can be provided by the user. Using this information, the method automatically generates a set of candidate models. These models are fit to the experimental data and the AIC score of each model is calculated. The model with the best AIC score is selected as the best model. Also, using the AIC scores of all candidate models, useful statistical information is provided to help the user to evaluate the quality of the selected model, as well as indications of how to interactively improve this modeling process. As a first case of study, statistical models obtained for different implementations of the broadcast collective communication in Open MPI are shown. These models are very accurate, exceeding its adjustment to theoretical approaches based on the LogGP model. Finally, the NAS Parallel Benchmark is also characterized using this new method with good results in terms of accuracy.
Year
DOI
Venue
2010
10.1109/PDP.2010.78
PDP
Keywords
Field
DocType
modeling process,different model,performance modeling,model selection techniques,experimental data,best model,mpi applications,loggp model,selected model,statistical model,new method,candidate model,aic score,message passing,parallel processing,statistical analysis,mathematical model,mpi,data models,computational modeling,algorithm design and analysis,akaike information criterion,model selection
Data modeling,Akaike information criterion,Experimental data,Computer science,Multilevel model,A priori and a posteriori,Model selection,Statistical model,Artificial intelligence,Message passing,Machine learning
Conference
ISSN
ISBN
Citations 
1066-6192
978-1-4244-5673-4
2
PageRank 
References 
Authors
0.39
1
5