Title
Milepost GCC: Machine Learning Enabled Self-tuning Compiler
Abstract
Tuning compiler optimizations for rapidly evolving hardware makes porting and extending an optimizing compiler for each new platform extremely challenging. Iterative optimization is a popular approach to adapting programs to a new architecture automatically using feedback-directed compilation. However, the large number of evaluations required for each program has prevented iterative compilation from widespread take-up in production compilers. Machine learning has been proposed to tune optimizations across programs systematically but is currently limited to a few transformations, long training phases and critically lacks publicly released, stable tools. Our approach is to develop a modular, extensible, self-tuning optimization infrastructure to automatically learn the best optimizations across multiple programs and architectures based on the correlation between program features, run-time behavior and optimizations. In this paper we describe Milepost GCC, the first publicly-available open-source machine learning-based compiler. It consists of an Interactive Compilation Interface (ICI) and plugins to extract program features and exchange optimization data with the cTuning.org open public repository. It automatically adapts the internal optimization heuristic at function-level granularity to improve execution time, code size and compilation time of a new program on a given architecture. Part of the MILEPOST technology together with low-level ICI-inspired plugin framework is now included in the mainline GCC. We developed machine learning plugins based on probabilistic and transductive approaches to predict good combinations of optimizations. Our preliminary experimental results show that it is possible to automatically reduce the execution time of individual MiBench programs, some by more than a factor of 2, while also improving compilation time and code size. On average we are able to reduce the execution time of the MiBench benchmark suite by 11% for the ARC reconfigurable processor. We also present a realistic multi-objective optimization scenario for Berkeley DB library using Milepost GCC and improve execution time by approximately 17%, while reducing compilation time and code size by 12% and 7% respectively on Intel Xeon processor.
Year
DOI
Venue
2011
10.1007/s10766-010-0161-2
International Journal of Parallel Programming
Keywords
Field
DocType
optimizing compiler,multi objective optimization,machine learning,compiler optimization
Computer science,Optimizing compiler,Single Compilation Unit,Artificial intelligence,Xeon,Just-in-time compilation,Computer architecture,Dynamic compilation,Parallel computing,Compiler,Porting,Plug-in,Machine learning
Journal
Volume
Issue
ISSN
39
3
1573-7640
Citations 
PageRank 
References 
76
2.91
44
Authors
17
Name
Order
Citations
PageRank
Grigori Fursin195850.76
Yuriy Kashnikov2843.79
Abdul Wahid Memon3854.28
Zbigniew Chamski412310.61
Olivier Temam52474148.79
M. Namolaru6924.42
Elad Yom-tov778253.97
Bilha Mendelson814411.71
Ayal Zaks941426.73
Eric Courtois10762.91
et al.1142259.98
Phil Barnard1212219.18
Elton Ashton13762.91
Edwin V. Bonilla14100853.32
John Thomson1550523.11
Christopher K. I. Williams166807631.16
Michael O’Boyle17762.91