Title
Optimal search efficiency of Barker's algorithm with an exponential fitness function.
Abstract
Markov Chain Monte Carlo (MCMC) methods may be employed to search for a probability distribution over a bounded space of function arguments to estimate which argument(s) optimize(s) an objective function. This search-based optimization requires sampling the suitability, or fitness, of arguments in the search space. When the objective function or the fitness of arguments vary with time, significant exploration of the search space is required. Search efficiency then becomes a more relevant measure of the usefulness of an MCMC method than traditional measures such as convergence speed to the stationary distribution and asymptotic variance of stationary distribution estimates. Search efficiency refers to how quickly prior information about the search space is traded-off for search effort savings. Optimal search efficiency occurs when the entropy of the probability distribution over the space during search is maximized. Whereas the Metropolis case of the Hastings MCMC algorithm with fixed candidate generation is optimal with respect to asymptotic variance of stationary distribution estimates, this paper proves that Barker’s case is optimal with respect to search efficiency if the fitness of the arguments in the search space is characterized by an exponential function. The latter instance of optimality is beneficial for time-varying optimization that is also model-independent.
Year
DOI
Venue
2014
10.1007/s11590-013-0608-7
Optimization Letters
Keywords
Field
DocType
Markov Chain Monte Carlo, Maximum entropy, Search efficiency, Selective generation, Stochastic optimization in dynamic environments
Mathematical optimization,Search algorithm,Markov chain Monte Carlo,Algorithm,Fitness function,Probability distribution,Stationary distribution,Binary search algorithm,Local search (optimization),Delta method,Mathematics
Journal
Volume
Issue
ISSN
8
2
1862-4480
Citations 
PageRank 
References 
3
0.43
1
Authors
2
Name
Order
Citations
PageRank
Amor a. Menezes1144.73
Pierre T. Kabamba25817.07