Title
Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery
Abstract
We address the minimization of regularized convex cost functions which are customarily used for edge-preserving restoration and reconstruction of signals and images. In order to accelerate computation, the multiplicative and the additive half-quadratic reformulation of the original cost-function have been pioneered in Geman and Reynolds [IEEE Trans. Pattern Anal. Machine Intelligence, 14 (1992), pp. 367--383] and Geman and Yang IEEE Trans. Image Process., 4 (1995), pp. 932--946]. The alternate minimization of the resultant (augmented) cost-functions has a simple explicit form. The goal of this paper is to provide a systematic analysis of the convergence rate achieved by these methods. For the multiplicative and additive half-quadratic regularizations, we determine their upper bounds for their root-convergence factors. The bound for the multiplicative form is seen to be always smaller than the bound for the additive form. Experiments show that the number of iterations required for convergence for the multiplicative form is always less than that for the additive form. However, the computational cost of each iteration is much higher for the multiplicative form than for the additive form. The global assessment is that minimization using the additive form of half-quadratic regularization is faster than using the multiplicative form. When the additive form is applicable, it is hence recommended. Extensive experiments demonstrate that in our MATLAB implementation, both methods are substantially faster (in terms of computational times) than the standard MATLAB Optimization Toolbox routines used in our comparison study.
Year
DOI
Venue
2005
10.1137/030600862
SIAM J. Scientific Computing
Keywords
Field
DocType
preconditioning,inverse problem,cost function,maximum a posteriori estimation,image processing,image restoration,inverse problems,optimization,machine intelligence,upper bound,convergence rate
Convergence (routing),Mathematical optimization,Multiplicative function,Upper and lower bounds,Quadratic form,Quadratic equation,Rate of convergence,Image restoration,Numerical linear algebra,Mathematics
Journal
Volume
Issue
ISSN
27
3
1064-8275
Citations 
PageRank 
References 
151
5.09
17
Authors
2
Search Limit
100151
Name
Order
Citations
PageRank
Mila Nikolova11792105.71
Ng Michael24231311.70