Title
The Equivalence of Half-Quadratic Minimization and the Gradient Linearization Iteration
Abstract
A popular way to restore images comprising edges is to minimize a cost function combining a quadratic data-fidelity term and an edge-preserving (possibly nonconvex) regularizalion term. Mainly because of the latter term, the calculation of the solution is slow and cumbersome. Half-quadratic (HQ) minimization (multiplicative form) was pioneered by Geman and Reynolds (1992) in order to alleviate the computational task in the context of image reconstruction with nonconvex regularization. By promoting the idea of locally homogeneous image models with a continuous-valued line process, they reformulated the optimization problem in terms of an augmented cost function which is quadratic with respect to the image and separable with respect to the line process, hence the name "half quadratic." Since then, a large amount of papers were dedicated to HQ minimization and important results--including edge-preservation along with convex regularization and convergence-have been obtained. In this paper, we show that HQ minimization (multiplicative form) is equivalent to the most simple and basic method where the gradient of the cost function is linearized at each iteration step. In fact, both methods give exactly the same iterations. Furthermore, connections of HQ minimization with other methods, such as the quasi-Newton method and the generalized Weiszfeld's method, are straightforward.
Year
DOI
Venue
2007
10.1109/TIP.2007.896622
IEEE Transactions on Image Processing
Keywords
Field
DocType
image restoration,iterative methods,linearisation techniques,minimisation,augmented cost function,continuous-valued line process,convex regularization,cost function,edge-preservation,edge-preserving regularization term,gradient linearization iteration,half-quadratic minimization,image reconstruction,image restoration,locally homogeneous image models,nonconvex regularization,quadratic data-fidelity term,quasi-Newton method,Gradient linearization,half-quadratic (HQ) regularization,inverse problems,optimization,signal and image restoration,variational methods
Gradient method,Quasi-Newton method,Mathematical optimization,Multiplicative function,Iterative method,Quadratic equation,Quadratic function,Regularization (mathematics),Linearization,Mathematics
Journal
Volume
Issue
ISSN
16
6
1057-7149
Citations 
PageRank 
References 
41
1.58
24
Authors
2
Name
Order
Citations
PageRank
Mila Nikolova11792105.71
R. H. Chan217714.11