Title
A convergence analysis of the method of codifferential descent.
Abstract
This paper is devoted to a detailed convergence analysis of the method of codifferential descent (MCD) developed by professor V.F. Demyanov for solving a large class of nonsmooth nonconvex optimization problems. We propose a generalization of the MCD that is more suitable for applications than the original method, and that utilizes only a part of a codifferential on every iteration, which allows one to reduce the overall complexity of the method. With the use of some general results on uniformly codifferentiable functions obtained in this paper, we prove the global convergence of the generalized MCD in the infinite dimensional case. Also, we propose and analyse a quadratic regularization of the MCD, which is the first general method for minimizing a codifferentiable function over a convex set. Apart from convergence analysis, we also discuss the robustness of the MCD with respect to computational errors, possible step size rules, and a choice of parameters of the algorithm. In the end of the paper we estimate the rate of convergence of the MCD for a class of nonsmooth nonconvex functions that arise, in particular, in cluster analysis. We prove that under some general assumptions the method converges with linear rate, and it convergence quadratically, provided a certain first order sufficient optimality condition holds true.
Year
DOI
Venue
2018
10.1007/s10589-018-0024-0
Comp. Opt. and Appl.
Keywords
Field
DocType
Nonsmooth optimization, Nonconvex optimization, Codifferential, Quasidifferential, Method of codifferential descent, 90C56, 49J52
Convergence (routing),Quadratic growth,Mathematical optimization,Convex set,Quadratic equation,Robustness (computer science),Regularization (mathematics),Rate of convergence,Optimization problem,Mathematics
Journal
Volume
Issue
ISSN
71
3
Computational Optimization and Applications, 71:3 (2018) 879-913
Citations 
PageRank 
References 
1
0.39
13
Authors
1
Name
Order
Citations
PageRank
Maxim V. Dolgopolik172.52