Title
Double Smoothing Technique for Large-Scale Linearly Constrained Convex Optimization.
Abstract
In this paper, we propose an efficient approach for solving a class of large-scale convex optimization problems. The problem we consider is the minimization of a convex function over a simple (possibly infinite-dimensional) convex set, under the additional constraint Au is an element of T, where A is a linear operator and T is a convex set whose dimension is small compared to the dimension of the feasible region. In our approach, we dualize the linear constraints, solve the resulting dual problem with a purely dual gradient-type method and show how to reconstruct an approximate primal solution. Because the linear constraints have been dualized, the dual objective function typically becomes separable, and therefore easy to compute. In order to accelerate our scheme, we introduce a novel double smoothing technique that involves regularization of the dual problem to allow the use of a fast gradient method. As a result, we obtain a method with complexity O(1/epsilon ln 1/epsilon) gradient iterations, where epsilon is the desired accuracy for the primal-dual solution. Our approach covers, in particular, optimal control problems with a trajectory governed by a system of linear differential equations, where the additional constraints can, for example, force the trajectory to visit some convex sets at certain moments in time.
Year
DOI
Venue
2012
10.1137/110826102
SIAM JOURNAL ON OPTIMIZATION
Keywords
Field
DocType
convex optimization,fast gradient methods,infinite-dimensional,Hilbert space,complexity theory,smoothing technique,optimal control
Discrete mathematics,Mathematical optimization,Convex combination,Convex set,Subderivative,Regularization (mathematics),Convex function,Proximal gradient methods for learning,Convex optimization,Mathematics,Convex analysis
Journal
Volume
Issue
ISSN
22
2
1052-6234
Citations 
PageRank 
References 
23
1.43
1
Authors
3
Name
Order
Citations
PageRank
Olivier Devolder1603.41
François Glineur236220.16
Yurii Nesterov31800168.77