Title
MANIFOLD SAMPLING FOR OPTIMIZING NONSMOOTH NONCONVEX COMPOSITIONS
Abstract
We propose a manifold sampling algorithm for minimizing a nonsmooth composition f = hoF, where we assume h is nonsmooth and may be inexpensively computed in closed form and F is smooth but its Jacobian may not be available. We additionally assume that the composition h o F defines a continuous selection. Manifold sampling algorithms can be classified as model-based derivative-free methods, in that models of F are combined with particularly sampled information about h to yield local models for use within a trust-region framework. We demonstrate that cluster points of the sequence of iterates generated by the manifold sampling algorithm are Clarke stationary. We consider the tractability of three particular subproblems generated by the manifold sampling algorithm and the extent to which inexact solutions to these subproblems may be tolerated. Numerical results demonstrate that manifold sampling as a derivative-free algorithm is competitive with state-of-the-art algorithms for nonsmooth optimization that utilize first-order information about f.
Year
DOI
Venue
2021
10.1137/20M1378089
SIAM JOURNAL ON OPTIMIZATION
Keywords
DocType
Volume
manifold sampling, gradient sampling, nonsmooth optimization
Journal
31
Issue
ISSN
Citations 
4
1052-6234
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Jeffrey Larson1325.46
Matt Menickelly2142.85
Baoyu Zhou300.34