Title
Diffusion stochastic optimization with non-smooth regularizers.
Abstract
We develop an effective distributed strategy for seeking the Pareto solution of an aggregate cost consisting of regularized risks. The focus is on stochastic optimization problems where each risk function is expressed as the expectation of some loss function and the probability distribution of the data is unknown. We assume each risk function is regularized and allow the regularizer to be non-smooth. Under conditions that are weaker than assumed earlier in the literature and, hence, applicable to a broader class of adaptation and learning problems, we show how the regularizers can be smoothed and how the Pareto solution can be sought by appealing to a multi-agent diffusion strategy. The formulation is general enough and includes, for example, a multi-agent proximal strategy as a special case.
Year
DOI
Venue
2016
10.1109/ICASSP.2016.7472458
ICASSP
Keywords
Field
DocType
Distributed optimization,diffusion strategy,non-smooth regularizer,proximal diffusion,proximal operator,regularized diffusion,smoothing
Mathematical optimization,Stochastic optimization,Computer science,Smoothing,Probability distribution,Risk function,Pareto solution,Special case
Conference
ISSN
Citations 
PageRank 
1520-6149
5
0.40
References 
Authors
14
3
Name
Order
Citations
PageRank
Stefan Vlaski12311.39
Lieven Vandenberghe21453234.07
Ali H. Sayed39134667.71