Title
Sparse Multinomial Logistic Regression via Approximate Message Passing
Abstract
For the problem of multi class linear classification and feature selection, we propose approximate message passing approaches to sparse multinomial logistic regression (MLR). First, we propose two algorithms based on the Hybrid Generalized Approximate Message Passing framework: one finds the maximum a posteriori linear classifier and the other finds an approximation of the test-error-rate minimizing linear classifier. Then we design computationally simplified variants of these two algorithms. Next, we detail methods to tune the hyperparameters of their assumed statistical models using Stein's unbiased risk estimate and expectation-maximization, respectively. Finally, using both synthetic and real-world datasets, we demonstrate improved error-rate and runtime performance relative to existing state-of-the-art approaches to sparse MLR.
Year
DOI
Venue
2015
10.1109/TSP.2016.2593691
IEEE Trans. Signal Processing
Keywords
DocType
Volume
Approximation algorithms,Message passing,Logistics,Algorithm design and analysis,Signal processing algorithms,Training,Belief propagation
Journal
abs/1509.04491
Issue
ISSN
Citations 
21
1053-587X
2
PageRank 
References 
Authors
0.37
13
2
Name
Order
Citations
PageRank
evan byrne120.37
Philip Schniter2162093.74