Title
Onsager-corrected deep learning for sparse linear inverse problems
Abstract
Deep learning has gained great popularity due to its widespread success on many inference problems. We consider the application of deep learning to the sparse linear inverse problem encountered in compressive sensing, where one seeks to recover a sparse signal from a small number of noisy linear measurements. In this paper, we propose a novel neural-network architecture that decouples prediction errors across layers in the same way that the approximate message passing (AMP) algorithm decouples them across iterations: through Onsager correction. Numerical experiments suggest that our “learned AMP” network significantly improves upon Gregor and Le-Cun's “learned ISTA” network in both accuracy and complexity.
Year
DOI
Venue
2016
10.1109/GlobalSIP.2016.7905837
2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Keywords
DocType
Volume
Deep learning,compressive sensing,sparse coding,approximate message passing
Conference
abs/1607.05966
ISSN
ISBN
Citations 
2376-4066
978-1-5090-4546-4
8
PageRank 
References 
Authors
0.68
15
2
Name
Order
Citations
PageRank
Mark Borgerding1492.19
Philip Schniter2162093.74