Paper Info
Title
Onsager-Corrected Deep Networks for Sparse Linear Inverse Problems.
Abstract
Deep learning has gained great popularity due to its widespread success on many inference problems. We consider the application of deep learning to the sparse linear inverse problem encountered in compressive sensing, where one seeks to recover a sparse signal from a few noisy linear measurements. In this paper, we propose two novel neural-network architectures that decouple prediction errors across layers in the same way that the approximate message passing (AMP) algorithms decouple them across iterations: through Onsager correction. We show numerically that our AMP network significantly improves upon Gregor and LeCunu0027s ISTA when both use soft-thresholding shrinkage. We then show that additional improvements result from jointly learning the shrinkage functions together with the linear transforms. Finally, we propose a network design inspired by an unfolding of the recently proposed vector AMP (VAMP) algorithm, and show that it outperforms all previously considered networks. Interestingly, the linear transforms and shrinkage functions prescribed by VAMP coincide with the values learned through backpropagation, yielding an intuitive explanation for the design of this deep network.
Year
Venue
Field
2016
arXiv: Information Theory
Computer science,Theoretical computer science,Inverse problem,Artificial intelligence
DocType
Volume
Citations 
Journal
abs/1612.01183
0
PageRank 
References 
Authors
0.34
0
2
Name
Order
Citations
PageRank
Mark Borgerding160.84
Philip Schniter2162093.74