Title
Deep Double Sparsity Encoder: Learning to Sparsify Not Only Features But Also Parameters.
Abstract
This paper emphasizes the significance to jointly exploit the problem structure and the parameter structure, in the context of deep modeling. As a specific and interesting example, we describe the deep double sparsity encoder (DDSE), which is inspired by the double sparsity model for dictionary learning. DDSE simultaneously sparsities the output features and the learned model parameters, under one unified framework. In addition to its intuitive model interpretation, DDSE also possesses compact model size and low complexity. Extensive simulations compare DDSE with several carefully-designed baselines, and verify the consistently superior performance of DDSE. We further apply DDSE to the novel application domain of brain encoding, with promising preliminary results achieved.
Year
Venue
Field
2016
arXiv: Learning
Dictionary learning,Computer science,Exploit,Artificial intelligence,Application domain,Encoder,Model interpretation,Machine learning,Encoding (memory)
DocType
Volume
Citations 
Journal
abs/1608.06374
0
PageRank 
References 
Authors
0.34
0
6
Name
Order
Citations
PageRank
Zhangyang Wang143775.27
Liang Zhang2427.04
Yingzhen Yang343.10
Jiayu Zhou476556.69
G. B. Giannakis5114641206.47
Thomas S. Huang6278152618.42