Title
Two SVDs produce more focal deep learning representations
Abstract
A key characteristic of work on deep learning and neural networks in general is that it relies on representations of the input that support generalization, robust inference, domain adaptation and other desirable functionalities. Much recent progress in the field has focused on efficient and effective methods for computing representations. In this paper, we propose an alternative method that is more efficient than prior work and produces representations that have a property we call focality -- a property we hypothesize to be important for neural network representations. The method consists of a simple application of two consecutive SVDs and is inspired by Anandkumar (2012).
Year
Venue
Field
2013
International Conference on Learning Representations
Computer science,Inference,Domain adaptation,Artificial intelligence,Deep learning,Artificial neural network,Machine learning
DocType
Volume
Citations 
Journal
abs/1301.3627
2
PageRank 
References 
Authors
0.41
12
2
Name
Order
Citations
PageRank
Hinrich Schuetze1332.73
Christian Scheible2777.61