Title
Scalable Deep Poisson Factor Analysis for Topic Modeling
Abstract
A new framework for topic modeling is developed, based on deep graphical models, where interactions between topics are inferred through deep latent binary hierarchies. The proposed multi-layer model employs a deep sigmoid belief network or restricted Boltzmann machine, the bottom binary layer of which selects topics for use in a Poisson factor analysis model. Under this setting, topics live on the bottom layer of the model, while the deep specification serves as a flexible prior for revealing topic structure. Scalable inference algorithms are derived by applying Bayesian conditional density filtering algorithm, in addition to extending recently proposed work on stochastic gradient thermostats. Experimental results on several corpora show that the proposed approach readily handles very large collections of text documents, infers structured topic representations, and obtains superior test perplexities when compared with related models.
Year
Venue
Field
2015
International Conference on Machine Learning
Data mining,Restricted Boltzmann machine,Conditional probability distribution,Computer science,Inference,Deep belief network,Bayesian network,Artificial intelligence,Graphical model,Topic model,Machine learning,Bayesian probability
DocType
Citations 
PageRank 
Conference
22
0.84
References 
Authors
26
5
Name
Order
Citations
PageRank
Zhe Gan131932.58
Changyou Chen236536.95
Ricardo Henao328623.85
David E. Carlson418215.35
Lawrence Carin513711.38