Title
A Stochastic approximation method for inference in probabilistic graphical models.
Abstract
We describe a new algorithmic framework for inference in probabilistic models, and apply it to inference for latent Dirichlet allocation. Our framework adopts the methodology of variational inference, but unlike existing variational methods such as mean field and expectation propagation it is not restricted to tractable classes of approximating distributions. Our approach can also be viewed as a sequential Monte Carlo (SMC) method, but unlike existing SMC methods there is no need to design the artificial sequence of distributions. Notably, our framework offers a principled means to exchange the variance of an importance sampling estimate for the bias incurred through variational approximation. Experiments on a challenging inference problem in population genetics demonstrate improvements in stability and accuracy over existing methods, and at a comparable cost.
Year
Venue
Field
2009
NIPS
Latent Dirichlet allocation,Importance sampling,Frequentist inference,Mathematical optimization,Inference,Fiducial inference,Computer science,Particle filter,Predictive inference,Artificial intelligence,Adaptive neuro fuzzy inference system,Machine learning
DocType
Citations 
PageRank 
Conference
10
1.25
References 
Authors
9
3
Name
Order
Citations
PageRank
Peter Carbonetto1727.42
Matthew King2645.95
Firas Hamze313114.05