Paper Info
Title
Cooperative Learning of Energy-Based Model and Latent Variable Model via MCMC Teaching.
Abstract
This paper proposes a cooperative learning algorithm to train both the undirected energy-based model and the directed latent variable model jointly. The learning algorithm interweaves the maximum likelihood algorithms for learning the two models, and each iteration consists of the following two steps: (1) Modified contrastive divergence for energy-based model: The learning of the energy-based model is based on the contrastive divergence, but the finite-step MCMC sampling of the model is initialized from the synthesized examples generated by the latent variable model instead of being initialized from the observed examples. (2) MCMC teaching of the latent variable model: The learning of the latent variable model is based on how the MCMC in (1) changes the initial synthesized examples generated by the latent variable model, where the latent variables that generate the initial synthesized examples are known so that the learning is essentially supervised. Our experiments show that the cooperative learning algorithm can learn realistic models of images.
Year
Venue
Field
2018
THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE
Markov chain Monte Carlo,Computer science,Latent variable model,Artificial intelligence,Cooperative learning,Machine learning
DocType
Citations 
PageRank 
Conference
2
0.37
References 
Authors
0
4
Name
Order
Citations
PageRank
Jianwen Xie113316.99
yang lu2745.42
Ruiqi Gao3219.35
Ying Nian Wu41652267.72