Title
Coupled Learning for Image Generation and Latent Representation Inference Using MMD.
Abstract
For modeling the data distribution or the latent representation distribution in the image domain, deep learning methods such as the variational autoencoder (VAE) and the generative adversarial network (GAN) have been proposed. However, despite its capability of modeling these two distributions, VAE tends to learn less meaningful latent representations; GAN can only model the data distribution using the challenging and unstable adversarial training. To address these issues, we propose an unsupervised learning framework to perform coupled learning of these two distributions based on kernel maximum mean discrepancy (MMD). Specifically, the proposed framework consists of (1) an inference network and a generation network for mapping between the data space and the latent space, and (2) a latent tester and a data tester for performing two-sample tests in these two spaces, respectively. On one hand, we perform a two-sample test between stochastic representations from the prior distribution and inferred representations from the inference network. On the other hand, we perform a two-sample test between the real data and generated data. In addition, we impose structural regularization that the two networks are inverses of each other, so that the learning of these two distributions can be coupled. Experimental results on benchmark image datasets demonstrate that the proposed framework is competitive on image generation and latent representation inference of images compared with representative approaches.
Year
DOI
Venue
2018
10.1007/978-3-030-00767-6_40
ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II
Keywords
Field
DocType
Image generation,Latent representation inference,Coupled learning,Maximum mean discrepancy
Kernel (linear algebra),Image generation,Autoencoder,Pattern recognition,Inference,Computer science,Unsupervised learning,Regularization (mathematics),Artificial intelligence,Deep learning,Prior probability
Conference
Volume
ISSN
Citations 
11165
0302-9743
0
PageRank 
References 
Authors
0.34
20
5
Name
Order
Citations
PageRank
Sheng Qian1194.02
Wen-Ming Cao22611.53
Rui Li320959.97
Si Wu4177.03
Hau-San Wong5100886.89