Title
An Online Learning Approach to Generative Adversarial Networks.
Abstract
We consider the problem of training generative models with a Generative Adversarial Network (GAN). Although GANs can accurately model complex distributions, they are known to be difficult to train due to instabilities caused by a difficult minimax optimization problem. In this paper, we view the problem of training GANs as finding a mixed strategy in a zero-sum game. Building on ideas from online learning we propose a novel training method named Chekhov GAN. On the theory side, we show that our method provably converges to an equilibrium for semi-shallow GAN architectures, i.e. architectures where the discriminator is a one-layer network and the generator is arbitrary. On the practical side, we develop an efficient heuristic guided by our theoretical results, which we apply to commonly used deep GAN architectures. On several real-world tasks our approach exhibits improved stability and performance compared to standard GAN training.
Year
Venue
Field
2017
international conference on learning representations
Online learning,Minimax,Heuristic,Discriminator,Strategy,Artificial intelligence,Generative grammar,Optimization problem,Machine learning,Mathematics,Adversarial system
DocType
Volume
Citations 
Journal
abs/1706.03269
11
PageRank 
References 
Authors
0.69
7
5
Name
Order
Citations
PageRank
Paulina Grnarova1152.08
Kfir Y. Levy2728.77
Aurelien Lucchi3241989.45
Thomas Hofmann4100641001.83
Andreas Krause55822368.37