Title
Training Generative Adversarial Networks with Binary Neurons by End-to-end Backpropagation.
Abstract
We propose the BinaryGAN, a novel generative adversarial network (GAN) that uses binary neurons at the output layer of the generator. We employ the sigmoid-adjusted straight-through estimators to estimate the gradients for the binary neurons and train the whole network by end-to-end backpropogation. The proposed model is able to directly generate binary-valued predictions at test time. We implement such a model to generate binarized MNIST digits and experimentally compare the performance for different types of binary neurons, GAN objectives and network architectures. Although the results are still preliminary, we show that it is possible to train a GAN that has binary neurons and that the use of gradient estimators can be a promising direction for modeling discrete distributions with GANs. For reproducibility, the source code is available at this https URL .
Year
Venue
Field
2018
arXiv: Learning
MNIST database,Source code,End-to-end principle,Network architecture,Artificial intelligence,Generative grammar,Backpropagation,Mathematics,Machine learning,Binary number,Estimator
DocType
Volume
Citations 
Journal
abs/1810.04714
0
PageRank 
References 
Authors
0.34
4
2
Name
Order
Citations
PageRank
Hao-Wen Dong1203.50
Yi-Hsuan Yang2102284.71