2017 MaximumLikelihoodAugmentedDiscr
- (Che et al., 2017) ⇒ Tong Che, Yanran Li, Ruixiang Zhang, R. Devon Hjelm, Wenjie Li, Yangqiu Song, and Yoshua Bengio. (2017). “Maximum-Likelihood Augmented Discrete Generative Adversarial Networks.” In: ArXiv Preprint: 1702.07983.
Subject Headings: Maximum-Likelihood Augmented Discrete Generative Adversarial Network (MaliGAN), Generative Adversarial Network, Memory Augmented Neural Network.
Notes
- Version(s) and URL(s):
Cited By
- Google Scholar: ~ 119 Citations
- Semantic Scholar: ~ 117 Citations
- MS Academic: ~ 125 Citations
Quotes
Abstract
Despite the successes in capturing continuous distributions, the application of generative adversarial networks (GANs) to discrete settings, like natural language tasks, is rather restricted. The fundamental reason is the difficulty of back-propagation through discrete random variables combined with the inherent instability of the GAN training objective. To address these problems, we propose Maximum-Likelihood Augmented Discrete Generative Adversarial Networks. Instead of directly optimizing the GAN objective, we derive a novel and low-variance objective using the discriminator's output that follows corresponds to the log-likelihood. Compared with the original, the new objective is proved to be consistent in theory and beneficial in practice. The experimental results on various discrete datasets demonstrate the effectiveness of the proposed approach.
References
BibTex
@article{2017_MaximumLikelihoodAugmentedDiscr, author = {Tong Che and Yanran Li and Ruixiang Zhang and R. Devon Hjelm and Wenjie Li and Yangqiu Song and [[Yoshua Bengio]]}, title = {{Maximum-Likelihood Augmented Discrete Generative Adversarial Networks}, journal = {CoRR}, volume = {abs/1702.07983}, year = {2017}, url = {http://arxiv.org/abs/1702.07983}, archivePrefix = {arXiv}, eprint = {1702.07983}, }
Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
---|---|---|---|---|---|---|---|---|---|---|
2017 MaximumLikelihoodAugmentedDiscr | Yangqiu Song Wenjie Li Yoshua Bengio Tong Che Yanran Li Ruixiang Zhang R. Devon Hjelm | Maximum-Likelihood Augmented Discrete Generative Adversarial Networks | 2017 |