Title
Enlightengan: Deep Light Enhancement Without Paired Supervision
Abstract
Deep learning-based methods have achieved remarkable success in image restoration and enhancement, but are they still competitive when there is a lack of paired training data? As one such example, this paper explores the low-light image enhancement problem, where in practice it is extremely challenging to simultaneously take a low-light and a normal-light photo of the same visual scene. We propose a highly effective unsupervised generative adversarial network, dubbed EnlightenGAN, that can be trained without low/normal-light image pairs, yet proves to generalize very well on various real-world test images. Instead of supervising the learning using ground truth data, we propose to regularize the unpaired training using the information extracted from the input itself, and benchmark a series of innovations for the low-light image enhancement problem, including a global-local discriminator structure, a self-regularized perceptual loss fusion, and the attention mechanism. Through extensive experiments, our proposed approach outperforms recent methods under a variety of metrics in terms of visual quality and subjective user study. Thanks to the great flexibility brought by unpaired training, EnlightenGAN is demonstrated to be easily adaptable to enhancing real-world images from various domains. Our codes and pre-trained models are available at: https://github.com/VITA-Group/EnlightenGAN.
Year
DOI
Venue
2019
10.1109/TIP.2021.3051462
IEEE TRANSACTIONS ON IMAGE PROCESSING
Keywords
DocType
Volume
Training, Visualization, Lighting, Generative adversarial networks, Gallium nitride, Adaptation models, Training data, Low-light enhancement, generative adversarial networks, unsupervised learning
Journal
30
Issue
ISSN
Citations 
1
1057-7149
12
PageRank 
References 
Authors
0.56
0
9
Name
Order
Citations
PageRank
Yifan Jiang1161.30
Xinyu Gong2233.45
Ding Liu361132.97
Yu Cheng461555.76
Chen Fang541514.87
Xiaohui Shen6127850.50
jianchao yang77508282.48
Pan Zhou812316.76
Zhangyang Wang943775.27