Title
Self-supervised GAN for Image Generation by Correlating Image Channels.
Abstract
Current most GAN-based methods directly generate all channels of a color image as a whole, while digging self-supervised information from the correlation between image channels for improving image generation has not been investigated. In this paper, we consider that a color image could be split into multiple sets of channels in terms of channels' semantic, and these sets of channels are closely related rather than completely independent. By leveraging this characteristic of color images, we introduce self-supervised learning into the GAN framework, and propose a generative model called Self-supervised GAN. Specifically, we explicitly decompose the generation process as follows: (1) generate image channels, (2) correlate image channels, (3) concatenate image channels into the whole image. Based on these operations, we not only perform a basic adversarial learning task for generating images, but also construct an auxiliary self-supervised learning task for further regularizing generation procedures. Experimental results demonstrate that the proposed method can improve image generation compared with representative methods and possess capabilities of image colorization and image texturization.
Year
DOI
Venue
2018
10.1007/978-3-030-00767-6_8
ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II
Keywords
Field
DocType
Image generation,GAN,Self-supervised learning
Computer vision,Self supervised learning,Image generation,Image colorization,Pattern recognition,Computer science,Communication channel,Concatenation,Artificial intelligence,Generative model,Color image
Conference
Volume
ISSN
Citations 
11165
0302-9743
0
PageRank 
References 
Authors
0.34
20
5
Name
Order
Citations
PageRank
Sheng Qian1194.02
Wen-Ming Cao22611.53
Rui Li320959.97
Si Wu4177.03
Hau-San Wong5100886.89