Paper Info
Title
A Joint Guidance-Enhanced Perceptual Encoder and Atrous Separable Pyramid-Convolutions for Image Inpainting
Abstract
Satisfactory image inpainting requires visually-exquisite details and semantically-plausible structures, where encoder-decoder networks have shown their potentials but bear undesired local and global inconsistencies, such as blurry textures. To address this issue, we incorporate a perception operation in the encoder, which extracts features from known areas of the input image, to improve textured details in missing areas. We also propose an iterative guidance loss for the perception operation to guide perceptual encoding features approaching to ground-truth encoding features. The guidance-enhanced perceptual encoding features are transferred to the decoder through skip connections, mutually reinforcing the entire encoder–decoder performance. Since the inpainting task involves different levels of feature representations, we further apply atrous separable parallel-convolutions (i.e., atrous separable pyramid-convolutions or ASPC) with different receptive fields in the last guidance-enhanced perceptual encoding feature, which is used to learn high-level semantic features with multi-scale information. Experiments on public databases show that the proposed method achieves promising results in terms of visual details and semantic structures.
Year
DOI
Venue
2020
10.1016/j.neucom.2020.01.068
Neurocomputing
Keywords
DocType
Volume
Image inpainting,Perceptual encoder–decoder,Generative adversarial networks
Journal
396
ISSN
Citations 
PageRank 
0925-2312
0
0.34
References 
Authors
0
8
Name
Order
Citations
PageRank
Yongle Zhang1153.05
Yingyu Wang250.80
Junyu Dong39923.43
Lin Qi4278.68
Hao Fan503.04
Xinghui Dong6347.06
Muwei Jian723530.97
Hui Yu8399.98