Title
Image inpainting through neural networks hallucinations
Abstract
We consider in this paper the problem of image inpainting, where the objective is to reconstruct large continuous regions of missing or deteriorated parts of an image. Traditional in-painting algorithms are unfortunately not well adapted to handle such corruptions as they rely on image processing techniques that cannot properly infer missing information when the corrupted holes are too large. To tackle this problem, we propose a novel approach where we rely on the hallucinations of pre-trained neural networks to fill large holes in images. To generate globally coherent images, we further impose smoothness and consistency regularization, thereby constraining the neural network hallucinations. Through illustrative experiments, we show that pre-trained neural networks contain crucial prior information that can effectively guide the reconstruction process of complex inpainting problems.
Year
DOI
Venue
2016
10.1109/IVMSPW.2016.7528221
2016 IEEE 12th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP)
Keywords
Field
DocType
Inpainting,neural networks,graph-based regularization,hallucination,image completion
Iterative reconstruction,Computer vision,Pattern recognition,Image processing,Inpainting,Regularization (mathematics),Artificial intelligence,Inverse problem,Artificial neural network,Smoothness,Mathematics
Conference
ISBN
Citations 
PageRank 
978-1-5090-1930-4
1
0.35
References 
Authors
4
4
Name
Order
Citations
PageRank
Alhussein Fawzi176636.80
Horst Samulowitz231626.05
Deepak S. Turaga356448.11
Pascal Frossard43015230.41