Title
A deep learning network based end-to-end image composition
Abstract
Currently, high-quality image composition largely depends on multiple user interactions and complex manual operations. In particular, the process of composition object extraction and region determination has become a burden that cannot be underestimated, restricting wider applications. Aiming at this problem, we propose an end-to-end image composition method that combines powerful deep-learning-based application modules such as image retrieval and instance segmentation to realize efficient non-interactive image composition. Specifically, the retrieval module, which is based on the attention mechanism, can determine semantically similar material images. Moreover, the content of interest (COI) extraction and optimization procedure is able to select the most proper instance among the material images. Finally, we propose the double-sieving strategy, which locates the best composition position in the target image. Using these effective modules, we carried out niche targeting experiments using an image database with high plausibility. The realistic experimental results illustrate that our method can achieve effective and reasonable end-to-end image composition.
Year
DOI
Venue
2022
10.1016/j.image.2021.116570
Signal Processing: Image Communication
Keywords
DocType
Volume
Image composition,End-to-end,Background retrieval,Instance optimization,Double-sieving region location
Journal
101
ISSN
Citations 
PageRank 
0923-5965
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Xiaoyu Zhu100.34
Haodi Wang231.39
Zhiyi Zhang300.34
Xiuping Wu400.34
Junqi Guo500.34
Hao Wu614318.69