Title
Patch-based self-adaptive matting for high-resolution image and video.
Abstract
We propose an efficient patch-based self-adaptive matting approach to reduce memory consumption in processing high-resolution image and video. Most existing image matting techniques employ a global optimization over the whole set of image pixels, incurring a prohibitively high memory consumption, especially in high-resolution images. Inspired by “divide-and-conquer,” we divide the images into small patches in a self-adaptive way according to the distribution of unknown pixels and handle the small patches one by one. The alpha mattes in patch level are combined according to the weights. Relationships between patches are also considered by locally linear embedding to maintain consistency through the whole image. We also extend the framework to video matting with considering the temporal coherence of alpha mattes. A sampling method is applied to speed up the operation of video sampling. A multi-frame graph model is also proposed to enhance temporal and spatial consistency which can be solved efficiently by Random Walk. Experimental results show that the proposed method significantly reduces memory consumption while maintaining high-fidelity matting results on the benchmark dataset.
Year
DOI
Venue
2019
10.1007/s00371-017-1424-3
The Visual Computer
Keywords
Field
DocType
Matting, Patch division, High resolution
Computer vision,Embedding,Global optimization,Random walk,High memory,Computer science,Coherence (physics),Sampling (statistics),Pixel,Artificial intelligence,Speedup
Journal
Volume
Issue
ISSN
35
1
1432-2315
Citations 
PageRank 
References 
0
0.34
21
Authors
4
Name
Order
Citations
PageRank
Guangying Cao191.13
Li Jianwei211417.71
Xiaowu Chen360545.05
Zhiqiang He483.52