Title
Disparity estimation in stereo video sequence with adaptive spatiotemporally consistent constraints
Abstract
Numerous stereo matching algorithms have been proposed to obtain disparity estimation for a single pair of stereo images. However, simply even applying the best of them to temporal frames independently, i.e., without considering the temporal consistency between consecutive frames, may suffer from the undesirable artifacts. Here, we proposed an adaptive, spatiotemporally consistent, constraints-based systematic method that generates spatiotemporally consistent disparity maps for stereo video image sequences. Firstly, a reliable temporal neighborhood is used to enforce the “self-similarity” assumption and prevent errors caused by false optical flow matching from propagating between consecutive frames. Furthermore, we formulate the adaptive temporal predicted disparity map as prior knowledge of the current frame. It is used as a soft constraint to enhance the temporal consistency of disparities, increase the robustness to luminance variance, and restrict the range of the potential disparities for each pixel. Additionally, to further strengthen smooth variation of disparities, the adaptive temporal segment confidence is incorporated as a soft constraint to reduce ambiguities caused by under- and over-segmentation, and retain the disparity discontinuities that align with 3D object boundaries from geometrically smooth, but strong color gradient regions. Experimental evaluations demonstrate that our method significantly improves the spatiotemporal consistency both quantitatively and qualitatively compared with other state-of-the-art methods on the synthetic DCB and realistic KITTI datasets.
Year
DOI
Venue
2019
10.1007/s00371-018-01622-1
The Visual Computer
Keywords
Field
DocType
Spatiotemporally consistent, Adaptive temporal segment confidence, Adaptive temporal predicted disparity, Reliable temporal neighborhood
Stereo matching,Computer vision,Classification of discontinuities,Computer science,Robustness (computer science),Artificial intelligence,Pixel,Luminance,Optical flow,Temporal consistency,Color gradient
Journal
Volume
Issue
ISSN
35
10
1432-2315
Citations 
PageRank 
References 
0
0.34
28
Authors
4
Name
Order
Citations
PageRank
Liang Tian100.68
Jing Liu200.68
Haibin Ling34531215.76
Wei Guo400.68