Title
Stereo matching with linear superposition of layers
Abstract
In this paper, we address stereo matching in the presence of a class of non-Lambertian effects, where image formation can be modeled as the additive superposition of layers at different depths. The presence of such effects makes it impossible for traditional stereo vision algorithms to recover depths using direct color matching-based methods. We develop several techniques to estimate both depths and colors of the component layers. Depth hypotheses are enumerated in pairs, one from each layer, in a nested plane sweep. For each pair of depth hypotheses, matching is accomplished using spatial-temporal differencing. We then use graph cut optimization to solve for the depths of both layers. This is followed by an iterative color update algorithm which we proved to be convergent. Our algorithm recovers depth and color estimates for both synthetic and real image sequences.
Year
DOI
Venue
2006
10.1109/TPAMI.2006.42
Pattern Analysis and Machine Intelligence, IEEE Transactions
Keywords
Field
DocType
graph theory,image colour analysis,image matching,image sequences,stereo image processing,depth hypotheses,direct color matching,graph cut optimization,image formation,image sequences,linear superposition,nonLambertian effects,stereo matching,Index Terms- Stereo matching,layer extraction,plane sweep.,reflection,transparency
Graph theory,Cut,Computer vision,Reflection (mathematics),Superposition principle,Computer science,Stereopsis,Image formation,Artificial intelligence,Motion analysis,Real image
Journal
Volume
Issue
ISSN
28
2
0162-8828
Citations 
PageRank 
References 
27
1.47
25
Authors
3
Name
Order
Citations
PageRank
Yanghai Tsin149742.10
Sing Bing Kang25064345.13
Richard Szeliski3213002104.74