Title
Oriented Light-Field Windows for Scene Flow
Abstract
2D spatial image windows are used for comparing pixel values in computer vision applications such as correspondence for optical flow and 3D reconstruction, bilateral filtering, and image segmentation. However, pixel window comparisons can suffer from varying defocus blur and perspective at different depths, and can also lead to a loss of precision. In this paper, we leverage the recent use of light-field cameras to propose alternative oriented light-field windows that enable more robust and accurate pixel comparisons. For Lambertian surfaces focused to the correct depth, the 2D distribution of angular rays from a pixel remains consistent. We build on this idea to develop an oriented 4D light-field window that accounts for shearing (depth), translation (matching), and windowing. Our main application is to scene flow, a generalization of optical flow to the 3D vector field describing the motion of each point in the scene. We show significant benefits of oriented light-field windows over standard 2D spatial windows. We also demonstrate additional applications of oriented light-field windows for bilateral filtering and image segmentation.
Year
DOI
Venue
2015
10.1109/ICCV.2015.399
ICCV
Field
DocType
Volume
Computer vision,Euclidean vector,Computer graphics (images),Computer science,Shearing (physics),Image segmentation,Light field,Artificial intelligence,Pixel,Bilateral filter,Optical flow,3D reconstruction
Conference
2015
Issue
ISSN
Citations 
1
1550-5499
6
PageRank 
References 
Authors
0.41
21
4
Name
Order
Citations
PageRank
Srinivasan, P.P.18110.65
Michael W. Tao222511.75
Ren Ng390260.47
Ravi Ramamoorthi44481237.21