Title
Bilateral filtering-based optical flow estimation with occlusion detection
Abstract
Using the variational approaches to estimate optical flow between two frames, the flow discontinuities between different motion fields are usually not distinguished even when an anisotropic diffusion operator is applied. In this paper, we propose a multi-cue driven adaptive bilateral filter to regularize the flow computation, which is able to achieve the smoothly varied optical flow field with highly desirable motion discontinuities. First, we separate the traditional one-step variational updating model into a two-step filtering-based updating model. Then, employing our occlusion detector, we reformulate the energy functional of optical flow estimation by explicitly introducing an occlusion term to balance the energy loss due to the occlusion or mismatches. Furthermore, based on the two-step updating framework, a novel multi-cue driven bilateral filter is proposed to substitute the original anisotropic diffusion process, and it is able to adaptively control the diffusion process according to the occlusion detection, image intensity dissimilarity, and motion dissimilarity. After applying our approach on various video sources (movie and TV) in the presence of occlusion, motion blurring, non-rigid deformation, and weak textureness, we generate a spatial-coherent flow field between each pair of input frames and detect more accurate flow discontinuities along the motion boundaries.
Year
DOI
Venue
2006
10.1007/11744023_17
ECCV
Keywords
Field
DocType
spatial-coherent flow field,optical flow field,occlusion detection,optical flow estimation,accurate flow discontinuity,desirable motion discontinuity,flow discontinuity,optical flow,flow computation,motion boundary,different motion field,bilateral filtering-based optical flow,bilateral filtering,anisotropic diffusion,diffusion process,adaptive control
Anisotropic diffusion,Computer vision,Computer science,Discontinuity (linguistics),Filter (signal processing),Image processing,Adaptive filter,Artificial intelligence,Energy functional,Bilateral filter,Optical flow
Conference
Volume
ISSN
ISBN
3951
0302-9743
3-540-33832-2
Citations 
PageRank 
References 
111
5.08
18
Authors
5
Search Limit
100111
Name
Order
Citations
PageRank
Jiangjian Xiao150927.19
Hui Cheng221517.34
Harpreet Sawhney326514.93
Cen Rao455134.74
Michael A. Isnardi51388.76