Title
Context-Aware Three-Dimensional Mean-Shift With Occlusion Handling for Robust Object Tracking in RGB-D Videos
Abstract
Depth cameras have recently become popular and many vision problems can be better solved with depth information. But, how to integrate depth information into a visual tracker to overcome the challenges such as occlusion and background distraction is still underinvestigated in current literature on visual tracking. In this paper, we investigate a 3-D extension of a classical mean-shift tracker whose greedy gradient ascend strategy is generally considered as unreliable in conventional 2-D tracking. However, through careful study of the physical property of 3-D point clouds, we reveal that objects which may appear to be adjacent on a 2-D image will form distinctive modes in the 3-D probability distribution approximated by kernel density estimation, and finding the nearest mode using 3-D mean-shift can always work in tracking. Based on the understanding of 3-D mean-shift, we propose two important mechanisms to further boost the tracker's robustness: one is to enable the tracker to be aware of potential distractions and make corresponding adjustments to the appearance model; and the other is to enable the tracker to detect and recover from tracking failures caused by total occlusion. The proposed method is both effective and computationally efficient. On a conventional personal computer, it runs at more than 60 FPS without graphical processing unit acceleration.
Year
DOI
Venue
2019
10.1109/TMM.2018.2863604
IEEE Transactions on Multimedia
Keywords
Field
DocType
Three-dimensional displays,Target tracking,Cameras,Two dimensional displays,Image color analysis,Histograms
Histogram,Computer vision,Pattern recognition,Computer science,Personal computer,Active appearance model,Robustness (computer science),Video tracking,Eye tracking,Artificial intelligence,Mean-shift,Kernel density estimation
Journal
Volume
Issue
ISSN
21
3
1520-9210
Citations 
PageRank 
References 
4
0.55
0
Authors
6
Name
Order
Citations
PageRank
Ye Liu183.34
Xiao-Yuan Jing276955.18
Jianhui Nie340.89
Hao Gao486.38
Jun Liu567130.44
Guo-Ping Jiang6256.26