Title
Vision based data fusion for autonomous vehicles target tracking using interacting multiple dynamic models
Abstract
In this paper, a novel algorithm is proposed for the vision-based object tracking by autonomous vehicles. To estimate the velocity of the tracked object, the algorithm fuses the information captured by the vehicle's on-board sensors such as the cameras and inertial motion sensors. Optical flow vectors, color features, stereo pair disparities are used as optical features while the vehicle's inertial measurements are used to determine the cameras' motion. The algorithm determines the velocity and position of the target in the world coordinate which are then tracked by the vehicle. In order to formulate this tracking algorithm, it is necessary to use a proper model which describes the dynamic information of the tracked object. However due to the complex nature of the moving object, it is necessary to have robust and adaptive dynamic models. Here, several simple and basic linear dynamic models are selected and combined to approximate the unpredictable, complex or highly nonlinear dynamic properties of the moving target. With these basic linear dynamic models, a detailed description of the three-dimensional (3D) target tracking scheme using the Interacting Multiple Models (IMM) along with an Extended Kalman Filter is presented. The final state of the target is estimated as a weighted combination of the outputs from each different dynamic model. Performance of the proposed fusion based IMM tracking algorithm is demonstrated through extensive experimental results.
Year
DOI
Venue
2008
10.1016/j.cviu.2006.12.001
Computer Vision and Image Understanding
Keywords
Field
DocType
tracked object,sensor data fusion,interacting multiple dynamic model,different dynamic model,image segmentation and clustering,target tracking scheme,kinematic model,imm tracking algorithm,dynamic information,extended kalman filtering,basic linear dynamic model,nonlinear dynamic property,template matching and updating,novel algorithm,autonomous vehicles,interacting multiple models (imm),linear dynamics model,target tracking,stereo vision,autonomous vehicle,data fusion,adaptive dynamic model,optical flow,pinhole camera projection model,tracking algorithm,nonlinear dynamics,template matching,image segmentation,extended kalman filter,three dimensional,object tracking
Inertial navigation system,Computer vision,Extended Kalman filter,Stereopsis,Kalman filter,Sensor fusion,Image segmentation,Video tracking,Artificial intelligence,Optical flow,Mathematics
Journal
Volume
Issue
ISSN
109
1
Computer Vision and Image Understanding
Citations 
PageRank 
References 
12
0.75
20
Authors
3
Name
Order
Citations
PageRank
Zhen Jia1585.53
Arjuna Balasuriya2645.17
Subhash Challa325224.96