Title
Differential Camera Tracking through Linearizing the Local Appearance Manifold
Abstract
The appearance of a scene is a function of the scene contents, the lighting, and the camera pose. A set of n-pixel images of a non-degenerate scene captured from different perspectives lie on a 6D nonlinear manifold in Rn. In general, this nonlinear manifold is complicated and numerous samples are required to learn it globally. In this paper, we present a novel method and some preliminary results for incrementally tracking camera motion through sampling and linearizing the local appearance manifold. At each frame time, we use a cluster of calibrated and synchronized small baseline cameras to capture scene appearance samples at different camera poses. We compute a first-order approximation of the appearance manifold around the current camera pose. Then, as new cluster samples are captured at the next frame time, we estimate the incremental camera motion using a linear solver. By using intensity measurements and directly sampling the appearance manifold, our method avoids the commonly-used feature extraction and matching processes, and does not require 3D correspondences across frames. Thus it can be used for scenes with complicated surface materials, geometries, and view-dependent appearance properties, situations where many other camera tracking methods would fail.
Year
DOI
Venue
2007
10.1109/CVPR.2007.382978
CVPR
Keywords
Field
DocType
image matching,nondegenerate scene,linear solver,target tracking,first-order approximation,linear programming,pixel images,motion estimation,image sampling,feature extraction,appearance manifold,matching processes,nonlinear manifold,scene appearance samples,differential camera tracking,camera motion tracking,lighting,sampling methods,parametric statistics,first order approximation,linear approximation,data mining,cluster sampling,layout
Computer vision,Pattern recognition,Computer science,Camera auto-calibration,Feature extraction,Camera resectioning,Sampling (statistics),Artificial intelligence,Linear programming,Motion estimation,Cluster sampling,Manifold
Conference
Volume
Issue
ISSN
2007
1
1063-6919 E-ISBN : 1-4244-1180-7
ISBN
Citations 
PageRank 
1-4244-1180-7
5
0.71
References 
Authors
15
5
Name
Order
Citations
PageRank
Hua Yang150.71
Marc Pollefeys27671475.90
Greg Welch31595186.21
Jan-Michael Frahm42847141.20
Adrian Ilie516615.20