Name
Title | ||
|---|---|---|
Video stabilization to a global 3D frame of reference by fusing orientation sensor and image alignment data |
Abstract | ||
|---|---|---|
Estimating the 3D orientation of the camera in a video sequence within a global frame of reference is useful for video stabilization when displaying the video in a virtual 3D environment, as well as for accurate navigation and other applications. This task requires the input of orientation sensors attached to the camera to provide absolute 3D orientation in a geographical frame of reference. However, high-frequency noise in the sensor readings makes it impossible to achieve accurate orientation estimates required for visually stable presentation of video sequences that were acquired with a camera subject to jitter, such as a handheld camera or a vehicle mounted camera. On the other hand, image alignment has proven successful for image stabilization, providing accurate frame-to-frame orientation estimates but drifting over time due to error and bias accumulation and lacking absolute orientation. In this paper we propose a practical method for generating high accuracy estimates of the 3D orientation of the camera within a global frame of reference by fusing orientation estimates from an efficient image-based alignment method, and the estimates from an orientation sensor, overcoming the limitations of the component methods. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1109/ISMAR.2010.5643595 | Mixed and Augmented Reality |
Keywords | Field | DocType |
image fusion,image sequences,jitter,solid modelling,video cameras,video signal processing,3D orientation estimation,frame-to-frame orientation,geographical frame,global 3D frame,handheld camera,high frequency noise,image based alignment method,image stabilization,orientation sensor fusion,vehicle mounted camera,video sequence,video stabilization,virtual 3D environment | Reference frame,Computer vision,Image fusion,Computer science,Image stabilization,Image processing,Video tracking,Artificial intelligence,Jitter,Frame of reference,Three-CCD camera | Conference |
ISBN | Citations | PageRank |
978-1-4244-9345-6 | 4 | 0.43 |
References | Authors | |
3 | 4 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Oscar Nestares | 1 | 134 | 12.37 |
| Yoram Gat | 2 | 15 | 2.41 |
| Horst Haussecker | 3 | 596 | 63.76 |
| Igor Kozintsev | 4 | 485 | 55.33 |