Title
Linear Sequence-to-Sequence Alignment
Abstract
In this paper, we consider the problem of estimating the spatiotemporal alignment between N unsynchronized video sequences of the same dynamic 3D scene, captured from distinct viewpoints. Unlike most existing methods, which work for N=2 and rely on a computationally intensive search in the space of temporal alignments, we present a novel approach that reduces the problem for general N to the robust estimation of a single line in {{\hbox{\rlap{I}\kern 2.0pt{\hbox{R}}}}}^{N}. This line captures all temporal relations between the sequences and can be computed without any prior knowledge of these relations. Considering that the spatial alignment is captured by the parameters of fundamental matrices, an iterative algorithm is used to refine simultaneously the parameters representing the temporal and spatial relations between the sequences. Experimental results with real-world and synthetic sequences show that our method can accurately align the videos even when they have large misalignments (e.g., hundreds of frames), when the problem is seemingly ambiguous (e.g., scenes with roughly periodic motion), and when accurate manual alignment is difficult (e.g., due to slow-moving objects).
Year
DOI
Venue
2010
10.1109/TPAMI.2008.301
IEEE Trans. Pattern Anal. Mach. Intell.
Keywords
Field
DocType
temporal alignment,computationally intensive search,temporal relation,spatiotemporal alignment,accurate manual alignment,linear sequence-to-sequence alignment,spatial relation,spatial alignment,general n,distinct viewpoint,single line,iterative algorithm,layout,metrology,iterative methods,geometry,robust estimator,epipolar geometry,robustness,object tracking,calibration,sequence alignment
Spatial relation,Computer vision,Epipolar geometry,Pattern recognition,Iterative method,Computer science,Image processing,Robustness (computer science),Video tracking,Artificial intelligence,Image registration,Spatial database
Journal
Volume
Issue
ISSN
32
2
0162-8828
Citations 
PageRank 
References 
19
0.77
19
Authors
4
Name
Order
Citations
PageRank
Flávio L. C. Pádua110210.88
Carceroni, R.L.2875.93
Geraldo A M R Santos3190.77
Kiriakos N. Kutulakos41801124.82