Title
Time slice video synthesis by robust video alignment
Abstract
Time slice photography is a popular effect that visualizes the passing of time by aligning and stitching multiple images capturing the same scene at different times together into a single image. Extending this effect to video is a difficult problem, and one where existing solutions have only had limited success. In this paper, we propose an easy-to-use and robust system for creating time slice videos from a wide variety of consumer videos. The main technical challenge we address is how to align videos taken at different times with substantially different appearances, in the presence of moving objects and moving cameras with slightly different trajectories. To achieve a temporally stable alignment, we perform a mixed 2D-3D alignment, where a rough 3D reconstruction is used to generate sparse constraints that are integrated into a pixelwise 2D registration. We apply our method to a number of challenging scenarios, and show that we can achieve a higher quality registration than prior work. We propose a 3D user interface that allows the user to easily specify how multiple videos should be composited in space and time. Finally, we show that our alignment method can be applied in more general video editing and compositing tasks, such as object removal.
Year
DOI
Venue
2017
10.1145/3072959.3073612
ACM Trans. Graph.
Keywords
Field
DocType
time slice,video alignment,3D reconstruction,SIFT flow,video compositing
Computer vision,Image stitching,Preemption,3d user interface,Computer graphics (images),Computer science,Video editing,Video tracking,Photography,Artificial intelligence,Compositing,3D reconstruction
Journal
Volume
Issue
ISSN
36
4
0730-0301
Citations 
PageRank 
References 
2
0.37
19
Authors
4
Name
Order
Citations
PageRank
Zhaopeng Cui19316.66
Oliver Wang296952.27
Ping Tan3173986.98
Jue Wang42871155.89