Title
Coherent Video Generation For Multiple Hand-Held Cameras With Dynamic Foreground
Abstract
For many social events such as public performances, multiple hand-held cameras may capture the same event. This footage is often collected by amateur cinematographers who typically have little control over the scene and may not pay close attention to the camera. For these reasons, each individually captured video may fail to cover the whole time of the event, or may lose track of interesting foreground content such as a performer. We introduce a new algorithm that can synthesize a single smooth video sequence of moving foreground objects captured by multiple hand-held cameras. This allows later viewers to gain a cohesive narrative experience that can transition between different cameras, even though the input footage may be less than ideal. We first introduce a graph-based method for selecting a good transition route. This allows us to automatically select good cut points for the hand-held videos, so that smooth transitions can be created between the resulting video shots. We also propose a method to synthesize a smooth photorealistic transition video between each pair of hand-held cameras, which preserves dynamic foreground content during this transition. Our experiments demonstrate that our method outperforms previous state-of-the-art methods, which struggle to preserve dynamic foreground content.
Year
DOI
Venue
2020
10.1007/s41095-020-0187-3
COMPUTATIONAL VISUAL MEDIA
Keywords
DocType
Volume
video editing, smooth temporal transitions, dynamic foreground, multiple cameras, hand-held cameras
Journal
6
Issue
ISSN
Citations 
3
2096-0433
1
PageRank 
References 
Authors
0.35
0
5
Name
Order
Citations
PageRank
Fang-Lue Zhang126915.60
Connelly Barnes2172959.07
Hao-Tian Zhang3232.43
Junhong Zhao4277.02
Gabriel Salas510.35