Title
Joint rendering and segmentation of free-viewpoint video
Abstract
This paper presents a method that jointly performs synthesis and object segmentation of free-viewpoint video using multiview video as the input. This method is designed to achieve robust segmentation from online video input without per-frame user interaction and precomputations. This method shares a calculation process between the synthesis and segmentation steps; the matching costs calculated through the synthesis step are adaptively fused with other cues depending on the reliability in the segmentation step. Since the segmentation is performed for arbitrary viewpoints directly, the extracted object can be superimposed onto another 3D scene with geometric consistency. We can observe that the object and new background move naturally along with the viewpoint change as if they existed together in the same space. In the experiments, our method can process online video input captured by a 25-camera array and show the result image at 4.55 fps.
Year
DOI
Venue
2010
10.1155/2010/763920
EURASIP J. Image and Video Processing
Keywords
DocType
Volume
25-camera array,method share,object segmentation,calculation process,joint rendering,synthesis step,segmentation step,multiview video,online video input,free-viewpoint video,robust segmentation
Journal
2010,
Issue
ISSN
Citations 
1
1687-5281
0
PageRank 
References 
Authors
0.34
14
3
Name
Order
Citations
PageRank
Masato Ishii152.82
Keita Takahashi28212.04
Takeshi Naemura361195.07