Title
A Cloud-Based Multi-threaded Implementation of View Synthesis System
Abstract
In multiview video applications, view synthesis is a computationally intensive task that needs to be done correctly and efficiently in order to deliver a seamless user experience. In order to provide fast and efficient view synthesis, in this paper, we present a cloud-based implementation that will be especially beneficial to mobile users whose devices may not be powerful enough for high quality view synthesis. Our proposed implementation balances the view synthesis algorithm's components across multiple threads and utilizes the computational capacity of modern CPUs for faster and higher quality view synthesis. For arbitrary view generation, we utilize the depth map of the scene from the cameras' viewpoint and estimate the depth information conceived from the virtual camera. The estimated depth is then used in a backward direction to warp the cameras' image onto the virtual view. Finally, we use a depth-aided inpainting strategy for the rendering step to reduce the effect of disocclusion regions (holes) and to paint the missing pixels. For our cloud implementation, we employed an automatic scaling feature to offer elasticity in order to adapt the service load according to the fluctuating user demands. Our performance results using 4 multiview videos over 2 different scenarios show that our proposed system achieves average improvement of around 1.7 times for speedup, 50% and 52% for efficiency and resource utilization, respectively.
Year
DOI
Venue
2017
10.1109/ISM.2017.37
2017 IEEE International Symposium on Multimedia (ISM)
Keywords
Field
DocType
View synthesis,cloud computing,elasticity,multi-threading,warping,homography
Computer vision,User experience design,Computer science,Server,View synthesis,Real-time computing,Inpainting,Artificial intelligence,Depth map,Rendering (computer graphics),Cloud computing,Speedup
Conference
ISBN
Citations 
PageRank 
978-1-5386-2938-3
0
0.34
References 
Authors
9
4
Name
Order
Citations
PageRank
Parvaneh Pouladzadeh100.34
Razib Iqbal26011.93
Shervin Shirmohammadi31066125.81
Omid Fatemi47815.71