Title
Low-latency cloud-based volumetric video streaming using head motion prediction
Abstract
Volumetric video is an emerging key technology for immersive representation of 3D spaces and objects. Rendering volumetric video requires lots of computational power which is challenging especially for mobile devices. To mitigate this, we developed a streaming system that renders a 2D view from the volumetric video at a cloud server and streams a 2D video stream to the client. However, such network-based processing increases the motion-to-photon (M2P) latency due to the additional network and processing delays. In order to compensate the added latency, prediction of the future user pose is necessary. We developed a head motion prediction model and investigated its potential to reduce the M2P latency for different look-ahead times. Our results show that the presented model reduces the rendering errors caused by the M2P latency compared to a baseline system in which no prediction is performed.
Year
DOI
Venue
2020
10.1145/3386290.3396933
MMSys '20: 11th ACM Multimedia Systems Conference Istanbul Turkey June, 2020
Keywords
DocType
ISBN
volumetric video, augmented reality, mixed reality, cloud streaming, head motion prediction
Conference
978-1-4503-7945-8
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Serhan Gül122.74
Dimitri Podborski213.15
Buchholz Thomas301.01
Thomas Schierl456358.53
C. Hellge532832.26