Paper Info
Title
Using graphics rendering contexts to enhance the real-time video coding for mobile cloud gaming
Abstract
The emerging cloud gaming service has been growing rapidly, but not yet able to reach mobile customers due to many limitations, such as bandwidth and latency. We introduce a 3D image warping assisted real-time video coding method that can potentially meet all the requirements of mobile cloud gaming. The proposed video encoder selects a set of key frames in the video sequence, uses the 3D image warping algorithm to interpolate other non-key frames, and encodes the key frames and the residues frames with an H.264/AVC encoder. Our approach is novel in taking advantage of the run-time graphics rendering contexts (rendering viewpoint, pixel depth, camera motion, etc.) from the 3D game engine to enhance the performance of video encoding for the cloud gaming service. The experiments indicate that our proposed video encoder has the potential to beat the state-of-art x264 encoder in the scenario of real-time cloud gaming. For example, by implementing the proposed method in a 3D tank battle game, we experimentally show that more than 2 dB quality improvement is possible.
Year
DOI
Venue
2011
10.1145/2072298.2072313
ACM Multimedia 2001
Keywords
DocType
Citations 
x264 encoder,video encoding,avc encoder,cloud gaming service,mobile cloud gaming,real-time video,key frame,proposed video encoder,real-time cloud gaming,video sequence,3d imaging,mobile device,quality improvement,mobile devices,real time
Conference
52
PageRank 
References 
Authors
2.39
13
4
Name
Order
Citations
PageRank
Shu Shi120416.62
Cheng-Hsin Hsu299181.56
Klara Nahrstedt37941636.63
Roy Campbell45133573.61