Name
Title | ||
|---|---|---|
Optimizing frame structure for interactive multiview video streaming with viewsynthesis |
Abstract | ||
|---|---|---|
Traditional multiview video coding schemes compress all captured video frames exploiting all possible inter-view and temporal frame correlation for coding gain, creating complex inter-frame dependencies in the process. In contrast, interactive multiview video streaming (IMVS) demands data navigation flexibility in the frame structure design, so that server can send only a single periodically selected video view for decoding and display at client, saving transmission bandwidth. In this paper, we generalize previous IMVS frame structure optimization to allow a client to request an arbitrary virtual view; i.e., the server sends two adjacent coded views for the client to synthesize the desired virtual view. Since existing IMVS schemes transmit only one view at a time, they employ only cross-time pre diction; i.e., the frame of previous time instant from which the client switches is used as predictor for the requested view. In our new scenario, two coded views are transmitted, thus within-time prediction can also be used, where the coded frame of one transmitted view is used to predict the frame of the other view of same time instant. Using I-frames, P-frames and Merge (M-) frames as building blocks, we formulate a Lagrangian problem to find the optimal frame structure for a desired storage/streaming rate tradeoff, with the right mixture of cross-time / within-time prediction types. Experiments show that for the same storage cost, the expected streaming rate of the proposed structure can be 40% lower than that of the I-frame-only structure, and 9% lower than that of the structure using M-frames but with cross-time prediction only. |
Year | DOI | Venue |
|---|---|---|
2011 | 10.1109/ICME.2011.6012165 | ICME |
Keywords | Field | DocType |
interactive multiview video,imvs,optimisation,i-frame building block,client switch,complex interframe dependency,requested view,storage-streaming rate tradeoff,transmitted view,multiview video coding scheme,previous time instant frame,data compression,interactive multiview video streaming,p-frame building block,temporal frame correlation,previous imvs frame structure,frame structure design,merge frame building block,video coding,m-frame building block,arbitrary virtual view,coding gain,interview frame correlation,cross-time-within-time prediction,prediction theory,multiview video,video streaming,data navigation,view interpolation / synthesis,virtual view,video view,optimal frame structure,decoding,lagrangian problem,video frame,optimizing frame structure,cross-time prediction,irrigation,indexing terms,indexes,multiview video coding | Reference frame,Computer vision,Coding gain,Computer science,Video streaming,Multiview Video Coding,Real-time computing,Residual frame,Artificial intelligence,Decoding methods,Data compression,Fold (higher-order function) | Conference |
ISSN | ISBN | Citations |
1945-7871 E-ISBN : 978-1-61284-349-0 | 978-1-61284-349-0 | 1 |
PageRank | References | Authors |
0.35 | 6 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Xiaoyu Xiu | 1 | 94 | 12.99 |
| Gene Cheung Connie Chan | 2 | 1387 | 121.82 |
| Antonio Ortega | 3 | 4720 | 493.26 |
| Jie Liang | 4 | 707 | 80.89 |