Name
Title | ||
|---|---|---|
Reference frame selection for loss-resilient texture & depth map coding in multiview video conferencing |
Abstract | ||
|---|---|---|
In a free-viewpoint video conferencing system, the viewer can choose any desired viewpoint of the 3D scene for observation. Rendering of images for arbitrarily chosen viewpoint can be achieved through depth-image-based rendering (DIBR), which typically employs “texture-plus-depth” video format for 3D data exchange. Robust and timely transmission of multiple texture and depth maps over bandwidth-constrained and loss-prone networks is a challenging problem. In this paper, we optimize transmission of multiview video in texture-plus-depth format over a lossy channel for free viewpoint synthesis at decoder. In particular, we construct a recursive model to estimate the distortion in synthesized view due to errors in both texture and depth maps, and formulate a rate-distortion optimization problem to select reference pictures for macroblock encoding in H.264 in a computation-efficient way, in order to provide unequal protection to different macroblocks. Results show that the proposed scheme can outperform random insertion of intra refresh blocks by up to 0.73 dB at 5% loss. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1109/ICIP.2012.6467194 | Image Processing |
Keywords | Field | DocType |
data compression,decoding,image texture,optimisation,rate distortion theory,recursive estimation,rendering (computer graphics),signal synthesis,teleconferencing,video coding,3D data exchange,3D scene,DIBR,H.264,bandwidth-constrained networks,decoder,depth map coding,depth-image-based rendering,distortion estimation,free viewpoint synthesis,free-viewpoint video conferencing system,loss-prone networks,loss-resilient texture,lossy channel,multiview video conferencing,rate-distortion optimization problem,recursive estimation model,reference frame selection,texture-plus-depth video format,unequal protection,Depth-image-based rendering,video streaming | Macroblock,Computer vision,Texture compression,Video post-processing,Pattern recognition,Real-time rendering,Image texture,Computer science,Multiview Video Coding,Artificial intelligence,Data compression,Rendering (computer graphics) | Conference |
ISSN | ISBN | Citations |
1522-4880 E-ISBN : 978-1-4673-2532-5 | 978-1-4673-2532-5 | 6 |
PageRank | References | Authors |
0.45 | 0 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Bruno Macchiavello | 1 | 77 | 8.78 |
| Camilo C. Dorea | 2 | 95 | 10.02 |
| Edson M. Hung | 3 | 60 | 6.15 |
| Gene Cheung Connie Chan | 4 | 1387 | 121.82 |
| Wai-tian Tan | 5 | 672 | 78.92 |