Analysis of compressed depth and image streaming on unreliable networks

This paper explores the issues connected to the transmission of three dimensional scenes over unreliable networks such as the wireless ones. It analyzes the effect of the loss of compressed data packets in a typical image-based rendering scenario, where a set of compressed images together with the corresponding depth maps are transmitted and used to generate the views required from the user at client side. The different impact on the rendered views of the geometry and texture packets is analyzed in detail, taking into account also the position of the lost packets and the warping operation. Finally we will discuss how to exploit this results in the design of an efficient network protocol for the transmission of 3D models.

[1]  David S. Taubman,et al.  Server Policies For Interactive Transmission Of 3D Scenes , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[2]  Luca Ballan,et al.  Multimodal 3D Shape Recovery from Texture, Silhouette and Shadow Information , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[3]  Michael W. Marcellin,et al.  Decompression of corrupt JPEG2000 codestreams , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[4]  Anup Basu,et al.  Perceptually optimized 3D transmission over wireless networks , 2005, SIGGRAPH '05.

[5]  Robert Prandolini,et al.  Architecture, philosophy, and performance of JPIP: internet protocol standard for JPEG2000 , 2003, Visual Communications and Image Processing.

[6]  Bane V. Vasic,et al.  Unequal error protection and progressive decoding for JPEG2000 , 2005, IEEE International Conference on Image Processing 2005.

[7]  Bing-Yu Chen,et al.  3D Model Streaming Based on JPEG 2000 , 2007, IEEE Transactions on Consumer Electronics.

[8]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[9]  Irene Cheng,et al.  Packet Loss Modeling for Perceptually Optimized 3D Transmission , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[10]  Bane V. Vasic,et al.  Unequal error protection and progressive decoding for JPEG2000 , 2005, ICIP.

[11]  David S. Taubman,et al.  A novel framework for the interactive transmission of 3D scenes , 2006, Signal Process. Image Commun..