Framework for layered 3D video streaming

This paper presents a layered framework for 3D-TV applications, combining multiview and depth-image based approaches in a scalable fashion. To solve the problem of missing data due to disocclusions, we add specific layers for coded oc clusion data and the edge-mask information for high-quality 3D rendering of key objects in the scene. We show how the same framework can be extended towards FTV applications by jointly addressing simulcast and multicast transmission. By adopting a distributed delivery architecture, new interesting properties can be realized such as shared processing for the creation and streaming of virtual viewpoints. In an extensive system discussion, we conclude that it is possible to adaptively implement our streaming applications using a cross-layered approach. Similarly, the concept of selective reliability optimization can be introduced into our system.

[1]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[2]  Azer Bestavros,et al.  Cache-and-Relay Streaming Media Delivery for Asynchronous Clients , 2002 .

[3]  Peter H. N. de With,et al.  Near-Future Streaming Framework for 3D-TV Applications , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[4]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[5]  Nick Feamster,et al.  Packet Loss Recovery for Streaming Video , 2002 .

[6]  Hui Zhang,et al.  Internet Multicast Video Delivery , 2005, Proceedings of the IEEE.

[7]  Alan F. Lippman,et al.  Video coding for streaming media delivery on the Internet , 2001, IEEE Trans. Circuits Syst. Video Technol..

[8]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[9]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[10]  S. B. Kang,et al.  Survey of image-based representations and compression techniques , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  Ds Dirk Farin,et al.  Automatic video segmentation employing object/camera modeling techniques , 2005 .

[12]  Calton Pu,et al.  Player for adaptive MPEG video streaming over the Internet , 1998, Other Conferences.

[13]  Marc Pollefeys,et al.  An evolutionary and optimised approach on 3D-TV , 2002 .