Stereoscopic TV over IP

Immersive media content provides a more natural representation of real world information compared to conventional two-dimensional video. In the near future, video applications will be replaced by immersive media with the technological advancements of three-dimensional video capture technologies, efficient multi-view compression algorithms, ever increasing bandwidth of communication links and three-dimensional video display techniques. This paper envisages an application scenario of stereoscopic TV over IP networks. The colour and depth/disparity videos are considered as the main source of stereoscopic video material. Furthermore, this paper proposes a methodology to encode colour and depth video asymmetrically using the layered architecture of the scalable extension of H.264/AVC. The proposed asymmetric coding method achieves high image quality for the rendered left and right videos at low overall bitrates compared to the bitrate requirements of existing IP TV applications. The proposed method can be used to scale existing IP TV applications into stereoscopic TV with a minimum overhead increase while guaranteeing high quality depth perception. Finally the performance of stereoscopic TV content over IP networks is analyzed. This concludes that the image quality of the rendered stereoscopic video over IP can be vastly improved by prioritizing the colour video packets ahead of depth video packets.

[1]  M Kawakita,et al.  Axi-vision camera (real-time distance-mapping camera). , 2000, Applied optics.

[2]  André Vincent,et al.  Stereo image quality: effects of mixed spatio-temporal resolution , 2000, IEEE Trans. Circuits Syst. Video Technol..

[3]  Zhaoyang Zhang,et al.  Data compression of stereoscopic image pairs , 2001, International Symposium on Multispectral Image Processing and Pattern Recognition.

[4]  G. Iddan,et al.  3D IMAGING IN THE STUDIO (AND ELSEWHERE...) , 2001 .

[5]  Janusz Konrad,et al.  Visual communications of tomorrow: natural, efficient, and flexible , 2001, IEEE Commun. Mag..

[6]  Wijnand A. IJsselsteijn,et al.  A survey of perceptual quality issues in three-dimensional television systems , 2003, IS&T/SPIE Electronic Imaging.

[7]  Nick Holliman,et al.  3D Display Systems , 2003 .

[8]  C. Fehn.  A 3 DTV Approach Using Depth-Image-Based Rendering ( DIBR ) , 2003 .

[9]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[10]  Klaus Hopf,et al.  Key technologies for an advanced 3D TV system , 2004, SPIE Optics East.

[11]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[12]  Neil A. Dodgson,et al.  Autostereoscopic 3D displays , 2005, Computer.

[13]  A. Murat Tekalp,et al.  Temporal and spatial scaling for stereoscopic video compression , 2006, 2006 14th European Signal Processing Conference.

[14]  C. Fehn,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006 .

[15]  Ahmet M. Kondoz,et al.  Comparison of stereo video coding support in MPEG-4 MAC, H.264/AVC and H.264/SVC , 2007 .

[16]  A. Navarro.  SUIT-Scalable, Ultra-fast and Interoperable Interactive Television , 2007, 2007 IEEE International Symposium on Consumer Electronics.