The Emerging MVC Standard for 3D Video Services

Multiview video has gained a wide interest recently. The huge amount of data needed to be processed by multiview applications is a heavy burden for both transmission and decoding. The joint video team has recently devoted part of its effort to extend the widely deployed H.264/AVC standard to handle multiview video coding (MVC). The MVC extension of H.264/AVC includes a number of new techniques for improved coding efficiency, reduced decoding complexity, and new functionalities for multiview operations. MVC takes advantage of some of the interfaces and transport mechanisms introduced for the scalable video coding (SVC) extension of H.264/AVC, but the system level integration of MVC is conceptually more challenging as the decoder output may contain more than one view and can consist of any combination of the views with any temporal level. The generation of all the output views also requires careful consideration and control of the available decoder resources. In this paper, multiview applications and solutions to support generic multiview as well as 3D services are introduced. The proposed solutions, which have been adopted to the draft MVC specification, cover a wide range of requirements for 3D video related to interface, transport of the MVC bitstreams, and MVC decoder resource management. The features that have been introduced in MVC to support these solutions include marking of reference pictures, supporting for efficient view switching, structuring of the bitstream, signalling of view scalability supplemental enhancement information (SEI) and parallel decoding SEI.

[1]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[2]  Ying Chen,et al.  BUFFER REQUIREMENT ANALYSES FOR MULTIVIEW VIDEO CODING , 2007 .

[3]  Toshiaki Fujii,et al.  System design of free viewpoint video communication , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[4]  Bernhard Fröba,et al.  Face detection and tracking using edge orientation information , 2000, IS&T/SPIE Electronic Imaging.

[5]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[7]  Miska M. Hannuksela,et al.  Isolated regions in video coding , 2004, IEEE Transactions on Multimedia.

[8]  Gerard Faria,et al.  DVB-H: Digital Broadcast Services to Handheld Devices , 2006, Proceedings of the IEEE.

[9]  W. Matusik,et al.  Coding Approaches for End-To-End 3D TV Systems , 2004 .

[10]  S. B. Kang,et al.  Survey of image-based representations and compression techniques , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  Heiko Schwarz,et al.  Analysis of Hierarchical B Pictures and MCTF , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[12]  C. Fehn,et al.  Interactive 3-DTV-Concepts and Key Technologies , 2006 .

[13]  Hideaki Kimata,et al.  Development of MPEG standards for 3D and free viewpoint video , 2005, SPIE Optics East.

[14]  Houqiang Li,et al.  Parallel Encoding - Decoding Operation for Multiview Video Coding with High Coding Efficiency , 2007, 2007 3DTV Conference.

[15]  Dong Tian,et al.  Sub-sequence video coding for improved temporal scalability , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[16]  Miska M. Hannuksela,et al.  System and Transport Interface of SVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Aljoscha Smolic,et al.  Interactive 3-D Video Representation and Coding Technologies , 2005, Proceedings of the IEEE.

[18]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  J. G. Eden,et al.  Information Display Early in the 21st Century: Overview of Selected Emissive Display Technologies , 2006, Proceedings of the IEEE.

[20]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.