Scalable Multi-view Video Coding based on HEVC

In this paper, we propose an integrated spatial and view scalable video codec based on high efficiency video coding (HEVC). The proposed video codec is developed based on similarity and uniqueness between the scalable extension and 3D multi-view extension of HEVC. To improve compression efficiency using the proposed scalable multi-view video codec, inter-layer and interview predictions are jointly employed by using high-level syntaxes that are defined to identify view and layer information. For the inter-view and inter-layer predictions, a decoded picture buffer (DPB) management algorithm is also proposed. The inter-view and inter-layer motion predictions are integrated into a consolidated prediction by harmonizing with the temporal motion prediction of HEVC. We found that the proposed scalable multi-view codec achieves bitrate reduction of 36.1%, 31.6% and 15.8% on the top of ×2, ×1.5 parallel scalable codec and parallel multi-view codec, respectively.

[1]  Thiow Keng Tan,et al.  Overview of HEVC High-Level Syntax and Reference Picture Management , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Heiko Schwarz,et al.  Constrained inter-layer prediction for single-loop decoding in spatial scalability , 2005, IEEE International Conference on Image Processing 2005.

[4]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[5]  Sung-Jea Ko,et al.  Selective inter-layer residual prediction for SVC-based video streaming , 2009, IEEE Transactions on Consumer Electronics.

[6]  Ivan V. Bajic,et al.  Scalable video coding based on high efficiency video coding (HEVC) , 2011, Proceedings of 2011 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[9]  Yo-Sung Ho,et al.  Overview of Multi-view Video Coding , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[10]  Detlev Marpe,et al.  Block Merging for Quadtree-Based Partitioning in HEVC , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Kemal Ugur,et al.  Intra Coding of the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Chia-Yang Tsai,et al.  Sample Adaptive Offset in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Heiko Schwarz,et al.  Performance Analysis of SVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  He.  Special Section on the Joint Call for Proposals on High Efficiency Video Coding ( HEVC ) Standardization , 2011 .

[15]  Minhua Zhou,et al.  HEVC Deblocking Filter , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[17]  Soon-kak Kwon,et al.  Overview of H.264/MPEG-4 part 10 , 2006, J. Vis. Commun. Image Represent..

[18]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.