Low Complexity Depth Coding Assisted by Coding Information From Color Video

Recently, color plus depth map format 3-D video has been introduced as a new 3-D scene representation format, which gains the attention for its relatively low storage and transmission bandwidth requirement in comparison to the multiview video system. Usually, encoding of the color video and the depth data uses two traditional H.264 encoders. The complexity and hardware requirements to code one 2-D view and its associated depth data are nearly two times higher than coding one 2-D view. In this paper, we address the reduction of complexity of depth coding. Since both color videos and depth maps represent the same scene at the same time instant, it is likely for each macroblock to have similar coding information including the prediction mode and motion vectors. Taking advantage of correlations between coding information from depth maps and color videos, we propose a low complexity depth coding algorithm incorporating a fast motion search method and a fast mode decision method. Results show that the proposed algorithm reduces 80% computational complexity with a negligible loss of coding efficiency in comparison with the original Joint Multiview Video Coding encoder.

[1]  Yo-Sung Ho,et al.  Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  M. Halle,et al.  3-D Displays and Signal Processing , 2007, IEEE Signal Processing Magazine.

[3]  Yiwen Sun,et al.  Efficient SKIP Mode Detection for Coarse Grain Quality Scalable Video Coding , 2010, IEEE Signal Processing Letters.

[4]  Satoshi Goto,et al.  Difference detection based early mode termination for depth map coding in MVC , 2010, 28th Picture Coding Symposium.

[5]  Yan Zhang,et al.  Low complexity multiview video plus depth coding , 2011, IEEE Transactions on Consumer Electronics.

[6]  Yo-Sung Ho,et al.  H.264-Based Depth Map Sequence Coding Using Motion Information of Corresponding Texture Video , 2006, PSIVT.

[7]  Yo-Sung Ho,et al.  Mesh-Based Depth Coding for 3D Video using Hierarchical Decomposition of Depth Maps , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[9]  Dong Tian,et al.  New Depth Coding Techniques With Utilization of Corresponding Video , 2011, IEEE Transactions on Broadcasting.

[10]  Rabab Kreidieh Ward,et al.  An H.264-based video encoding scheme for 3D TV , 2006, 2006 14th European Signal Processing Conference.

[11]  C.-C. Jay Kuo,et al.  Adaptive Motion Search Range Prediction for Video Encoding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[14]  Zhi Liu,et al.  Inter mode selection for depth map coding in 3D video , 2012, IEEE Transactions on Consumer Electronics.

[15]  Kwanghoon Sohn,et al.  Motion information sharing mode for depth video coding , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[16]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[17]  Da-Hyun Yoon,et al.  Fast Mode Decision Algorithm for Depth Coding in 3 D Video Systems Using H . 264 / AVC , 2011 .