Inter mode selection for depth map coding in 3D video

3D video (3DV) data usually includes both conventional 2D videos and corresponding depth maps. In 3DV coding, color videos and depth maps need to be jointly coded. Usually, the system of 3DV coding uses the two-channel coding method which encodes color videos and depth maps based on two parallel codec implementations. The complexity and hardware requirements are nearly two times higher than coding 2D color videos. While low-complexity color video coding has been broadly studied, depth map coding has received much less attention. The depth map represents the distance from cameras to objects, which has characteristics of both data on Z-axis in world coordinate and the video signal. Thus, there is a high correlation among motion information (the prediction mode, reference frame and motion vector) from color videos and depth maps. Based on this observation, we propose one method to reduce depth coding complexity. An experimental analysis is performed to study the prediction mode correlation in coding information from color videos and depth maps. Based on the correlation, we propose an efficient mode decision algorithm. With almost the same RD performance, the proposed algorithm can reduce about 70% computational complexity of depth coding, which is beneficial for real-time realization through a hardware or software implementation for the 3DV applications.

[1]  Erika Müller,et al.  Sharing of motion vectors in 3D video coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Dong Tian,et al.  New Depth Coding Techniques With Utilization of Corresponding Video , 2011, IEEE Transactions on Broadcasting.

[3]  Satoshi Goto,et al.  Region of Interest oriented fast mode decision for depth map coding in DIBR , 2011, 2011 IEEE 7th International Colloquium on Signal Processing and its Applications.

[4]  Yan Zhang,et al.  Low complexity multiview video plus depth coding , 2011, IEEE Transactions on Consumer Electronics.

[5]  Yo-Sung Ho,et al.  Mesh-Based Depth Coding for 3D Video using Hierarchical Decomposition of Depth Maps , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Kwanghoon Sohn,et al.  Motion information sharing mode for depth video coding , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[7]  Seung-Uk Yoon,et al.  Multiple Color and Depth Video Coding Using a Hierarchical Representation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[9]  Warnakulasuriya Anil Chandana Fernando,et al.  A new mode selection technique for coding Depth maps of 3D video , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Satoshi Goto,et al.  Difference detection based early mode termination for depth map coding in MVC , 2010, 28th Picture Coding Symposium.

[12]  Warnakulasuriya Anil Chandana Fernando,et al.  Intra mode selection for depth map coding to minimize rendering distortions in 3D video , 2009, IEEE Transactions on Consumer Electronics.

[13]  Yiwen Sun,et al.  Efficient SKIP Mode Detection for Coarse Grain Quality Scalable Video Coding , 2010, IEEE Signal Processing Letters.

[14]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[15]  Yo-Sung Ho,et al.  H.264-Based Depth Map Sequence Coding Using Motion Information of Corresponding Texture Video , 2006, PSIVT.

[16]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[17]  Rabab Kreidieh Ward,et al.  An H.264-based video encoding scheme for 3D TV , 2006, 2006 14th European Signal Processing Conference.

[18]  M. Halle,et al.  3-D Displays and Signal Processing , 2007, IEEE Signal Processing Magazine.