Difference detection based early mode termination for depth map coding in MVC

Depth map coding is a new topic in multiview video coding (MVC) following the development of depth-image-based rendering (DIBR). Since depth map is monochromatic and has less texture than color map, fast algorithm is necessary and possible to reduce the computation burden of the encoder. This paper proposed difference detection based early mode termination strategy. The difference detection (DD) algorithms are categorized to reconstructed frame based (RDD) and original frame based (ODD). A simplified ODD (sODD) strategy is also proposed. Early mode termination based on these three DD algorithms are implemented and evaluated in the reference software of Joint Multiview Video Coding (JMVC) version 8.0 respectively. Simulation results indicate that RDD based one has no performance lost and reduce 25% runtime on average. ODD and sODD based ones can save 54.3% and 43.6% runtime respectively and have an acceptable R-D performance lost.

[1]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[2]  Ahmet M. Kondoz,et al.  Prediction of stereoscopic video quality using objective quality models of 2-D video , 2008 .

[3]  Erhan Ekmekcioglu,et al.  Efficient edge, motion and depth-range adaptive processing for enhancement of multi-view depth map sequences , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  Peter H. N. de With,et al.  Depth-Image Compression Based on an R-D Optimized Quadtree Decomposition for the Transmission of Multiview Images , 2007, 2007 IEEE International Conference on Image Processing.

[5]  Pei-Jun Lee,et al.  Adaptive edge-oriented depth image smoothing approach for depth image based rendering , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[6]  Sehoon Yea,et al.  Depth Estimation for View Synthesis in Multiview Video Coding , 2007, 2007 3DTV Conference.

[7]  Ahmet M. Kondoz,et al.  A Temporal Subsampling Approach for Multiview Depth Map Compression , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Harpreet S. Sawhney,et al.  A depth map representation for real-time transmission and view-based rendering of a dynamic 3D scene , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[9]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[10]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[11]  Masayuki Tanimoto.  Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[12]  Levent Onural,et al.  Television in 3-D: What Are the Prospects? , 2007 .

[13]  Warnakulasuriya Anil Chandana Fernando,et al.  Intra mode selection for depth map coding to minimize rendering distortions in 3D video , 2009, IEEE Transactions on Consumer Electronics.