Fast mode decision based on texture–depth correlation and motion prediction for multiview depth video coding

The motion estimation and disparity estimation are used to remove the temporal and inter-view redundancies in multiview plus depth video coding, however, the variable block-size ME and DE make the computational complexity increase dramatically. This drawback limits it to be applied in real-time applications. In this paper, based on the mode correlations between depth video and its corresponding texture video, motion prediction and coded block pattern, we propose a fast mode decision algorithm to reduce the computational complexity of multiview depth video coding. Experimental results show that the proposed algorithm can achieve 67.18 and 69.90 % encoding time saving for even and odd views, respectively, while maintaining a comparable rate-distortion performance. In addition, with the dramatic encoding time reduction, the proposed algorithm becomes more suitable for real-time applications.

[1]  Mei Yu,et al.  Fast macroblock mode selection algorithm for multiview depth video coding , 2010 .

[2]  Sam Kwong,et al.  A fast inter-mode decision scheme based on luminance difference for H.264/AVC , 2011, Proceedings 2011 International Conference on System Science and Engineering.

[3]  C.-C. Jay Kuo,et al.  H.264/SVC Mode Decision Based on Optimal Stopping Theory , 2012, IEEE Transactions on Image Processing.

[4]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[5]  Long Xu,et al.  Predictive and distribution-oriented fast motion estimation for H.264/AVC , 2012, Journal of Real-Time Image Processing.

[6]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[7]  Zhi Liu,et al.  Selective Disparity Estimation and Variable Size Motion Estimation Based on Motion Homogeneity for Multi-View Coding , 2009, IEEE Transactions on Broadcasting.

[8]  Jianfeng Xu,et al.  Fast integer-pel and fractional-pel motion estimation for H.264/AVC , 2006, J. Vis. Commun. Image Represent..

[9]  Shih-Hsuan Yang,et al.  Using H.264 coded block patterns for fast inter-mode selection , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[10]  Reuben A. Farrugia,et al.  Fast inter-mode decision in multi-view video plus depth coding , 2012, 2012 Picture Coding Symposium.

[11]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[12]  Tao Yan,et al.  Early SKIP mode decision for MVC using inter-view correlation , 2010, Signal Process. Image Commun..

[13]  He Yejunb Efficient Prediction Structure of Multi-view Video Coding , 2012 .

[14]  Kai-Kuang Ma,et al.  Fast Mode Decision for Multiview Video Coding Using Mode Correlation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..

[16]  Yo-Sung Ho,et al.  Fast Mode Decision Algorithm for Depth Coding in 3D Video Systems Using H.264/AVC , 2011, PSIVT.

[17]  Yan Zhang,et al.  Low complexity multiview video plus depth coding , 2011, IEEE Transactions on Consumer Electronics.

[18]  Narciso García,et al.  Fast mode decision on H.264/AVC baseline profile for real-time performance , 2008, Journal of Real-Time Image Processing.

[19]  Mei Yu,et al.  Statistical Early Termination Model for Fast Mode Decision and Reference Frame Selection in Multiview Video Coding , 2012, IEEE Transactions on Broadcasting.

[20]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Sam Kwong,et al.  Fast Inter-Mode Decision Based on Rate-Distortion Cost Characteristics , 2010, PCM.

[22]  C.-C. Jay Kuo,et al.  Fast Mode Decision Based on Mode Adaptation , 2010, IEEE Transactions on Circuits and Systems for Video Technology.