Fast macroblock encoding algorithm based on rate-distortion activity for multiview video coding

Multiview video coding (MVC) is the appendix H of H.264/AVC, and it requires a great amount of time to compress multiple viewpoints' video with complex prediction structures. To reduce the whole computational complexity of MVC, this paper proposes a fast macroblock (MB) encoding algorithm based on rate-distortion (RD) activity, and it includes the fast mode decision and the fast motion/disparity estimation. First, the RD activity type of the current MB is calculated by utilizing the Skip/Direct RD cost and the average RD costs of classified MB modes. Then, through utilizing the RD activity type and RD costs of the estimated modes, the selection of candidate modes, the early decision of Skip/Direct mode, and the reduction of Inter8×8 mode estimation are all presented in the fast mode decision. By using the RD activity type and the correlations of vectors, the selection of search center and the prediction of search range are introduced in the fast motion/disparity estimation. In addition, the proposed algorithm can be applied to temporal and inter-view views as well as anchor and non-anchor frames. An experiment with a wide range of video scenes, camera setups and quantization parameters was implemented, and the results confirmed that the proposed algorithm can reduce the encoding time significantly while maintaining a similar RD performance as the original MVC encoder. Compared to the state-of-the-art algorithms, the proposed algorithm also demonstrated better performances in the various test cases. Both a fast mode decision and a fast motion/disparity estimation are addressed.RD activity is evaluated by using the Skip/Direct RD cost and the average RD costs.RD activity type, RD costs and vectors are used to improve algorithm performances.About 91% and 95% encoding time are reduced on temporal views and inter-view views.

[1]  Kai-Kuang Ma,et al.  Fast Mode Decision for Multiview Video Coding Using Mode Correlation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Zhipin Deng,et al.  Fast Motion and Disparity Estimation With Adaptive Search Range Adjustment in Stereoscopic Video Coding , 2012, IEEE Transactions on Broadcasting.

[3]  Kuo-Feng Hsu,et al.  A Fast H.264/AVC-Based Stereo Video Encoding Algorithm Based on Hierarchical Two-Stage Neural Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[4]  Jie Feng,et al.  Fast inter-view prediction and mode selection for multiview video coding , 2011, 2011 4th International Congress on Image and Signal Processing.

[5]  Zhi Liu,et al.  Selective Disparity Estimation and Variable Size Motion Estimation Based on Motion Homogeneity for Multi-View Coding , 2009, IEEE Transactions on Broadcasting.

[6]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Tao Yan,et al.  Early SKIP mode decision for MVC using inter-view correlation , 2010, Signal Process. Image Commun..

[8]  J. Li,et al.  An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Klaus Fraedrich,et al.  Summer atmospheric bridging between Europe and East Asia: Influences on drought and wetness on the Tibetan Plateau , 2011 .

[10]  Liang-Gee Chen,et al.  Content-Aware Prediction Algorithm With Inter-View Mode Decision for Multiview Video Coding , 2008, IEEE Transactions on Multimedia.

[11]  Sergio Bampi,et al.  A multi-level dynamic complexity reduction scheme for multiview video coding , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Tao Yan,et al.  View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Zhi Liu,et al.  Low Complexity Depth Coding Assisted by Coding Information From Color Video , 2014, IEEE Transactions on Broadcasting.

[14]  Gangyi Jiang,et al.  DIRECT Mode Early Decision Optimization Based on Rate Distortion Cost Property and Inter-view Correlation , 2013, IEEE Transactions on Broadcasting.

[15]  Angela Chih-Wei Tang,et al.  Coding statistics based fast mode decision for multi-view video coding , 2013, J. Vis. Commun. Image Represent..

[16]  Zhi Liu,et al.  Low-Complexity Mode Decision for MVC , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Yun He,et al.  Fast disparity motion estimation in MVC based on range prediction , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  Gangyi Jiang,et al.  Efficient Multi-Reference Frame Selection Algorithm for Hierarchical B Pictures in Multiview Video Coding , 2011, IEEE Transactions on Broadcasting.

[19]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[20]  Fan Zhou,et al.  Fast disparity estimation using spatio-temporal correlation of disparity field for multiview video coding , 2010, IEEE Transactions on Consumer Electronics.

[21]  Wen Gao,et al.  A Fast Inter Frame Prediction Algorithm for Multi-View Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[22]  Zhou Wang,et al.  Multiview Coding Mode Decision With Hybrid Optimal Stopping Model , 2013, IEEE Transactions on Image Processing.

[23]  Yuan-Teng Chang,et al.  An adaptive search range algorithm for multiview motion and disparity estimation , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[24]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Qionghai Dai,et al.  Fast Macroblock Mode Selection Algorithm for Multiview Video Coding , 2008, EURASIP J. Image Video Process..

[26]  Wen Gao,et al.  Fast disparity and motion estimation based on correlations for multiview video coding , 2008, IEEE Transactions on Consumer Electronics.

[27]  Peng Chen,et al.  An Adaptive Inter Mode Decision for Multiview Video Coding , 2011, 2011 IEEE International Symposium on Multimedia.

[28]  Sergio Bampi,et al.  An adaptive early skip mode decision scheme for multiview video coding , 2010, 28th Picture Coding Symposium.

[29]  Kwanghoon Sohn,et al.  Fast Disparity and Motion Estimation for Multi-view Video Coding , 2007, IEEE Transactions on Consumer Electronics.

[30]  Pascal Frossard,et al.  Fast encoding techniques for Multiview Video Coding , 2013, Signal Process. Image Commun..

[31]  Antonio Ortega,et al.  Predictive fast motion/disparity search for multiview video coding , 2006, Electronic Imaging.

[32]  Zhipin Deng,et al.  Iterative search strategy with selective bi-directional prediction for low complexity multiview video coding , 2012, J. Vis. Commun. Image Represent..

[33]  Mei Yu,et al.  Statistical Early Termination Model for Fast Mode Decision and Reference Frame Selection in Multiview Video Coding , 2012, IEEE Transactions on Broadcasting.

[34]  Fan Zhou,et al.  Fast inter mode decision based on textural segmentation and correlations for multiview video coding , 2010, IEEE Transactions on Consumer Electronics.

[35]  Zhi Liu,et al.  Inter mode selection for depth map coding in 3D video , 2012, IEEE Transactions on Consumer Electronics.

[36]  Sidan Du,et al.  Efficient early direct mode decision for multi-view video coding , 2013, Signal Process. Image Commun..

[37]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[38]  Reuben A. Farrugia,et al.  Fast inter-mode decision in multi-view video plus depth coding , 2012, 2012 Picture Coding Symposium.