Fast intra prediction algorithm based on texture analysis for 3D-HEVC encoders

AbstractThe advances in display technologies and the growing popularity of 3D video systems have attracted more consumers for 3D viewing experiences, and, consequently, the demand for storage and transmission of 3D video content is increasing. To cope with this demand, a 3D video extension of high-efficiency video coding (HEVC) standard is being developed and near the final standardization stage. The upcoming 3D-HEVC standard is expected to provide higher encoding efficiency than its predecessors, supporting multiple views with high resolution, at a cost of considerable increase in computational complexity, which can be an obstacle to its use in real-time applications. This article proposes a novel complexity reduction algorithm developed to optimize the 3D-HEVC intra mode decision targeting real-time video processing for consumer devices with limited computational power, such as 3D camcorders and smartphones equipped with multiple cameras and depth acquisition capabilities. The proposed algorithm analyzes the texture frames and depth maps to estimate the orientation of edges present in the prediction unit data, speeding up the intra prediction process and reducing the 3D-HEVC encoding processing time. Experimental results demonstrate that the proposed algorithm can save 26 % in computational complexity on average with negligible loss of encoding efficiency. This solution contributes to make more feasible the compression of 3D videos targeting real-time applications in power-constrained devices.

[1]  Nidhi Chandrakar,et al.  Study and comparison of various image edge detection techniques , 2012 .

[2]  Jianhua Zheng,et al.  Fast bi-partition mode selection for 3D HEVC depth intra coding , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[3]  Mengmeng Zhang,et al.  Fast inter-prediction mode decision algorithm for HEVC , 2013, Signal, Image and Video Processing.

[4]  Jin Soo Choi,et al.  A Fast Intra‐Prediction Method in HEVC Using Rate‐Distortion Estimation Based on Hadamard Transform , 2013 .

[5]  Fawnizu Azmadi Hussin,et al.  Optimization of Processor Architecture for Image Edge Detection Filter , 2010, 2010 12th International Conference on Computer Modelling and Simulation.

[6]  Philip P. Dang VLSI architecture for real-time image and video processing systems , 2006, Journal of Real-Time Image Processing.

[7]  Rik Van de Walle,et al.  3D video compression based on high efficiency video coding , 2012, IEEE Transactions on Consumer Electronics.

[8]  Chun-Su Park,et al.  Edge-Based Intramode Selection for Depth-Map Coding in 3D-HEVC , 2015, IEEE Transactions on Image Processing.

[9]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[11]  Dimitrios E. Maroulis,et al.  Real-time compression architecture for efficient coding in autostereoscopic displays , 2009, Journal of Real-Time Image Processing.

[12]  Beatrice Pesquet-Popescu,et al.  Depth video coding based on intra mode inheritance from texture , 2014, APSIPA Transactions on Signal and Information Processing.

[13]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[14]  Madhukar Budagavi Real-time image and video processing in portable and mobile devices , 2006, Journal of Real-Time Image Processing.

[15]  Christos Grecos,et al.  Fast intra encoding decisions for high efficiency video coding standard , 2017, Journal of Real-Time Image Processing.

[16]  O. R. Vincent,et al.  A Descriptive Algorithm for Sobel Image Edge Detection , 2009 .

[17]  R. Maini Study and Comparison of Various Image Edge Detection Techniques , 2004 .

[18]  T. A. Abbasi,et al.  A novel FPGA-based architecture for Sobel edge detection operator , 2007 .

[19]  Susanto Rahardja,et al.  Fast mode decision algorithm for intraprediction in H.264/AVC video coding , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Yih Chuan Lin,et al.  Edge Density Early Termination Algorithm for HEVC Coding Tree Block , 2014, 2014 International Symposium on Computer, Consumer and Control.

[21]  Masayuki Tanimoto,et al.  3D-TV System with Depth-Image-Based Rendering , 2012 .

[22]  Kemal Ugur,et al.  Intra Coding of the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Luciano Volcan Agostini,et al.  Complexity reduction of depth intra coding for 3D video extension of HEVC , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[24]  Bruno Zatt,et al.  Complexity reduction for 3D-HEVC depth maps intra-frame prediction using simplified edge detector algorithm , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[25]  Jianhua Zheng,et al.  Fast Depth Modeling Mode selection for 3D HEVC depth intra coding , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[26]  Béatrice Pesquet-Popescu,et al.  Initialization, Limitation, and Predictive Coding of the Depth and Texture Quadtree in 3D-HEVC , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[28]  N. Senthilkumaran,et al.  Image Segmentation - A Survey of Soft Computing Approaches , 2009, 2009 International Conference on Advances in Recent Technologies in Communication and Computing.

[29]  Herbert Freeman,et al.  Machine Vision for Three-Dimensional Scenes , 1990 .

[30]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.