Efficient Prediction Methods With Enhanced Spatial-Temporal Correlation for HEVC

The state-of-the-art high efficiency video coding (HEVC) standard provides a significant improvement relative to H.264/AVC, with almost 50% bitrate reduction. However, there are still requirements to further improve the coding performance of HEVC. In this paper, we reveal some problems in both intra and inter prediction by giving detailed observations, and solve them by further exploring spatial and temporal correlations. First, it is noteworthy that large boundary distortions in intra prediction blocks arise from the simplistic extrapolation operation with partial reference samples. To reduce these boundary distortions, we propose an enhanced prediction boundary filtering method based on generalized Gaussian distribution functions, and extend this method to merge prediction. Second, we combine intra and inter prediction to create a novel prediction method, in which spatial and temporal correlations are simultaneously considered. In addition, the existing merge mode can only provide accurate prediction results for simple movements, owing to the lack of motion estimation. To improve the flexibility, we optimize the existing merge mode by intensifying the temporal correlation with a simple motion search process. The experimental results show that the proposed methods achieve consistent bitrate savings, 1.3% for all intra, 1.5% for random access, 2.5% (up to 4.2%) for low delay P, and 1.2% for low delay B configuration. The encoding time only rises by 70% – 80%, and the decoding time increases negligibly.

[1]  Eduardo Peixoto,et al.  Enhanced inter-prediction using Merge Prediction Transformation in the HEVC codec , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Yue Chen,et al.  Rate-distortion optimization and adaptation of intra prediction filter parameters , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Thomas Sikora,et al.  A dynamic model buffer for parametric motion vector prediction in random-access coding scenarios , 2013, 2013 IEEE International Conference on Image Processing.

[4]  Fan Liang,et al.  Affine SKIP and MERGE modes for video coding , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[5]  Dong Liu,et al.  Combining directional intra prediction and intra block copy with block partition for HEVC , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[6]  Jianle Chen,et al.  Position dependent prediction combination for intra-frame video coding , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Kemal Ugur,et al.  Intra Coding of the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  André Kaup,et al.  Spatio-temporal prediction in video coding by spatially refined motion compensation , 2008, 2008 15th IEEE International Conference on Image Processing.

[10]  Fatih Kamisli,et al.  Block-Based Spatial Prediction and Transforms Based on 2D Markov Processes for Image and Video Compression , 2015, IEEE Transactions on Image Processing.

[11]  Thomas Sikora,et al.  Parametric motion vector prediction for hybrid video coding , 2012, 2012 Picture Coding Symposium.

[12]  Thomas Richter,et al.  Spatio-temporal prediction in video coding by non-local means refined motion compensation , 2010, 28th Picture Coding Symposium.

[13]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Wen Gao,et al.  Enhanced intra prediction for inter pictures , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Thomas Sikora,et al.  A block-adaptive skip mode for inter prediction based on parametric motion models , 2011, 2011 18th IEEE International Conference on Image Processing.

[17]  Yun He,et al.  Short distance intra coding scheme for HEVC , 2012, 2012 Picture Coding Symposium.

[18]  Kei Kawamura,et al.  Prediction mode based reference line synthesis for intra prediction of video coding , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[19]  K. Ngan COMBINED INTER-INTRA PREDICTION FOR HIGH DEFINITION VIDEO CODING , 2007 .

[20]  Eduardo A. B. da Silva,et al.  Sparse least-squares prediction for intra image coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[21]  Wen Gao,et al.  Mode dependent intra smoothing filter for HEVC , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[22]  Detlev Marpe,et al.  Adaptive cross-component prediction for 4:4:4 high efficiency video coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[23]  Fatih Kamisli Intra prediction based on Markov process modeling of images , 2013, ICIP.

[24]  Atsushi Shimizu,et al.  Motion vector prediction methods considering prediction continuity in HEVC , 2016, 2016 Picture Coding Symposium (PCS).

[25]  Aidong Men,et al.  Intra prediction with enhanced inpainting method and vector predictor for HEVC , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Yu Zhang,et al.  Improving HEVC intra prediction with PDE-based inpainting , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[27]  Yue Chen,et al.  Joint inter-intra prediction based on mode-variant and edge-directed weighting approaches in video coding , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Yao Zhao,et al.  Affine SKIP and DIRECT modes for efficient video coding , 2012, 2012 Visual Communications and Image Processing.

[29]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Min-Su Cheon,et al.  Quadtree Based Nonsquare Block Structure for Inter Frame Coding in High Efficiency Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Oscar C. Au,et al.  Improved combined inter-intra prediction using spatial-variant weighted coefficient , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[32]  Yue Chen,et al.  A recursive extrapolation approach to intra prediction in video coding , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[33]  Wen Gao,et al.  Hybrid angular intra/template matching prediction for HEVC intra coding , 2015, 2015 Visual Communications and Image Processing (VCIP).

[34]  Fatih Kamisli,et al.  Intra prediction based on statistical modeling of images , 2012, 2012 Visual Communications and Image Processing.

[35]  Li Li,et al.  Hierarchical quadtree-based flexible block ordering in HEVC intra coding , 2016, 2016 Visual Communications and Image Processing (VCIP).

[36]  André Kaup,et al.  Spatio-temporal prediction in video coding by best approximation , 2009, 2009 Picture Coding Symposium.

[37]  Detlev Marpe,et al.  Block Merging for Quadtree-Based Partitioning in HEVC , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[38]  Chia-Yang Tsai,et al.  Sample Adaptive Offset in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Yinyi Lin,et al.  New merge mode decision in High Efficiency Video Coding (HEVC) , 2014, 2014 International Computer Science and Engineering Conference (ICSEC).

[40]  Oscar C. Au,et al.  Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC , 2014, IEEE Transactions on Image Processing.

[41]  Bin Li,et al.  Efficient Multiple-Line-Based Intra Prediction for HEVC , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .