DC Coefficient Estimation of Intra-Predicted Residuals in HEVC

This paper presents a DC coefficient estimation algorithm for intra-predicted residual blocks in the High-Efficiency Video Coding (HEVC) standard. Discarding the DC coefficient directly in each transform block leads to substantial bit-saving, but at the same time produces strong discontinuities between neighboring blocks. To overcome this problem, we propose an estimation algorithm for the DC coefficient, which solves an optimal offset in a closed-form to recover the corresponding block edges. Then, we embed this algorithm into HEVC in its rate-distortion optimized quantization and sign bit hiding steps. Furthermore, a flag is signaled to decide whether the DC estimation strategy is used for each transform block. Test results under the common test condition show that our algorithm achieves 1.5% and 1.6% BD-rate reduction on average for luma and chroma, respectively, under all intra configuration. In the meantime, our simulation results show that both encoding time and decoding time increase only slightly (about 10%, without any special optimization on programming our proposed algorithm). When testing the proposed DC estimation algorithm on inter coding configurations, including low delay with P pictures, low delay with B pictures, and random access, we can also achieve 0.5%–1.1% bit-rate savings on average, while nearly no extra encoding and decoding time is needed.

[1]  Gary J. Sullivan,et al.  Video Quality Evaluation Methodology and Verification Testing of HEVC Compression Performance , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  En-Hui Yang,et al.  Rate Distortion Optimization for H.264 Interframe Coding: A General Framework and Algorithms , 2007, IEEE Transactions on Image Processing.

[3]  Yi Guo,et al.  Priority-based template matching intra prediction , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[4]  Harold W. Kuhn,et al.  Nonlinear programming: a historical view , 1982, SMAP.

[5]  Bing Zeng,et al.  In Search of “Better-than-DCT” Unitary Transforms for Encoding of Residual Signals , 2010, IEEE Signal Processing Letters.

[6]  Bing Zeng,et al.  Directional Discrete Cosine Transforms—A New Framework for Image Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[9]  Victor Sanchez,et al.  Adaptive quantization by soft thresholding in HEVC , 2015, 2015 Picture Coding Symposium (PCS).

[10]  Sunil K. Narang,et al.  Graph based transforms for depth video coding , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Madhukar Budagavi,et al.  Improvements on Intra Block Copy in natural content video coding , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[12]  Ankur Saxena,et al.  DCT/DST-Based Transform Coding for Intra Prediction in Image/Video Coding , 2013, IEEE Transactions on Image Processing.

[13]  Enrico Magli,et al.  Steerable Discrete Cosine Transform , 2017, IEEE Trans. Image Process..

[14]  Bing Zeng,et al.  Constrained Quantization in the Transform Domain With Applications in Arbitrarily-Shaped Object Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Oscar C. Au,et al.  Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images , 2015, IEEE Transactions on Image Processing.

[16]  Jian-Feng Cai,et al.  Inpainting for Compressed Images , 2010 .

[17]  Chen Chen,et al.  A new block-based coding method for HEVC intra coding , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[18]  Fatih Kamisli Intra prediction based on Markov process modeling of images , 2013, ICIP.

[19]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[20]  Jaejoon Lee,et al.  Edge-adaptive transforms for efficient depth map coding , 2010, 28th Picture Coding Symposium.

[21]  Marta Karczewicz,et al.  Transform coefficient coding in HEVC , 2012, 2012 Picture Coding Symposium.

[22]  Fatih Kamisli,et al.  Block-Based Spatial Prediction and Transforms Based on 2D Markov Processes for Image and Video Compression , 2015, IEEE Transactions on Image Processing.

[23]  Zhiwei Xiong,et al.  Block-Based Image Compression With Parameter-Assistant Inpainting , 2010, IEEE Transactions on Image Processing.

[24]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[25]  Marta Mrak,et al.  Intensity dependent spatial quantization with application in HEVC , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[26]  Moncef Gabbouj,et al.  A New Block-Based Method for HEVC Intra Coding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Dong Liu,et al.  Image Compression With Edge-Based Inpainting , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Thiow Keng Tan,et al.  Intra Prediction by Template Matching , 2006, 2006 International Conference on Image Processing.

[29]  Thiow Keng Tan,et al.  Intra Prediction by Averaged Template Matching Predictors , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[30]  Thomas Wiegand,et al.  Towards efficient intra prediction based on image inpainting methods , 2010, 28th Picture Coding Symposium.

[31]  G. Sreelekha,et al.  Performance improvement of HEVC using Adaptive Quantization , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[32]  Susanto Rahardja,et al.  Mode-Dependent Transforms for Coding Directional Intra Prediction Residuals , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  King Ngi Ngan,et al.  Improved block level adaptive quantization for high efficiency video coding , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).