Sub-Sampled Cross-Component Prediction for Emerging Video Coding Standards

Cross-component linear model (CCLM) prediction has been repeatedly proven to be effective in reducing the interchannel redundancies in video compression. Essentially speaking, the linear model is identically trained by employing accessible luma and chroma reference samples at both encoder and decoder, elevating the level of operational complexity due to the least square regression or max-min based model parameter derivation. In this paper, we investigate the capability of the linear model in the context of sub-sampled based cross-component correlation mining, as a means of significantly releasing the operation burden and facilitating the hardware and software design for both encoder and decoder. In particular, the sub-sampling ratios and positions are elaborately designed by exploiting the spatial correlation and the inter-channel correlation. Extensive experiments verify that the proposed method is characterized by its simplicity in operation and robustness in terms of rate-distortion performance, leading to the adoption by Versatile Video Coding (VVC) standard and the third generation of Audio Video Coding Standard (AVS3).

[1]  W. Mauersberger Generalised correlation model for designing 2-dimensional image coders , 1979 .

[2]  Kai Zhang,et al.  Extended Coding Unit Partitioning for Future Video Coding , 2019, IEEE Transactions on Image Processing.

[3]  Detlev Marpe,et al.  Overview of the Range Extensions for the HEVC Standard: Tools, Profiles, and Performance , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Fabrice Urban,et al.  Wide Angular Intra Prediction for Versatile Video Coding , 2019, 2019 Data Compression Conference (DCC).

[5]  Oscar C. Au,et al.  Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC , 2014, IEEE Transactions on Image Processing.

[6]  Jianle Chen,et al.  Joint Separable and Non-Separable Transforms for Next-Generation Video Coding , 2018, IEEE Transactions on Image Processing.

[7]  Wen Gao,et al.  Improving chroma intra prediction for HEVC , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[8]  Shiqi Wang,et al.  History-Based Motion Vector Prediction for Future Video Coding , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[9]  Yue Wang,et al.  Adaptive Motion Vector Resolution for Affine-Inter Mode Coding , 2019, 2019 Picture Coding Symposium (PCS).

[10]  Wei-Jung Chien,et al.  An Improved Framework of Affine Motion Compensation in Video Coding , 2019, IEEE Transactions on Image Processing.

[11]  Jizheng Xu,et al.  History-Based Motion Vector Prediction in Versatile Video Coding , 2019, 2019 Data Compression Conference (DCC).

[12]  Jerry D. Gibson,et al.  Handbook of Image and Video Processing , 2000 .

[13]  Jianle Chen,et al.  Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding , 2018, IEEE Transactions on Image Processing.

[14]  Wen Gao,et al.  Recent Development of AVS Video Coding Standard: AVS3 , 2019, 2019 Picture Coding Symposium (PCS).

[15]  Wen Gao,et al.  Unified Intra Mode Coding Based on Short and Long Range Correlations , 2020, IEEE Transactions on Image Processing.

[16]  Heiko Schwarz,et al.  Inter-Component Transform for Color Video Coding , 2019, 2019 Picture Coding Symposium (PCS).

[17]  Dong Liu,et al.  A Hybrid Neural Network for Chroma Intra Prediction , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[18]  José Prades Nebot On the Efficiency of Angular Intraprediction , 2014, IEEE Transactions on Image Processing.

[19]  Heiko Schwarz,et al.  An Intra Subpartition Coding Mode for VVC , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[20]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[21]  Detlev Marpe,et al.  Cross-Component Prediction in HEVC , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Wen Gao,et al.  Sub-Sampled Cross-Component Prediction for Chroma Component Coding , 2020, 2020 Data Compression Conference (DCC).