Spatial Information Refinement for Chroma Intra Prediction in Video Coding

Video compression benefits from advanced chroma intra prediction methods, such as the Cross-Component Linear Model (CCLM) which uses linear models to approximate the relationship between the luma and chroma components. Recently it has been proven that advanced cross-component prediction methods based on Neural Networks (NN) can bring additional coding gains. In this paper, spatial information refinement is proposed for improving NN-based chroma intra prediction. Specifically, the performance of chroma intra prediction can be improved by refined down-sampling or by incorporating location information. Experimental results show that the two proposed methods obtain 0.31%, 2.64%, 2.02% and 0.33%, 3.00%, 2.12% BD-rate reduction on Y, Cb and Cr components, respectively, under All-Intra configuration, when implemented in Versatile Video Coding (H.266/VVC) test model.

[1]  Oscar C. Au,et al.  Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC , 2014, IEEE Transactions on Image Processing.

[2]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[3]  Gary J. Sullivan,et al.  Developments in International Video Coding Standardization After AVC, With an Overview of Versatile Video Coding (VVC) , 2021, Proceedings of the IEEE.

[4]  Jens Schneider,et al.  Convolutional Neural Networks for Video Intra Prediction Using Cross-component Adaptation , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Saverio G. Blasi,et al.  Attention-Based Neural Networks for Chroma Intra Prediction in Video Coding , 2021, IEEE Journal of Selected Topics in Signal Processing.

[6]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[7]  Jianle Chen,et al.  Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding , 2018, IEEE Transactions on Image Processing.

[8]  Luc Van Gool,et al.  NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Christophe Gisquet,et al.  Model Correction for Cross-Channel Chroma Prediction , 2013, 2013 Data Compression Conference.

[10]  Detlev Marpe,et al.  Overview of the Range Extensions for the HEVC Standard: Tools, Profiles, and Performance , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Linwei Zhu,et al.  Deep Learning-Based Chroma Prediction for Intra Versatile Video Coding , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Susanto Rahardja,et al.  Chroma intra prediction using template matching with reconstructed luma components , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Wen Gao,et al.  Improving chroma intra prediction for HEVC , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[14]  Noel E. O'Connor,et al.  Chroma Intra Prediction With Attention-Based CNN Architectures , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[15]  Nam Ik Cho,et al.  Intra prediction method based on the linear relationship between the channels for YUV 4∶2∶0 intra coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[16]  Jianle Chen,et al.  Cross component decorrelation for HEVC range extension standard , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[17]  Dong Liu,et al.  A Hybrid Neural Network for Chroma Intra Prediction , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[18]  Jianle Chen,et al.  Multi-model based cross-component linear model chroma intra-prediction for video coding , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[19]  Nam Ik Cho,et al.  A new intra prediction method using channel correlations for the H.264/AVC intra coding , 2009, 2009 Picture Coding Symposium.