Intra-Prediction Mode Propagation for Video Coding

Intra-prediction and inter-prediction are two major ways of prediction in video coding. In the state-of-the-art video coding schemes such as joint exploration model (JEM), these two kinds of prediction are performed independently as different modes. An inter-coded coding unit (CU) is only assigned with the motion information, without an intra-prediction mode (IPM). To capture the texture direction in an inter-coded CU with low complexity, we present an IPM propagation approach in this paper. In the proposed scheme, each $4\times 4$ sub-block in an inter-coded CU is assigned with a propagated IPM, which is fetched from a reference block, located by a motion vector. The propagated IPM is utilized in two aspects. First, the propagated IPM can help to perform inter–intra-prediction in the inter-coded CU. Inter-prediction controlled by the motion information and intra-prediction controlled by the propagated IPM are both performed. The final prediction is generated by a position-dependent weighted sum of the two kinds of prediction. Second, the propagated IPMs of neighboring inter-coded blocks can help to predict the IPM of the intra-coded CU in an inter-picture. The propagated IPM of an inter-coded neighboring block can also be treated as a most probable mode. Simulation results show that BD rate savings of 0.5%, 1.0%, and 1.0% on average for Y, Cb, and Cr components, respectively, are achieved in random access configurations under the common test condition, compared with JEM-7.1. On ultra-high definition sequences, the BD rate savings can reach 1.0%, 1.7%, and 2.3% for Y, Cb, and Cr components, respectively.

[1]  Dong Liu,et al.  An Efficient Four-Parameter Affine Motion Model for Video Coding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[3]  Wei-Jung Chien,et al.  Sub-block motion derivation for merge mode in HEVC , 2016, Optical Engineering + Applications.

[4]  K. Ngan COMBINED INTER-INTRA PREDICTION FOR HIGH DEFINITION VIDEO CODING , 2007 .

[5]  Yu-Wen Huang,et al.  Inter-Palette Coding in Screen Content Coding , 2017, IEEE Transactions on Broadcasting.

[6]  Jianle Chen,et al.  Enhanced Cross-Component Linear Model for Chroma Intra-Prediction in Video Coding , 2018, IEEE Transactions on Image Processing.

[7]  Fatih Kamisli,et al.  Recursive Prediction for Joint Spatial and Temporal Prediction in Video Coding , 2014, IEEE Signal Processing Letters.

[8]  Jie Jia,et al.  An Efficient Coding of Intra Picture Prediction Modes for H.264/AVC , 2009, 2009 Third International Conference on Multimedia and Ubiquitous Engineering.

[9]  Qian Huang,et al.  An efficient coding method for intra prediction mode information , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[10]  Xiang Li,et al.  Frame Rate Up-Conversion Based Motion Vector Derivation for Hybrid Video Coding , 2017, 2017 Data Compression Conference (DCC).

[11]  Oscar C. Au,et al.  Improved combined inter-intra prediction using spatial-variant weighted coefficient , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[12]  Wen Gao,et al.  Directional residue prediction with motion alignment for video coding , 2008 .

[13]  Alexander Alshin,et al.  Bi-directional Pptical Flow for Future Video Codec , 2016, 2016 Data Compression Conference (DCC).

[14]  Jianle Chen,et al.  Multi-model based cross-component linear model chroma intra-prediction for video coding , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[15]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Anthony Vetro,et al.  Predictive coding of intra prediction modes for high efficiency video coding , 2012, 2012 Picture Coding Symposium.

[17]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .