A Unified Region-Based Template Matching Approach for Intra and Inter Prediction in VVC

Template matching is a texture synthesis method which has found applications in video coding. However, the increased decoder complexity from its underlying search algorithm makes it less suitable for practical applications. In our previous paper, we presented region-based template matching where the decoder complexity is considerably reduced. This publication describes further improvements of the aforementioned tool for intra prediction and decoder side motion vector derivation. When applied together, it achieves an average coding gain of -1.04% with 107% decoder run-time for all intra and -1.60% with 113% decoder run-time for random access configurations respectively. The proposed method needs considerably fewer computations and memory requirements compared to the previous version of the algorithm.

[1]  Detlev Marpe,et al.  Hardware-Friendly Intra Region-Based Template Matching for VVC , 2019, 2019 Data Compression Conference (DCC).

[2]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Yoshinori Suzuki,et al.  Inter frame coding with template matching spatio-temporal prediction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[5]  Xin Li,et al.  Intra prediction using template matching with adaptive illumination compensation , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Yi Guo,et al.  Priority-based template matching intra prediction , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[7]  Pierre Duhamel,et al.  A set of template matching predictors for intra video coding , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Detlev Marpe,et al.  Fast template matching for intra prediction , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[9]  Thiow Keng Tan,et al.  Intra Prediction by Template Matching , 2006, 2006 International Conference on Image Processing.

[10]  Hong Zhang,et al.  High efficiency video coding (HEVC) based screen content coding , 2013 .

[11]  Detlev Marpe,et al.  Region-based Template Matching for Decoder-Side Motion Vector Derivation , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[12]  Wen Gao,et al.  Combining template matching and block motion compensation for video coding , 2010, 2010 International Symposium on Intelligent Signal Processing and Communication Systems.

[13]  Thiow Keng Tan,et al.  Inter Frame Coding with Template Matching Averaging , 2007, 2007 IEEE International Conference on Image Processing.

[14]  Thiow Keng Tan,et al.  Intra Prediction by Averaged Template Matching Predictors , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[15]  Mathias Wien,et al.  Fast decoder side motion vector derivation for inter frame video coding , 2008, 2009 Picture Coding Symposium.