Predictive patch matching for inter-frame coding

Inter prediction is an important component for video coding which exploits the temporal correlation between frames and significantly reduces the redundancy in video sequences. In this paper, we propose a predictive patch matching for inter prediction based on template matching prediction. Besides the surrounding reconstructed pixels which form the template in template matching prediction, our proposed patch matching is able to utilize the predicted pixels generated by the traditional motion prediction. A linear combination of the reconstructed template and the predicted pixels permits to synthesize a prediction while maintaining the local variations of the target block. Furthermore, a mode selection mechanism is introduced to adaptively select the predictive patch matching at sub-block level. Experimental results demonstrate the effectiveness of our proposed predictive patch matching. Constant coding gain can be achieved by our scheme at both low and high bit rates

[1]  Yoshinori Suzuki,et al.  Inter frame coding with template matching spatio-temporal prediction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[4]  Guillermo Sapiro,et al.  Structure and texture filling-in of missing image blocks in wireless transmission and compression applications , 2003, IEEE Trans. Image Process..

[5]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[6]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Xiaoyan Sun,et al.  Video coding with spatio-temporal texture synthesis and edge-based inpainting , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[8]  Thomas Wiegand,et al.  A generic and automatic content-based approach for improved H.264/MPEG4-AVC video coding , 2005, IEEE International Conference on Image Processing 2005.

[9]  Mathias Wien,et al.  Fast decoder side motion vector derivation for inter frame video coding , 2008, 2009 Picture Coding Symposium.

[10]  Thiow Keng Tan,et al.  Inter Frame Coding with Template Matching Averaging , 2007, 2007 IEEE International Conference on Image Processing.