Adaptive patch matching for motion compensated prediction

Motion compensated prediction (MCP) plays an important role in video coding due to its great capability of reducing temporal redundancy. In this paper, we propose a new MCP scheme by adaptive patch matching with the full use of the reconstructed pixels surrounding the current block (referred to as the template inside the patch) aiming at achieving a more accurate prediction than conventional MCP. The proposed scheme not only takes advantage of the temporal correlation but also efficiently exploits the spatial correlation between the current block and its template inside the patch. An adaptive linear combination of the current block and its template in motion estimation is designed to generate an optimal prediction while maintaining the local variation of the current block. Accordingly, a modification of the rate-distortion criterion is introduced to select the combined prediction. Experimental results show that our proposed APM achieves improved coding performance compared with H.264/AVC.

[1]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[2]  Mark R. Pickering,et al.  Video Coding Using Elastic Motion Model and Larger Blocks , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Yoshinori Suzuki,et al.  Inter frame coding with template matching spatio-temporal prediction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Mathias Wien,et al.  Decoder side motion vector derivation for inter frame video coding , 2009, 2008 15th IEEE International Conference on Image Processing.

[5]  Xin Li,et al.  Geometry-Adaptive Block Partitioning for Video Coding , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[6]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Xiaoyan Sun,et al.  Predictive patch matching for inter-frame coding , 2010, Visual Communications and Image Processing.

[9]  Marc Antonini,et al.  Hybrid-1D macroblock prediction for video compression , 2009, 2009 17th European Signal Processing Conference.