Video Encoding Scheme Employing Intra and Inter Prediction Based on Averaged Template Matching Predictors

In video compression, the information transmitted from the encoder to the decoder can be classified into two categories: side information, which carries action instructions to be performed, and data such as the residual error of the texture. As video compression technology has matured, better compression has been achieved by increasing the ratio of side information to data, while reducing the overall bit rate. However, there is a limit to this method because the side information becomes a significant fraction of the overall bit rate. In recent video compression technologies, the decoder tends to share the burden of the decision making in order to achieve a higher compression ratio. To further improve the coding efficiency, we tried to provide the decoder with a more active role in reducing the amount of data. According to this approach, by using reconstructed pixels that surround a target block to produce a better sample predictor of the target block, the amount of side information and the residual error of the texture are reduced. Furthermore, multiple candidates of the sample predictor are utilized to create a better sample predictor without increasing the amount of side information. In this paper, we employ a template matching method that makes the decoder more active. The template matching method is applied to the conventional video codec to improve the prediction performance of intra, inter, and bi-directional pictures in video. The results show that improvements in coding efficiency up to 5.8% are achieved.

[1]  Gregory W. Wornell,et al.  The duality between information embedding and source coding with side information and some applications , 2003, IEEE Trans. Inf. Theory.

[2]  Thiow Keng Tan,et al.  Inter Frame Coding with Template Matching Averaging , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Ram Zamir,et al.  The rate loss in the Wyner-Ziv problem , 1996, IEEE Trans. Inf. Theory.

[4]  Aggelos K Katsaggelos,et al.  A model-based pel-recursive motion estimation algorithm , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[5]  Thiow Keng Tan,et al.  Intra Prediction by Template Matching , 2006, 2006 International Conference on Image Processing.

[6]  H. Schwarz,et al.  Joint Video Team (jvt) of Iso/iec Mpeg & Itu-t Vceg (iso/iec Jtc1/sc29/wg11 and Itu-t Sg16 Q.6) , 2002 .

[7]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[8]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[9]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[10]  Yoshinori Suzuki,et al.  Block-Based Reduced Resolution Inter Frame Coding with Template Matching Prediction , 2006, 2006 International Conference on Image Processing.

[11]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[12]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[13]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[14]  Thiow Keng Tan,et al.  Intra Prediction by Averaged Template Matching Predictors , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[15]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[16]  Markus Flierl,et al.  Rate-constrained multihypothesis prediction for motion-compensated video compression , 2002, IEEE Trans. Circuits Syst. Video Technol..

[17]  Yoshinori Suzuki,et al.  Inter frame coding with template matching spatio-temporal prediction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[18]  Haibo Li,et al.  Image sequence coding at very low bit rates: a review , 1994, IEEE Trans. Image Process..

[19]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..