A weighted low-rank matrix approximation based template matching scheme for inter-frame prediction

In the field of video coding, inter-frame prediction plays an important role in improving compression efficiency. This task is achieved by finding a predictor for each block such that the residual data can be close to zero as much as possible. For recent video coding standards, motion vectors are required for a decoder to locate the predictors during video reconstruction. Block matching algorithms are usually utilized in the stage of motion estimation to find such motion vectors. For decoderside inter-frame predictive coding, proper templates are defined and template matching algorithms are used to produce a predictor for each block such that the overhead information to transmit motion vectors can be avoided. However, the conventional criteria of either block matching or template matching algorithms may lead to the generation of worse predictors. To enhance coding efficiency, a weighted low-rank matrix approximation approach for decoder-side inter-frame prediction is proposed in this paper. By finding dominating block candidates as well as their corresponding importance factors, a predictor for each block is formed. Together with mode decision, the coder can switch to a better mode between the motion compensation by block matching and the proposed template matching scheme which can operate at decoder side.

[1]  Mehmet Türkan,et al.  Sparse approximation with adaptive dictionary for image prediction , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[2]  Jin Wang,et al.  A low-rank matrix completion based intra prediction for H.264/AVC , 2011, 2011 IEEE 13th International Workshop on Multimedia Signal Processing.

[3]  Yoshinori Suzuki,et al.  Inter frame coding with template matching spatio-temporal prediction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[4]  Thiow Keng Tan,et al.  Inter Frame Coding with Template Matching Averaging , 2007, 2007 IEEE International Conference on Image Processing.

[5]  Yi Ma,et al.  Robust principal component analysis?: Recovering low-rank matrices from sparse errors , 2010, 2010 IEEE Sensor Array and Multichannel Signal Processing Workshop.

[6]  Mehmet Türkan,et al.  Image prediction: Template matching vs. sparse approximation , 2010, 2010 IEEE International Conference on Image Processing.

[7]  Yoshinori Suzuki,et al.  Block-Based Reduced Resolution Inter Frame Coding with Template Matching Prediction , 2006, 2006 International Conference on Image Processing.

[8]  James Bennett,et al.  The Netflix Prize , 2007 .

[9]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[11]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[12]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.