Efficient motion vector recovery algorithm for H.264 based on a polynomial model

In this paper, we propose an efficient motion vector recovery algorithm for the new coding standard H.264, which is based on a polynomial model. To achieve better coding efficiency, the motion estimation scheme used in H.264 is different from previous coding standards. In H.264, a 16/spl times/16 macroblock can be divided into different block shapes for motion estimation. Each macroblock contains more motion vectors than previous coding standards. For nature video, the blocks within a small area likely belong to the same object, hence the motion vectors of neighboring blocks are highly correlated. Based on the correlation of neighboring motion vectors, we can use the motion vectors that are adjacent to the lost motion vectors to constitute a polynomial model, which can describe the change tendency of motion vectors within a small area. Through this model, the lost motion vectors can be predicted and the lost macroblocks can be reconstructed. Different video sequences are used to test the performance of proposed method. The simulation results show that the quality of corrupted video can be obviously improved by proposed algorithm.

[1]  Sang Uk Lee,et al.  Recovery of corrupted image data based on the NURBS interpolation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Jin-Jang Leou,et al.  Detection and correction of transmission errors in JPEG images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[4]  Tsuhan Chen,et al.  Model-based error concealment for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[6]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[7]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[8]  JongWon Kim,et al.  DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error , 1997, IEEE Trans. Circuits Syst. Video Technol..

[9]  Faouzi Kossentini,et al.  A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences , 2000, IEEE Trans. Multim..

[10]  Miska M. Hannuksela,et al.  The error concealment feature in the H.26L test model , 2002, Proceedings. International Conference on Image Processing.

[11]  Ioannis Pitas,et al.  MPEG-2 error concealment based on block-matching principles , 2000, IEEE Trans. Circuits Syst. Video Technol..

[12]  Pamela C. Cosman,et al.  Decision trees for error concealment in video decoding , 2003, IEEE Trans. Multim..

[13]  Maja Bystrom,et al.  Hybrid error concealment schemes for broadcast video transmission over ATM networks , 1999, IEEE Trans. Circuits Syst. Video Technol..

[14]  Shao Ya-fei,et al.  Reconstruction of missing blocks in image transmission by using self-embedding , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[15]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[16]  Chen-Yi Lee,et al.  Error-resilient image coding (ERIC) with smart-IDCT error concealment technique for wireless multimedia transmission , 2003, IEEE Trans. Circuits Syst. Video Technol..

[17]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .

[18]  Rabab Kreidieh Ward,et al.  A concealment method for video communications in an error-prone environment , 2000, IEEE Journal on Selected Areas in Communications.

[19]  Kai-Kuang Ma,et al.  Error concealment for video transmission with dual multiscale Markov random field modeling , 2003, IEEE Trans. Image Process..

[20]  Yo-Sung Ho,et al.  Error concealment techniques for digital TV , 2002, IEEE Trans. Broadcast..

[21]  Jae-Won Suh,et al.  Directional Interpolation For Spatial Error Concealment , 1997, 1997 International Conference on Consumer Electronics.

[22]  Yao Wang,et al.  Coding and cell-loss recovery in DCT-based packet video , 1993, IEEE Trans. Circuits Syst. Video Technol..