Efficient motion vector recovery algorithm for H.264 using directional interpolation

This study proposes a novel motion vector recovery (MVR) algorithm for the H.264 video coding standard, which takes into account the change in the motion vectors (MVs) in different directions. Existing algorithms for MVR are confined to use the horizontal or vertical directions to recover the lost MVs. However, in the presence of non-linear movements or a fast/sudden motion of any object in a scene of the given input video, the MVs recovered by these algorithms turn out to be inaccurate. The proposed directional interpolation-based technique can interpolate the MVs in any direction based on the tendency of motion around the lost macro block, thus making it suitable to handle non-linear or fast motions. Testing the proposed technique with different benchmark video sequences shows an average improvement 1-2-dB in the peak signal-to-noise ratio of the recovered video over existing techniques.

[1]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[2]  Yao Wang,et al.  Coding and cell-loss recovery in DCT-based packet video , 1993, IEEE Trans. Circuits Syst. Video Technol..

[3]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[4]  JongWon Kim,et al.  DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[6]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[7]  Jin-Jang Leou,et al.  Detection and correction of transmission errors in JPEG images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[8]  Maja Bystrom,et al.  Hybrid error concealment schemes for broadcast video transmission over ATM networks , 1999, IEEE Trans. Circuits Syst. Video Technol..

[9]  Sang Uk Lee,et al.  Recovery of corrupted image data based on the NURBS interpolation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[10]  Rabab Kreidieh Ward,et al.  A concealment method for video communications in an error-prone environment , 2000, IEEE Journal on Selected Areas in Communications.

[11]  Faouzi Kossentini,et al.  A Concealment Method for Shape Information in MPEG-4 Coded Video Sequences , 2000, IEEE Trans. Multim..

[12]  Ioannis Pitas,et al.  MPEG-2 error concealment based on block-matching principles , 2000, IEEE Trans. Circuits Syst. Video Technol..

[13]  Zhengguo Li,et al.  A congestion control strategy for multipoint videoconferencing , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[14]  Shao Ya-fei,et al.  Reconstruction of missing blocks in image transmission by using self-embedding , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[15]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[16]  Yo-Sung Ho,et al.  Error concealment techniques for digital TV , 2002, IEEE Trans. Broadcast..

[17]  Tsuhan Chen,et al.  Model-based error concealment for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[18]  Kai-Kuang Ma,et al.  Error concealment for video transmission with dual multiscale Markov random field modeling , 2003, IEEE Trans. Image Process..

[19]  Lap-Pui Chau,et al.  A motion vector recovery algorithm for digital video using Lagrange interpolation , 2003, IEEE Trans. Broadcast..

[20]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[21]  Pamela C. Cosman,et al.  Decision trees for error concealment in video decoding , 2003, IEEE Trans. Multim..

[22]  Wen-Nung Lie,et al.  Video Error Concealment by Integrating Greedy Suboptimization and Kalman Filtering Techniques , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  L. Pezzoni,et al.  Adaptive gop size control in h.264/avc encoding based on scene change detection , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.