Motion Vector Recovery for Video Error Concealment by Using Iterative Dynamic-Programming Optimization

This paper proposes an error concealment technique for video transmission, focusing on motion vector (MV) recovery for both inter- and intra-coded frames, to improve video quality at decoder when video bit stream data incur transmission errors. The proposed algorithm considers slice (i.e., a row of macroblocks (MBs)) errors and uses DP (Dynamic Programming) optimization technique to estimate the lost MVs in a global manner, differing from the traditional Boundary Matching Algorithm (BMA) and others that recover MVs independently for individual MBs in an erroneous slice. We also propose an iterative DP process based on 8 × 8 pixels blocks to resolve finer motions (for 8 × 8, 8 × 16, and 16 × 8 pixels blocks) that will aid in the enhancement of reconstruction quality. Experiment results show that our algorithm outperforms the well-known BMA by up to 7.28 dB and the DMVE and another prior work by Qian by up to 1.0 dB at a packet loss rate of 15%. Subjective evaluation shows that our algorithm is especially promising in preserving line/curve features and motion details.

[1]  Xinhua Zhuang,et al.  Fast motion estimation and mode decision for H.264 video coding in packet loss environment , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[2]  Xueming Qian,et al.  Global motion estimation from randomly selected motion vector groups and GM/LM based applications , 2007, Signal Image Video Process..

[3]  David G. Messerschmitt,et al.  Resynchronization of motion compensated video affected by ATM cell loss , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Shao-Yi Chien,et al.  Enhanced temporal error concealment algorithm with edge-sensitive processing order , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[5]  Xueming Qian,et al.  Recovering Connected Error Region Based on Adaptive Error Concealment Order Determination , 2009, IEEE Transactions on Multimedia.

[6]  Mark R. Pickering,et al.  Video error concealment using decoder motion vector estimation , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[7]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Wen-Nung Lie,et al.  Video Error Concealment by Integrating Greedy Suboptimization and Kalman Filtering Techniques , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Thomas Eriksson,et al.  Packet Video Error Concealment With Gaussian Mixture Models , 2008, IEEE Transactions on Image Processing.

[10]  Lap-Pui Chau,et al.  A motion vector recovery algorithm for digital video using Lagrange interpolation , 2003, IEEE Trans. Broadcast..

[11]  Tsung-Han Tsai,et al.  Video error concealment techniques using progressive interpolation and boundary matching algorithm , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[12]  Xueming Qian,et al.  An effective GM/LM-based video error concealment , 2012, Signal Image Video Process..

[13]  H. A. Karim,et al.  Depth image-based spatial error concealment for 3-D video transmission , 2010, 2010 IEEE Student Conference on Research and Development (SCOReD).

[14]  Michael R. Frater,et al.  A cell-loss concealment technique for MPEG-2 coded video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[15]  Wen Gao,et al.  Packet Video Error Concealment With Auto Regressive Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Bo Yan,et al.  Efficient Motion Vector Interpolation for Error Concealment of H.264/AVC , 2011, IEEE Transactions on Broadcasting.

[17]  Oscar C. Au,et al.  Edge-Directed Error Concealment , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Wen-Nung Lie,et al.  Video error concealment by using iterative dynamic-programming optimization , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Jian Feng,et al.  Loss recovery techniques for transmission of MPEG video over ATM networks , 1996, Proceedings of ICC/SUPERCOMM '96 - International Conference on Communications.

[21]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .

[22]  Wen-Nung Lie,et al.  Prescription-based error concealment technique for video transmission on error-prone channels , 2007, J. Vis. Commun. Image Represent..

[23]  Lap-Pui Chau,et al.  Efficient motion vector recovery algorithm for H.264 based on a polynomial model , 2005, IEEE Transactions on Multimedia.

[24]  Ioannis Pitas,et al.  Motion field estimation by vector rational interpolation for error concealment purposes , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[25]  Wen-Nung Lie,et al.  Video error concealment by integrating dynamic programming and adaptive Kalman filtering techniques , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[26]  Hyung-Myung Kim,et al.  Weighted boundary matching algorithm for error concealment in the MPEG-2 video bit stream , 1999, Signal Process..

[27]  Ming-Ting Sun,et al.  Global motion estimation from coarsely sampled motion vector field and the applications , 2003, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Oscar C. Au,et al.  Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation , 2008, IEEE Transactions on Multimedia.

[29]  Thomas Wiegand,et al.  Rate-Distortion Optimization for JVT/H.26L Video Coding in Packet Loss Environment , 2002 .

[30]  Ming-Ting Sun,et al.  A non-iterative motion vector based global motion estimation algorithm , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[31]  Shao-Yi Chien,et al.  Efficient Spatial-Temporal Error Concealment Algorithm and Hardware Architecture Design for H.264/AVC , 2010, IEEE Transactions on Circuits and Systems for Video Technology.