Video Motion Vector Recovery Method Using Decoding Partition Information

This paper presents a novel motion vector recovery and error concealment algorithm with the utilization of encoding partition information for H.264/AVC. The motion vectors for each missing pixel location are derived using available neighboring pixel motion vectors, which contribute to the generation of the missing motion vectors inversely proportional to the distance between them. The motion extrapolation method is used to project the encoding partition information from the reference frame into the current frame with different levels of overlapping of lost pixels. The different levels of overlapping can help determine the estimated encoding partition information in the lost macroblock (MB). Finally, the pixels that are determined to be of the same estimated partition share the same motion vector in order to maintain the integrity of the estimated moving objects in the lost MB. This proposed pixel-based motion vector with partition (PMVP) method compares with the state-of-the-art Zhou's method, Lin's method, and Lie's method. For total average in packet loss rates of 3%, 7%, 16%, and 20%, PMVP is better than Zhou by 0.88, 1.02, 1.05, and 1.01 dB, respectively; Lin by 0.22, 0.32, 0.35, and 0.33 dB, respectively; and Lie by 4.12, 4.98, 4.15, and 3.88 dB, respectively. Therefore, the proposed PMVP performs the best on average among all the methods.

[1]  Oscar C. Au,et al.  Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation , 2008, IEEE Transactions on Multimedia.

[2]  Xueming Qian,et al.  Recovering Connected Error Region Based on Adaptive Error Concealment Order Determination , 2009, IEEE Transactions on Multimedia.

[3]  Bo Yan,et al.  Efficient Motion Vector Interpolation for Error Concealment of H.264/AVC , 2011, IEEE Transactions on Broadcasting.

[4]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[5]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[6]  Bo Yan,et al.  Pixel Interlacing Based Video Transmission for Low-Complexity Intra-Frame Error Concealment , 2011, IEEE Transactions on Broadcasting.

[7]  Shih-Chang Hsia An edge-oriented spatial interpolation for consecutive block error concealment , 2004, IEEE Signal Process. Lett..

[8]  V. Kamakoti,et al.  Efficient Motion Vector Recovery Algorithm for H.264 Using B-Spline Approximation , 2010, IEEE Transactions on Broadcasting.

[9]  Yo-Sung Ho,et al.  Error concealment technique based on optical flow , 2002 .

[10]  Weisi Lin,et al.  Bayesian Error Concealment With DCT Pyramid for Images , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  André Kaup,et al.  Inter-Sequence Error Concealment Techniques for Multi-Broadcast TV Reception , 2011, IEEE Transactions on Broadcasting.

[12]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[13]  Wen-Nung Lie,et al.  Motion Vector Recovery for Video Error Concealment by Using Iterative Dynamic-Programming Optimization , 2014, IEEE Transactions on Multimedia.

[14]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[15]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Yanling Xu,et al.  H.264 video communication based refined error concealment schemes , 2004, IEEE Transactions on Consumer Electronics.

[17]  Liu Da The Error Concealment Feature in the H.26L Test Model , 2003 .

[18]  Wen Gao,et al.  Packet Video Error Concealment With Auto Regressive Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Cedric Nishan Canagarajah,et al.  Enhanced error concealment with mode selection , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Jun Wu,et al.  A temporal error concealment method for H.264/AVC using motion vector recovery , 2008, IEEE Transactions on Consumer Electronics.

[21]  Kuei-Ting Kuo,et al.  An Adaptive Error Concealment Method Based on Fuzzy Reasoning for Multi-View Video Coding , 2014, Journal of Display Technology.

[22]  Wen-Chih Chen,et al.  Recovery of Lost Motion Vectors Using Encoded Residual Signals , 2013, IEEE Transactions on Broadcasting.

[23]  Dinh Trieu Duong,et al.  Hybrid Temporal Error Concealment Methods for Block-Based Compressed Video Transmission , 2008, IEEE Transactions on Broadcasting.