An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering

Error concealment at the decoder side is an economical approach to ensuring an acceptable and stable video quality in case of packet erasure or loss, and thus, it has attracted considerable research and application interest. Relevant techniques usually employ the spatial or temporal correlation to recover the motion vectors (MVs) of the missing blocks, and interpolation, extrapolation, or boundary-matching schemes are usually effective. However, for heavily corrupted sequences, e.g., with block loss rate beyond 50 %, most methods might perform less satisfactorily. Inspired by the tracking efficiency of Kalman filter (KF), in the present work, we adopted it to predict the missing MVs, and the unpredicted ones (minority) were restored complementarily using a modified bilinear motion field interpolation (MFI) method. Since the KF prediction is independent of the loss rate, the present framework proves to be robust for heavily corrupted videos. Experimental results on typical sequences reveal that the proposed algorithm outperforms the boundary-matching algorithm embedded in the H.264/AVC reference code, the MFI and the MV extrapolation techniques in the literature.

[1]  Fredrik Gustafsson,et al.  Extended Target Tracking Using Polynomials With Applications to Road-Map Estimation , 2011, IEEE Transactions on Signal Processing.

[2]  Avinash C. Kak,et al.  A multi-Kalman filtering approach for video tracking of human-delineated objects in cluttered environments , 2005, Computer Vision and Image Understanding.

[3]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[4]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[5]  N. Canagarajah,et al.  Temporal error concealment using motion field interpolation , 1999 .

[6]  Ali H. Sayed,et al.  A Robust Finger Tracking Method for Multimodal Wearable Computer Interfacing , 2006, IEEE Transactions on Multimedia.

[7]  Xiaoqin Zhang,et al.  Multiple Object Tracking Via Species-Based Particle Swarm Optimization , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  David Bull,et al.  Motion field interpolation for temporal error concealment , 2000 .

[9]  Pradipta Kishore Dash,et al.  Fast Tracking of Power Quality Disturbance Signals Using an Optimized Unscented Filter , 2009, IEEE Transactions on Instrumentation and Measurement.

[10]  Avinash C. Kak,et al.  A multi-Kalman filtering approach for video tracking of human-delineated objects in cluttered environments , 2005, Comput. Vis. Image Underst..

[11]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Cedric Nishan Canagarajah,et al.  Error concealment using motion field interpolation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[13]  Eric A. Wan,et al.  RSSI-Based Indoor Localization and Tracking Using Sigma-Point Kalman Smoothers , 2009, IEEE Journal of Selected Topics in Signal Processing.

[14]  Rómer Rosales,et al.  A framework for heading-guided recognition of human activity , 2003, Comput. Vis. Image Underst..

[15]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[16]  Wen-Nung Lie,et al.  Video error concealment by using Kalman-filtering technique , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[17]  Leyza Baldo Dorini,et al.  Unscented feature tracking , 2011, Comput. Vis. Image Underst..

[18]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[19]  Bradley J. Nelson,et al.  A Dynamic Region-of-Interest Vision Tracking System Applied to the Real-Time Wing Kinematic Analysis of Tethered Drosophila , 2010, IEEE Transactions on Automation Science and Engineering.

[20]  Jin Young Choi,et al.  Hierarchical Kalman-particle filter with adaptation to motion changes for object tracking , 2011, Comput. Vis. Image Underst..

[21]  Enrico Magli,et al.  An error concealment algorithm for streaming video , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[22]  Zhenyu Wu,et al.  An error concealment scheme for entire frame losses based on H.264/AVC , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[23]  Eric J. Seibel,et al.  In Vivo Validation of a Hybrid Tracking System for Navigation of an Ultrathin Bronchoscope Within Peripheral Airways , 2010, IEEE Transactions on Biomedical Engineering.

[24]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[25]  Jiang Li,et al.  An Error Concealment Algorithm for Entire Frame Loss in Video Transmission , 2004 .

[26]  Oswald Lanz,et al.  Approximate Bayesian multibody tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jan Mochnac,et al.  Kalman filter based error concealment algorithm , 2009 .

[28]  C.-C. Jay Kuo,et al.  Low-complexity video error concealment for mobile applications using OBMA , 2008, IEEE Transactions on Consumer Electronics.

[29]  F. Jay Breidt,et al.  Highest density gates for target tracking , 2000, IEEE Trans. Aerosp. Electron. Syst..