Survey of Error Concealment techniques: Research directions and open issues

Error Concealment (EC) techniques use either spatial, temporal or a combination of both types of information to recover the data lost in transmitted video. In this paper, existing EC techniques are reviewed, which are divided into three categories, namely Intra-frame EC, Inter-frame EC, and Hybrid EC techniques. We first focus on the EC techniques developed for the H.264/AVC standard. The advantages and disadvantages of these EC techniques are summarized with respect to the features in H.264. Then, the EC algorithms are also analyzed. These EC algorithms have been recently adopted in the newly introduced H.265/HEVC standard. A performance comparison between the classic EC techniques developed for H.264 and H.265 is performed in terms of the average PSNR. Lastly, open issues in the EC domain are addressed for future research consideration.

[1]  Pamela C. Cosman,et al.  Motion Compensated Error Concealment for HEVC Based on Block-Merging and Residual Energy , 2013, 2013 20th International Packet Video Workshop.

[2]  Linlin Zhu,et al.  Spatial error concealment for stereoscopic video coding based on pixel matching , 2010, The Journal of Supercomputing.

[3]  Wenjie Yang,et al.  H.264/AVC video error concealment algorithm by employing motion vector recovery under cloud computing environment , 2014, The Journal of Supercomputing.

[4]  Tieniu Tan,et al.  Brief review of invariant texture analysis methods , 2002, Pattern Recognit..

[5]  Chang Liu,et al.  Error Concealment for Whole Frame Loss in HEVC , 2012, IFTC.

[6]  C.-C. Jay Kuo,et al.  Spatial error concealment with sequence-aligned texture modeling and adaptive directional recovery , 2011, J. Vis. Commun. Image Represent..

[7]  Jie Zhu,et al.  Error-Resilient and Error Concealment 3-D SPIHT for Multiple Description Video Coding With Added Redundancy , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[9]  Bernd Girod,et al.  Feedback-based error control for mobile video transmission , 1999, Proc. IEEE.

[10]  Søren Holdt Jensen,et al.  Sequential Error Concealment for Video/Images by Weighted Template Matching , 2012, 2012 Data Compression Conference.

[11]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[12]  Antonio M. Peinado,et al.  Kernel-Based MMSE Multimedia Signal Reconstruction and Its Application to Spatial Error Concealment , 2014, IEEE Transactions on Multimedia.

[13]  Heng Li,et al.  Motion characteristic differentiated error concealment , 2011, Multimedia Tools and Applications.

[14]  Wen-Jiin Tsai,et al.  Joint Temporal and Spatial Error Concealment for Multiple Description Video Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Hamid R. Rabiee,et al.  Multi-directional spatial error concealment using adaptive edge thresholding , 2012, IEEE Transactions on Consumer Electronics.

[16]  Bo Yan,et al.  Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission , 2012, IEEE Trans. Multimedia.

[17]  André Kaup,et al.  Spatio-temporal error concealment in video by denoised temporal extrapolation refinement , 2013, 2013 IEEE International Conference on Image Processing.

[18]  Kiok Ahn,et al.  Edge-based spatial concealment of digital dropout error in degraded archived media , 2014 .

[19]  Markus Rupp,et al.  Error concealment analysis for H.264/advanced video coding encoded video sequences , 2012, e & i Elektrotechnik und Informationstechnik.

[20]  Yuan Zhou,et al.  Frame Loss Concealment for Multiview Video Transmission Over Wireless Multimedia Sensor Networks , 2015, IEEE Sensors Journal.

[21]  Shih-Hsuan Yang,et al.  An object-based error concealment technique for H.264 coded video , 2014, Multimedia Tools and Applications.

[22]  Ting-Lan Lin,et al.  Error concealment algorithm for HEVC coded video using block partition decisions , 2013, 2013 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2013).

[23]  Wen-Nung Lie,et al.  Motion Vector Recovery for Video Error Concealment by Using Iterative Dynamic-Programming Optimization , 2014, IEEE Transactions on Multimedia.

[24]  Gene Cheung,et al.  Video Error Concealment Using a Computation-Efficient Low Saliency Prior , 2013, IEEE Transactions on Multimedia.

[25]  Wen Gao,et al.  Packet Video Error Concealment With Auto Regressive Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Claudia Feregrino Uribe,et al.  Video Error Concealment Based on Data Hiding for the Emerging Video Technologies , 2013, PSIVT.

[27]  Masayuki Tanimoto,et al.  An Overview of 3D-TV System Using Depth-Image-Based Rendering , 2013 .

[28]  Zongliang Gan,et al.  Error Concealment Techniques for Video Transmission over Error-prone Channels: A Survey , 2012 .

[29]  Pamela C. Cosman,et al.  Error concealment for dual frame video coding with uneven quality , 2005, Data Compression Conference.

[30]  Yixuan Zhang,et al.  A Joint Source-Channel Video Coding Scheme Based on Distributed Source Coding , 2008, IEEE Transactions on Multimedia.

[31]  Kuei-Ting Kuo,et al.  An Adaptive Error Concealment Method Based on Fuzzy Reasoning for Multi-View Video Coding , 2014, Journal of Display Technology.

[32]  Huijuan Cui,et al.  An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering , 2014, Signal Image Video Process..

[33]  Antonio M. Peinado,et al.  Spatial Error Concealment Based on Edge Visual Clearness for Image/Video Communication , 2013, Circuits Syst. Signal Process..

[34]  Hamid R. Rabiee,et al.  Signal Extrapolation for Image and Video Error Concealment Using Gaussian Processes With Adaptive Nonstationary Kernels , 2012, IEEE Signal Processing Letters.

[35]  Nanning Zheng,et al.  Depth-Assisted Temporal Error Concealment for Intra Frame Slices in 3-D Video , 2014, IEEE Transactions on Broadcasting.