Multi-directional spatial error concealment using adaptive edge thresholding

In this paper, a new method for spatial concealment of missing areas in image and video signals transmitted over error prone infrastructures, is presented. The concealment process is performed in three steps. First, a novel technique is used to estimate the significant edges of missing areas after performing a directional edge analysis on the correctly received neighboring blocks of the missing areas. This technique uses the moments of the neighboring edge magnitudes to obtain an adaptive threshold for rejecting non-significant directions. Second, based on the predicted significant directions, an approximation is obtained for each missing pixel. Finally, for each pixel, we compute a weighted average by using two edge correspondence measures as weighting factors. Moreover, the adaptive thresholding of the edges let us include as many edges as necessary in the interpolation process. Experiments show that the proposed method outperforms the previous state of the art methods based on both subjective and objective measures.

[1]  Jechang Jeong,et al.  Fine directional interpolation for spatial error concealment , 2006, IEEE Transactions on Consumer Electronics.

[2]  Changseok Bae,et al.  Dynamic Multi-mode Switching Error Concealment Algorithm for H.264/AVC Video Applications , 2008, IEEE Transactions on Consumer Electronics.

[3]  Hamid Gharavi,et al.  Spatial interpolation algorithm for error concealment , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Ness B. Shroff,et al.  Error Concealment in Encoded Video Streams , 1998 .

[5]  André Kaup,et al.  Complex-Valued Frequency Selective Extrapolation for Fast Image and Video Signal Extrapolation , 2010, IEEE Signal Processing Letters.

[6]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[7]  André Kaup,et al.  Fast orthogonality deficiency compensation for improved frequency selective image extrapolation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Min Wu,et al.  Classification-Based Spatial Error Concealment for Visual Communications , 2006, EURASIP J. Adv. Signal Process..

[9]  Til Aach,et al.  Frequency selective signal extrapolation with applications to error concealment in image communication , 2005 .

[10]  Myounghoon Kim,et al.  Spatial error concealment for H.264 using sequential directional interpolation , 2008, IEEE Transactions on Consumer Electronics.

[11]  Byoung-Ju Yun,et al.  POCS-based error concealment using interlayer correlation and features of neighbor blocks in multi-layer video coding , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[12]  Oscar C. Au,et al.  Edge-Directed Error Concealment , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Liu Da The Error Concealment Feature in the H.26L Test Model , 2003 .

[14]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[15]  Hamid R. Rabiee,et al.  A Gaussian Process Regression Framework for Spatial Error Concealment with Adaptive Kernels , 2010, 2010 20th International Conference on Pattern Recognition.

[16]  Hayder Radha,et al.  Error concealment of still image and video streams with multi-directional recursive nonlinear filters , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[17]  Weisi Lin,et al.  Bayesian error concealment with DCT pyramid , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Jeffrey J. Rodriguez,et al.  Low complexity error concealment scheme for intra-frames in H.264/AVC , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).