Spatial Error Concealment With an Adaptive Linear Predictor

In this paper, a novel spatial error concealment (EC) algorithm is proposed. Under the sequential recovery framework, pixels in missing blocks are successively reconstructed based on adaptive linear predictor. The predictor automatically tunes its order and support shape according to local contexts. The predictor order and support shape are determined using Bayesian information criterion, which is able to strike a balance between the bias and variance of the prediction errors. The flexibility of the order-adaptive predictor is able to recover more important features or structures. A novel scan order based on the uncertainty of each pixel is also proposed to alleviate error propagation problem. Compared with the state-of-the-art EC algorithms, experimental results show that the proposed method gives better reconstruction performance in terms of objective and subjective evaluations.

[1]  Michael R. Frater,et al.  A cell-loss concealment technique for MPEG-2 coded video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[5]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[6]  Chang-Su Kim,et al.  Efficient Multi-Hypothesis Error Concealment Technique for H.264 , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[7]  Carola-Bibiane Schönlieb,et al.  Combined First and Second Order Total Variation Inpainting using Split Bregman , 2013, Image Process. Line.

[8]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[9]  Oscar C. Au,et al.  Edge-Directed Error Concealment , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Hamid R. Rabiee,et al.  Signal Extrapolation for Image and Video Error Concealment Using Gaussian Processes With Adaptive Nonstationary Kernels , 2012, IEEE Signal Processing Letters.

[11]  Weisi Lin,et al.  Bayesian Error Concealment With DCT Pyramid for Images , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[13]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[14]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[16]  A Leon-Garcia,et al.  Information loss recovery for block-based image coding techniques-a fuzzy logic approach , 1995, IEEE Trans. Image Process..

[17]  Søren Holdt Jensen,et al.  Sequential Error Concealment for Video/Images by Sparse Linear Prediction , 2013, IEEE Transactions on Multimedia.

[18]  Wen Gao,et al.  Packet Video Error Concealment With Auto Regressive Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Didier J. Le Gall,et al.  The MPEG video compression standard , 1991, Compcon.

[20]  Antonio M. Peinado,et al.  On the application of multivariate kernel density estimation to image error concealment , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Sang Uk Lee,et al.  Recovery of corrupted image data based on the NURBS interpolation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[22]  C.-C. Jay Kuo,et al.  Spatial and Temporal Error Concealment Techniques for Video Transmission Over Noisy Channels , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Ángel M. Gómez,et al.  Error concealment based on MMSE estimation for multimedia wireless and IP applications , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[24]  André Kaup,et al.  Fast orthogonality deficiency compensation for improved frequency selective image extrapolation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  Lei Zhang,et al.  SSIM-Based Error Resilient Video Coding over Packet-Switched Networks , 2012, PCM.

[26]  Charles Kervrann,et al.  Local Adaptivity to Variable Smoothness for Exemplar-Based Image Regularization and Representation , 2008, International Journal of Computer Vision.

[27]  Yao Zhao,et al.  Real-Time Video Streaming Using Randomized Expanding Reed–Solomon Code , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Nasir D. Memon,et al.  An analysis of some common scanning techniques for lossless image coding , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[29]  Antonio M. Peinado,et al.  Spatial Error Concealment Based on Edge Visual Clearness for Image/Video Communication , 2013, Circuits Syst. Signal Process..

[30]  Wenjun Zhang,et al.  Adaptive Sequential Prediction of Multidimensional Signals With Applications to Lossless Image Coding , 2011, IEEE Transactions on Image Processing.

[31]  Rabab Kreidieh Ward,et al.  An adaptive Markov random field based error concealment method for video communication in an error prone environment , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[32]  Wenjun Zeng,et al.  Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[33]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[34]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[35]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[36]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[37]  Jianfei Cai,et al.  Image error-concealment via Block-based Bilateral Filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[38]  Robert J. Marks,et al.  Recovery of image blocks using the method of alternating projections , 2005, IEEE Transactions on Image Processing.

[39]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[40]  Søren Holdt Jensen,et al.  Sequential Error Concealment for Video/Images by Weighted Template Matching , 2012, 2012 Data Compression Conference.

[41]  Shih-Chang Hsia An edge-oriented spatial interpolation for consecutive block error concealment , 2004, IEEE Signal Process. Lett..

[42]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[43]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[44]  Xueming Qian,et al.  Recovering Connected Error Region Based on Adaptive Error Concealment Order Determination , 2009, IEEE Transactions on Multimedia.

[45]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[46]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.