Sparse Recovery-Based Error Concealment

Image and video transmission over heterogeneous networks may encounter packet loss due to the channel impairments, leading to quality degradation of the received image. In this paper, a novel robust image transmission system is proposed by casting the error concealment challenge into a sparse recovery framework. To this purpose, a robust encoder is carefully designed in order to mitigate the negative effects of the packet loss. After wavelet decomposition, a quadtree structure of the wavelet coefficients is used to rearrange them into independent partitions. Random linear combinations of coefficients for each partition are then adopted to provide a high error recovery capability. This linear process coupled with a simple packetization process introduces more robustness and error resilience into the transmission system. At the receiver side, the tree-sparse structure of the wavelet coefficients is explicitly exploited in order to model the error recovery problem as a sparse recovery framework. This is achieved by adaptation of a well-known iterative sparse reconstruction algorithm to the defined tree structure built in the wavelet domain. Compared with the state-of-the-art error concealment algorithms, experimental results show that the proposed method has better reconstruction performance in terms of objective and subjective evaluations over a range of packet loss rates, and ensure that a high-quality image can be recovered for the high packet loss scenarios.

[1]  Weisi Lin,et al.  Bayesian Error Concealment With DCT Pyramid for Images , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[3]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .

[4]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[5]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[6]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[7]  Richard G. Baraniuk,et al.  Democracy in Action: Quantization, Saturation, and Compressive Sensing , 2011 .

[8]  Hamid R. Rabiee,et al.  Multi-directional spatial error concealment using adaptive edge thresholding , 2012, IEEE Transactions on Consumer Electronics.

[9]  Junzhou Huang,et al.  Forest Sparsity for Multi-Channel Compressive Sensing , 2012, IEEE Transactions on Signal Processing.

[10]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[11]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[12]  Xiao Su,et al.  A survey of error-concealment schemes for real-time audio and video transmissions over the Internet , 2000, Proceedings International Symposium on Multimedia Software Engineering.

[13]  Thierry Blu,et al.  Mathematical properties of the JPEG2000 wavelet filters , 2003, IEEE Trans. Image Process..

[14]  Antonio M. Peinado,et al.  Kernel-Based MMSE Multimedia Signal Reconstruction and Its Application to Spatial Error Concealment , 2014, IEEE Transactions on Multimedia.

[15]  Søren Holdt Jensen,et al.  Sequential Error Concealment for Video/Images by Sparse Linear Prediction , 2013, IEEE Transactions on Multimedia.

[16]  Michel Barlaud,et al.  Image coding using wavelet transform , 1992, IEEE Trans. Image Process..

[17]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[18]  Jianfei Cai,et al.  Image error-concealment via Block-based Bilateral Filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[19]  Maria Trocan,et al.  Sparse recovery-based error concealment for multiview images , 2015, 2015 International Workshop on Computational Intelligence for Multimedia Understanding (IWCIM).

[20]  Ali Tabatabai,et al.  Sub-band coding of digital images using symmetric short kernel filters and arithmetic coding techniques , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[21]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[22]  Rabab Kreidieh Ward,et al.  An adaptive Markov random field based error concealment method for video communication in an error prone environment , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[23]  Ronald A. DeVore,et al.  Image compression through wavelet transform coding , 1992, IEEE Trans. Inf. Theory.

[24]  S.-H. Yang,et al.  Robust Transmission of SPIHT-Coded Images Over Packet Networks , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Antonio M. Peinado,et al.  Spatial Error Concealment Based on Edge Visual Clearness for Image/Video Communication , 2013, Circuits Syst. Signal Process..

[26]  Michael Elad,et al.  Dictionaries for Sparse Representation Modeling , 2010, Proceedings of the IEEE.

[27]  Nirmal K. Bose,et al.  Classified zerotree wavelet image coding and adaptive packetization for low-bit-rate transport , 2001, IEEE Trans. Circuits Syst. Video Technol..

[28]  André Kaup,et al.  Frequency selective extrapolation with residual filtering for image error concealment , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Guangtao Zhai,et al.  Spatial Error Concealment With an Adaptive Linear Predictor , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Lei Cao,et al.  Robust multiple description image coding over wireless networks based on wavelet tree coding, error resilient entropy coding, and error concealment , 2008, J. Vis. Commun. Image Represent..

[31]  James E. Fowler,et al.  Block Compressed Sensing of Images Using Directional Transforms , 2010, 2010 Data Compression Conference.

[32]  Myounghoon Kim,et al.  Spatial error concealment for H.264 using sequential directional interpolation , 2008, IEEE Transactions on Consumer Electronics.

[33]  Yücel Altunbasak,et al.  Error-resilient image and video transmission over the Internet using unequal error protection , 2003, IEEE Trans. Image Process..

[34]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[35]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[36]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[37]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..