Efficient image/video deblocking via sparse representation

Blocking artifact, characterized by visually noticeable changes in pixel values along block boundaries, is a common problem in block-based image/video compression, especially at low bitrate coding. Various post-processing techniques have been proposed to reduce blocking artifacts, but they usually introduce excessive blurring or ringing effects. This paper proposes a self-learning-based image/ video deblocking framework via properly formulating deblocking as an MCA (morphological component analysis)-based image decomposition problem via sparse representation. The proposed method first decomposes an image/video frame into the low-frequency and high-frequency parts by applying BM3D (block-matching and 3D filtering) algorithm. The high-frequency part is then decomposed into a “blocking component” and a “non-blocking component” by performing dictionary learning and sparse coding based on MCA. As a result, the blocking component can be removed from the image/video frame successfully while preserving most original image/video details. Experimental results demonstrate the efficacy of the proposed algorithm.

[1]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[2]  Aggelos K. Katsaggelos,et al.  Image and video compression algorithms based on recovery techniques using mean field annealing , 1995, Proc. IEEE.

[3]  Alan C. Bovik,et al.  . Efficient DCT-domain blind measurement and reduction of blocking artifacts , 2002, IEEE Trans. Circuits Syst. Video Technol..

[4]  Kyu Ho Park,et al.  Variable block-based deblocking filter for H.264/AVC on low-end and low-bit rates terminals , 2010, Signal Process. Image Commun..

[5]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[6]  Nikolas P. Galatsanos,et al.  Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images , 1993, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ali M. Reza,et al.  Combined edge crispiness and statistical differencing for deblocking JPEG compressed images , 2001, IEEE Trans. Image Process..

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Yu-Hsiang Fu,et al.  Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition , 2012, IEEE Transactions on Image Processing.

[10]  D. Marpe,et al.  The H . 264 / AVC Video Coding Standard , 2004 .

[11]  Gary J. Sullivan,et al.  The H.264/AVC Video Coding Standard [Standards in a Nutshell] , 2007 .

[12]  Avideh Zakhor Iterative procedures for reduction of blocking effects in transform image coding , 1992, IEEE Trans. Circuits Syst. Video Technol..

[13]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[14]  Allen Gersho,et al.  Improved decoder for transform coding with application to the JPEG baseline system , 1992, IEEE Trans. Commun..

[15]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[16]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[17]  Licheng Jiao,et al.  Image deblocking via sparse representation , 2012, Signal Process. Image Commun..

[18]  Chia-Hung Yeh,et al.  Post-processing deblocking filter algorithm for various video decoders , 2012 .

[19]  Amir Averbuch,et al.  Deblocking of block-transform compressed images using weighted sums of symmetrically aligned pixels , 2005, IEEE Transactions on Image Processing.

[20]  Mohamed-Jalal Fadili,et al.  Image Decomposition and Separation Using Sparse Representations: An Overview , 2010, Proceedings of the IEEE.

[21]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[22]  Sang Uk Lee,et al.  On the POCS-based postprocessing technique to reduce the blocking artifacts in transform coded images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[23]  Wan-Chi Siu,et al.  A deblocking technique for block-transform compressed image using wavelet transform modulus maxima , 1998, IEEE Trans. Image Process..

[24]  Hyunchul Kang,et al.  A practical projection-based postprocessing of block-coded images with fast convergence rate , 2000, IEEE Trans. Circuits Syst. Video Technol..

[25]  Shen-Chuan Tai,et al.  Deblocking filter for low bit rate MPEG-4 video , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Thomas Sikora,et al.  Trends and Perspectives in Image and Video Coding , 2005, Proceedings of the IEEE.

[27]  Jiebo Luo,et al.  Artifact reduction in low bit rate DCT-based image compression , 1996, IEEE Trans. Image Process..

[28]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[29]  Jani Lainema,et al.  Adaptive deblocking filter , 2003, IEEE Trans. Circuits Syst. Video Technol..