Unified deblocking for discrete cosine transfer compressed images

In general, an inevitable side effect of the block-based transform coding includes grid noise in the monotone area, staircase noise along the edges, ringing around the strong edges, corner outliers, and edge corruption near the block boundaries. We propose a comprehensive postprocessing method for removing all the blocking-related artifacts in block-based discrete cosine transfer compressed image in the framework of overcomplete wavelet expansion (OWE) proposed by Mallat and Zhong [IEEE Trans. Pattern Anal. Mach. Intell 14(7), 710–732 (1992)], which is translationally invariant and can efficiently characterize signal singularities. We propose to use the wavelet transform modulus maxima extension (WTMME) to represent the image. The WTMME is extracted from the wavelet coefficients of three-level OWE of the blocky image. The artifacts related to blockiness are modeled and detected through multiscale edge analysis of the image using the information of both modulus and angle. Both the WTMME and the angle image are reconstructed accordingly using inter-/intraband correlation to suppress the influence of the distortions. Finally, the inverse OWE transform is performed for the processed image. Because the algorithm takes no assumption that the blockiness occurs at block boundaries, it is also applicable to video, where due to motion estimation and compensation, the grid noise may propagate into blocks. Extensive simulation and comparative study with 21 exiting relevant algorithms have demonstrated the effectiveness of the proposed algorithm in terms of subjective and objective quality of the resultant images.

[1]  R. Stevenson,et al.  DCT quantization noise in compressed images , 2005 .

[2]  Stanley J. Reeves,et al.  Comments on "Iterative procedures for reduction of blocking effects in transform image coding" , 1993, IEEE Trans. Circuits Syst. Video Technol..

[3]  Nikolas P. Galatsanos,et al.  Regularized reconstruction to reduce blocking artifacts of block discrete cosine transform compressed images , 1993, IEEE Trans. Circuits Syst. Video Technol..

[4]  G. Lakhani,et al.  Derivation of prediction equations for blocking effect reduction , 1999, IEEE Trans. Circuits Syst. Video Technol..

[5]  Michael T. Orchard,et al.  A deblocking algorithm for JPEG compressed images using overcomplete wavelet representations , 1997, IEEE Trans. Circuits Syst. Video Technol..

[6]  Alan C. Bovik,et al.  . Efficient DCT-domain blind measurement and reduction of blocking artifacts , 2002, IEEE Trans. Circuits Syst. Video Technol..

[7]  Sang Uk Lee,et al.  A DCT-based spatially adaptive post-processing technique to reduce the blocking artifacts in transform coded images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[8]  Hong Yan,et al.  Artifact reduction in compressed images based on region homogeneity constraints using the projection onto convex sets algorithm , 2002, IEEE Trans. Circuits Syst. Video Technol..

[9]  Chung J. Kuo,et al.  Adaptive postprocessor for block encoded images , 1995, IEEE Trans. Circuits Syst. Video Technol..

[10]  Jechang Jeong,et al.  Blocking artifacts reduction in image compression with block boundary discontinuity criterion , 1998, IEEE Trans. Circuits Syst. Video Technol..

[11]  Aggelos K. Katsaggelos,et al.  Iterative Image Restoration Algorithms , 1989 .

[12]  Ken D. Sauer,et al.  A generalized Gaussian image model for edge-preserving MAP estimation , 1993, IEEE Trans. Image Process..

[13]  D. Lun,et al.  Application of singularity detection for the deblocking of JPEG decoded images , 1998 .

[14]  Avideh Zakhor,et al.  An optimization approach for removing blocking effects in transform coding , 1995, IEEE Trans. Circuits Syst. Video Technol..

[15]  Faouzi Kossentini,et al.  H.263+: video coding at low bit rates , 1998, IEEE Trans. Circuits Syst. Video Technol..

[16]  Bhaskar Ramamurthi,et al.  Nonlinear space-variant postprocessing of block coded images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[17]  Sang Uk Lee,et al.  On the POCS-based postprocessing technique to reduce the blocking artifacts in transform coded images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[18]  Guoliang Fan,et al.  Postprocessing of low bit-rate wavelet-based image coding using multiscale edge characterization , 2001, IEEE Trans. Circuits Syst. Video Technol..

[19]  Bing Zeng,et al.  Reduction of blocking effect in DCT-coded images using zero-masking techniques , 1999, Signal Process..

[20]  Wan-Chi Siu,et al.  A deblocking technique for block-transform compressed image using wavelet transform modulus maxima , 1998, IEEE Trans. Image Process..

[21]  C.-C. Jay Kuo,et al.  Coding artifact removal with multiscale postprocessing , 1997, Proceedings of International Conference on Image Processing.

[22]  Yongmin Kim,et al.  A de-blocking algorithm and a blockiness metric for highly compressed images , 2002, IEEE Trans. Circuits Syst. Video Technol..

[23]  Ali M. Reza,et al.  Combined edge crispiness and statistical differencing for deblocking JPEG compressed images , 2001, IEEE Trans. Image Process..

[24]  Amir Averbuch,et al.  Deblocking of block-transform compressed images using weighted sums of symmetrically aligned pixels , 2005, IEEE Transactions on Image Processing.

[25]  Rabab Kreidieh Ward,et al.  Removing the blocking artifacts of block-based DCT compressed images , 2003, IEEE Trans. Image Process..

[26]  Edward J. Delp,et al.  Block artifact reduction using a transform-domain Markov random field model , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Jar-Ferr Yang,et al.  Adaptive postprocessors with DCT-based block classifications , 2003, IEEE Trans. Circuits Syst. Video Technol..

[28]  Nam Chul Kim,et al.  Reduction of blocking artifact in block-coded images using wavelet transform , 1998, IEEE Trans. Circuits Syst. Video Technol..

[29]  Ju Jia Zou,et al.  A deblocking method for BDCT compressed images based on adaptive projections , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Robert L. Stevenson,et al.  Reduction of coding artifacts in transform image coding , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[31]  Jiebo Luo,et al.  Artifact reduction in low bit rate DCT-based image compression , 1996, IEEE Trans. Image Process..

[32]  Avideh Zakhor Iterative procedures for reduction of blocking effects in transform image coding , 1992, IEEE Trans. Circuits Syst. Video Technol..

[33]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[34]  Karel Rijkse ITU standardisation of very low bitrate video coding algorithms , 1995, Signal Process. Image Commun..

[35]  Ajay Luthra,et al.  Introduction to the Special Issue on Scalable Video Coding-Standardization and Beyond , 2007, IEEE Trans. Circuits Syst. Video Technol..

[36]  Yung-Chang Chen,et al.  A new adaptive separable median filter for removing blocking effects , 1993 .

[37]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[39]  Tao Chen,et al.  Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts , 2001, IEEE Trans. Circuits Syst. Video Technol..

[40]  V. Ramamoorthy Removal of 'staircase' effects in coarsely quantized video sequences , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[41]  Aggelos K. Katsaggelos,et al.  Image and video compression algorithms based on recovery techniques using mean field annealing , 1995, Proc. IEEE.

[42]  Taejeong Kim,et al.  Blocking-artifact reduction in block-coded images using wavelet-based subband decomposition , 2000, IEEE Trans. Circuits Syst. Video Technol..

[43]  H. Kalva The H.264 Video Coding Standard , 2006, IEEE MultiMedia.

[44]  Ramesh A. Gopinath,et al.  Wavelet-based post-processing of low bit rate transform coded images , 1994, Proceedings of 1st International Conference on Image Processing.

[45]  Nikolas P. Galatsanos,et al.  Removal of compression artifacts using projections onto convex sets and line process modeling , 1997, IEEE Trans. Image Process..

[46]  H. W. Park,et al.  Blocking effect reduction of JPEG images by signal adaptive filtering , 1998, IEEE Trans. Image Process..

[47]  John G. Apostolopoulos,et al.  Postprocessing for very low bit-rate video compression , 1999, IEEE Trans. Image Process..

[48]  Hyunchul Kang,et al.  A practical projection-based postprocessing of block-coded images with fast convergence rate , 2000, IEEE Trans. Circuits Syst. Video Technol..

[49]  Michael G. Strintzis,et al.  Blocking artifact detection and reduction in compressed data , 2002, IEEE Trans. Circuits Syst. Video Technol..

[50]  Jar-Ferr Yang,et al.  Efficient postprocessor for blocky effect removal based on transform characteristics , 1997, IEEE Trans. Circuits Syst. Video Technol..

[51]  Hong Yan,et al.  POCS-based blocking artifacts suppression using a smoothness constraint set with explicit region modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[52]  Yung Lyul Lee,et al.  A postprocessing method for reducing quantization effects in low bit-rate moving picture coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[53]  Hong Yan,et al.  An efficient wavelet-based deblocking algorithm for highly compressed images , 2001, IEEE Trans. Circuits Syst. Video Technol..

[54]  Seop Hyeong Park,et al.  Theory of projection onto the narrow quantization constraint set and its application , 1999, IEEE Trans. Image Process..

[55]  Dong Wei,et al.  Optimal wavelet thresholding for various coding schemes , 1995, Proceedings., International Conference on Image Processing.

[56]  Hong Yan,et al.  Blocking artifacts suppression in block-coded images using overcomplete wavelet representation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[57]  Amlan Kundu,et al.  Enhancement of JPEG coded images by adaptive spatial filtering , 1995, Proceedings., International Conference on Image Processing.

[58]  Robert L. Stevenson,et al.  Improved image decompression for reduced transform coding artifacts , 1994, Electronic Imaging.