No-reference noticeable blockiness estimation in images

Blocking artifact is a prevailing degradation caused by the block-based Discrete Cosine Transform (BDCT) coding technique under low bit-rate conditions. In this paper, we propose an efficient no-reference noticeable blockiness estimation algorithm for BDCT coded images. The difference on block boundaries is first measured and then transformed into the block discontinuity map. We consider the effects of luminance adaptation and texture masking on blocking and integrate them using a nonlinear operator to form an overall masking map. This map is finally incorporated with the discontinuity map to generate Noticeable Blockiness Map (NBM), which can be used to guide perceptual quality assessment, codec parameter optimization, post-processing, etc. We have demonstrated the validity of the NBM through its applications in no-reference image quality assessment and image deblocking.

[1]  Heidi A. Peterson,et al.  Luminance-model-based DCT quantization for color image compression , 1992, Electronic Imaging.

[2]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[3]  Lina J. Karam,et al.  Locally adaptive perceptual image coding , 2000, IEEE Trans. Image Process..

[4]  James D. Johnston,et al.  Spatial noise shaping based on human visual sensitivity and its application to image coding , 2002, IEEE Trans. Image Process..

[5]  Avideh Zakhor.  Iterative procedures for reduction of blocking effects in transform image coding , 1992, IEEE Trans. Circuits Syst. Video Technol..

[6]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[7]  Lina J. Karam,et al.  Adaptive image coding with perceptual distortion control , 2002, IEEE Trans. Image Process..

[8]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[9]  Weisi Lin,et al.  Perceptual quality and objective quality measurements of compressed videos , 2006, J. Vis. Commun. Image Represent..

[10]  Trac D. Tran,et al.  A locally adaptive perceptual masking threshold model for image coding , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[11]  Hong Yan,et al.  Blocking artifacts suppression in block-coded images using overcomplete wavelet representation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Andrew B. Watson,et al.  Digital images and human vision , 1993 .

[13]  Stefan Winkler,et al.  Quality metric design: a closer look , 2000, Electronic Imaging.

[14]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[15]  King Ngi Ngan,et al.  Adaptive cosine transform coding of images in perceptual domain , 1989, IEEE Trans. Acoust. Speech Signal Process..

[16]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[17]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[18]  Francesc J. Ferri,et al.  Perceptual feedback in multigrid motion estimation using an improved DCT quantization , 2001, IEEE Trans. Image Process..

[19]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[20]  Weisi Lin,et al.  Rate control for videophone using local perceptual cues , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  W.S. Lin,et al.  Just-noticeable-distortion profile with nonlinear additivity model for perceptual masking in color images , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[22]  R. J. Safranek,et al.  A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[23]  Robert J. Safranek,et al.  Signal compression based on models of human perception , 1993, Proc. IEEE.

[24]  Anastasios N. Venetsanopoulos,et al.  A perceptual model for JPEG applications based on block classification, texture masking, and luminance masking , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[25]  Andrew B. Watson,et al.  DCTune: A TECHNIQUE FOR VISUAL OPTIMIZATION OF DCT QUANTIZATION MATRICES FOR INDIVIDUAL IMAGES. , 1993 .

[26]  John D. Villasenor,et al.  Visibility of wavelet quantization noise , 1997, IEEE Transactions on Image Processing.

[27]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[28]  Chun-Hsien Chou,et al.  A perceptually optimized 3-D subband codec for video communication over wireless channels , 1996, IEEE Trans. Circuits Syst. Video Technol..

[29]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[30]  Murat Kunt,et al.  Performance comparison of masking models based on a new psychovisual test method with natural scenery stimuli , 2002, Signal Process. Image Commun..

[31]  Tao Chen,et al.  Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts , 2001, IEEE Trans. Circuits Syst. Video Technol..

[32]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[33]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[34]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  B. Wandell.  Foundations of vision , 1995 .

[36]  Stanley A. Klein,et al.  Seven models of masking , 1997, Electronic Imaging.

[37]  Christian J. Van Den Branden Lambrecht.  Color moving pictures quality metric , 1996, ICIP.

[38]  Stanley J. Reeves,et al.  Comments on "Iterative procedures for reduction of blocking effects in transform image coding" , 1993, IEEE Trans. Circuits Syst. Video Technol..

[39]  Susu Yao,et al.  Just noticeable distortion model and its applications in video coding , 2005, Signal Process. Image Commun..

[40]  H.R. Wu,et al.  A generalized block-edge impairment metric for video coding , 1997, IEEE Signal Processing Letters.

[41]  Toby Berger,et al.  A software-only videocodec using pixelwise conditional differential replenishment and perceptual enhancements , 1999, IEEE Trans. Circuits Syst. Video Technol..