Reduced-reference image quality assessment in reorganized DCT domain

In this paper, a novel reduced-reference (RR) image quality assessment (IQA) is proposed by depicting the subband statistical characteristics in the reorganized discrete cosine transform (RDCT) domain. First, the block-based DCT coefficients are reorganized into a three-level coefficient tree, resulting in ten RDCT subbands. For the intra RDCT subband characteristic, the coefficient distribution of each RDCT subband is modeled by the generalized Gaussian density (GGD) function. The city-block distance (CBD) is employed to measure the modeling error between the actual distribution and the fitted GGD curve. For the inter RDCT subband characteristic, the mutual information (MI) is utilized to depict the dependencies between coefficient pairs in related RDCT subbands. Moreover, a frequency ratio descriptor (FRD) calculated in the RDCT domain is proposed to depict how the image energy distributes among different frequency components. The FRD values computed from both the reference and distorted images are jointly considered to derive a novel mutual masking strategy for simulating the texture masking property of the human visual system (HVS). By considering the GGD modeling of intra RDCT subband, MI of inter RDCT subbands, and FRD of the image, the proposed RR IQA is developed. Experimental results demonstrate that a small number of RR features is sufficient to represent the reference image for the perceptual quality analysis. The proposed method can outperform the state-of-the-art RR IQAs, and even the full-reference (FR) PSNR and SSIM.

[1]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[3]  Tubagus Maulana Kusuma,et al.  Reduced-reference metric design for objective perceptual quality assessment in wireless imaging , 2009, Signal Process. Image Commun..

[4]  Weisi Lin,et al.  Just-noticeable difference estimation with pixels in images , 2008, J. Vis. Commun. Image Represent..

[5]  Mohammed Ghanbari,et al.  Blockiness detection for MPEG2-coded video , 2000, IEEE Signal Processing Letters.

[6]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[7]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[8]  Sheila S. Hemami,et al.  No-reference image and video quality estimation: Applications and human-motivated design , 2010, Signal Process. Image Commun..

[9]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[10]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[11]  Alan C. Bovik,et al.  RRED indices: Reduced reference entropic differencing framework for image quality assessment , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Khaled El-Maleh,et al.  Perceptual Temporal Quality Metric for Compressed Video , 2007, IEEE Transactions on Multimedia.

[13]  Margaret H. Pinson Low Bandwidth Reduced Reference Video Quality Monitoring System , 2005 .

[14]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[15]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[16]  Christian Viard-Gaudin,et al.  Continuous quality assessment of MPEG2 video with reduced reference , 2005 .

[17]  Patrick Le Callet,et al.  Visual features for image quality assessment with reduced reference , 2005, IEEE International Conference on Image Processing 2005.

[18]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[19]  Jan P. Allebach,et al.  Human vision and electronic imaging , 1996, J. Electronic Imaging.

[20]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[21]  Siwei Lyu Divisive Normalization: Justification and Effectiveness as Efficient Coding Transform , 2010, NIPS.

[22]  R. Freeman,et al.  Oblique effect: a neural basis in the visual cortex. , 2003, Journal of neurophysiology.

[23]  Mohammed Ghanbari,et al.  Reduced-Reference Video Quality Assessment Using Discriminative Local Harmonic Strength With Motion Consideration , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[25]  Tiago Rosa Maria Paula Queluz,et al.  No-reference image quality assessment based on DCT domain statistics , 2008, Signal Process..

[26]  King Ngi Ngan,et al.  Visual Horizontal Effect for Image Quality Assessment , 2010, IEEE Signal Processing Letters.

[27]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[28]  King Ngi Ngan,et al.  Reduced-Reference Video Quality Assessment of Compressed Video Sequences , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[30]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[31]  Fan Zhang,et al.  Spread Spectrum Image Watermarking Based on Perceptual Quality Metric , 2011, IEEE Transactions on Image Processing.

[32]  Wufeng Xue,et al.  Reduced reference image quality assessment based on Weibull statistics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[33]  Wen Gao,et al.  Morphological representation of DCT coefficients for image compression , 2002, IEEE Trans. Circuits Syst. Video Technol..

[34]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[35]  Michael T. Orchard,et al.  A comparative study of DCT- and wavelet-based image coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[36]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[37]  Abdul Rehman,et al.  Reduced-reference SSIM estimation , 2010, 2010 IEEE International Conference on Image Processing.

[38]  Judith Redi,et al.  Color Distribution Information for the Reduced-Reference Assessment of Perceived Image Quality , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Andrew P. Bradley,et al.  A wavelet visible difference predictor , 1999, IEEE Trans. Image Process..

[40]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[41]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[42]  Christian Viard-Gaudin,et al.  A Convolutional Neural Network Approach for Objective Video Quality Assessment , 2006, IEEE Transactions on Neural Networks.

[43]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[44]  Zhou Wang,et al.  Quality-aware images , 2006, IEEE Transactions on Image Processing.

[45]  Xuelong Li,et al.  Reduced-Reference IQA in Contourlet Domain , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[47]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[48]  Lin Ma,et al.  A visual saliency modulated just noticeable distortion profile for image watermarking , 2011, 2011 19th European Signal Processing Conference.

[49]  Alan C. Bovik,et al.  41 OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[50]  Seungjoon Yang Reduced reference MPEG-2 picture quality measure based on ratio of DCT coefficients , 2011 .

[51]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[52]  Songnan Li,et al.  Reduced-Reference Image Quality Assessment via Intra- and Inter-Subband Statistical Characteristics in Reorganized DCT Domain , 2011 .

[53]  Fan Zhang,et al.  Adaptive Block-size Transform based Just-Noticeable Difference model for images/videos , 2011, Signal Process. Image Commun..

[54]  Min Zhang,et al.  Reduced reference image quality assessment based on statistics of edge , 2011, Electronic Imaging.

[55]  Fan Zhang,et al.  Practical Image Quality Metric Applied to Image Coding , 2011, IEEE Transactions on Multimedia.

[56]  Wen Gao,et al.  No-reference perceptual image quality metric using gradient profiles for JPEG2000 , 2010, Signal Process. Image Commun..

[57]  Margaret H. Pinson,et al.  Spatial-temporal distortion metric for in-service quality monitoring of any digital video system , 1999, Optics East.

[58]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[59]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[60]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[61]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[62]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[63]  Patrick Le Callet,et al.  An image quality assessment method based on perception of structural information , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[64]  Eero P. Simoncelli,et al.  Nonlinear image representation using divisive normalization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  Abdul Rehman,et al.  Reduced-Reference Image Quality Assessment by Structural Similarity Estimation , 2012, IEEE Transactions on Image Processing.