A Perceptually Relevant MSE-Based Image Quality Metric

Image quality metrics (IQMs), such as the mean squared error (MSE) and the structural similarity index (SSIM), are quantitative measures to approximate perceived visual quality. In this paper, through analyzing the relationship between the MSE and the SSIM under an additive noise distortion model, we propose a perceptually relevant MSE-based IQM, MSE-SSIM, which is expressed in terms of the variance of the source image and the MSE between the source and distorted images. Evaluations on three publicly available databases (LIVE, CSIQ, and TID2008) show that the proposed metric, despite requiring less computation, compares favourably in performance to several existing IQMs. In addition, due to its simplicity, MSE-SSIM is amenable for the use in a wide range of image and video tasks that involve solving an optimization problem. As an example, MSE-SSIM is used as the objective function in designing a Wiener filter that aims at optimizing the perceptual visual quality of the output. Experimental results show that the images filtered with a MSE-SSIM-optimal Wiener filter have better visual quality than those filtered with a MSE-optimal Wiener filter.

[1]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Proceedings of 1st International Conference on Image Processing.

[2]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[3]  Thierry Pun,et al.  A Stochastic Approach to Content Adaptive Digital Image Watermarking , 1999, Information Hiding.

[4]  Thomas Wedi.  Adaptive interpolation filter for motion compensated prediction , 2002, Proceedings. International Conference on Image Processing.

[5]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[6]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[7]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[10]  Chun-Ling Yang,et al.  Gradient-Based Structural Similarity for Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[11]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[12]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[13]  Thomas Wedi,et al.  Transmission of Post-Filter Hints for Video Coding Schemes , 2007, 2007 IEEE International Conference on Image Processing.

[14]  Ashraf A. Kassim,et al.  Digital Video Image Quality and Perceptual Coding , 2005, J. Electronic Imaging.

[15]  Sheila S. Hemami,et al.  Understanding and simplifying the structural similarity metric , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  Alan C. Bovik,et al.  Unifying analysis of full reference image quality assessment , 2008, 2008 15th IEEE International Conference on Image Processing.

[17]  Robert W. Heath,et al.  SSIM-optimal linear image restoration , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Takashi Watanabe,et al.  In-loop filter using block-based filter control for video coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[19]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[20]  Fan Zhang,et al.  Limitation and challenges of image quality measurement , 2010, Visual Communications and Image Processing.

[21]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[22]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[23]  Valero Laparra,et al.  Divisive normalization image quality metric revisited. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Mylène C. Q. Farias.  Video Quality Metrics , 2010 .

[25]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[26]  Fan Zhang,et al.  Practical Image Quality Metric Applied to Image Coding , 2011, IEEE Transactions on Multimedia.

[27]  Dapeng Wu,et al.  Classified quadtree-based adaptive loop filter , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[28]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[29]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Chuohao Yeo,et al.  On Rate Distortion Optimization Using SSIM , 2012, IEEE Transactions on Circuits and Systems for Video Technology.