Image decomposition-based structural similarity index for image quality assessment

Perceptual image quality assessment (IQA) adopts a computational model to assess the image quality in a fashion, which is consistent with human visual system (HVS). From the view of HVS, different image regions have different importance. Based on this fact, we propose a simple and effective method based on the image decomposition for image quality assessment. In our method, we first divide an image into two components: edge component and texture component. To separate edge and texture components, we use the TV flow-based nonlinear diffusion method rather than the classic TV regularization methods, for highly effective computing. Different from the existing content-based IQA methods, we realize different methods on different components to compute image quality. More specifically, the luminance and contrast similarity are computed in texture component, while the structural similarity is computed in edge component. After obtaining the local quality map, we use texture component again as a weight function to derive a single quality score. Experimental results on five datasets show that, compared with previous approaches in the literatures, the proposed method is more efficient and delivers higher prediction accuracy.

[1]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[2]  Lei Zhang,et al.  RFSIM: A feature based image quality assessment metric using Riesz transforms , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Lai-Man Po,et al.  Discrete wavelet transform-based structural similarity for image quality assessment , 2008, 2008 15th IEEE International Conference on Image Processing.

[4]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[5]  Thomas Brox,et al.  A TV Flow Based Local Scale Measure for Texture Discrimination , 2004, ECCV.

[6]  Zhou Wang,et al.  Emerging Methods for Color Image and Video Quality Enhancement , 2010, EURASIP J. Image Video Process..

[7]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[8]  Thrasyvoulos N. Pappas,et al.  Structural Similarity Quality Metrics in a Coding Context: Exploring the Space of Realistic Distortions , 2006, IEEE Transactions on Image Processing.

[9]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[10]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Qiang Chen,et al.  Integrating clustering with level set method for piecewise constant Mumford-Shah model , 2014, EURASIP J. Image Video Process..

[12]  Stefan Winkler,et al.  Issues in vision modeling for perceptual video quality assessment , 1999, Signal Process..

[13]  Scott J. Daly,et al.  Application of a Noise Adaptive Contrast Sensitivity Function to Image Data Compression , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[14]  Sergios Theodoridis,et al.  A Novel Efficient Cluster-Based MLSE Equalizer for Satellite Communication Channels with-QAM Signaling , 2006, EURASIP J. Adv. Signal Process..

[15]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[16]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[17]  Zhou Wang,et al.  Applications of Objective Image Quality Assessment Methods [Applications Corner] , 2011, IEEE Signal Processing Magazine.

[18]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[19]  Nikolay N. Ponomarenko,et al.  Color image database TID2013: Peculiarities and preliminary results , 2013, European Workshop on Visual Information Processing (EUVIP).

[20]  V. Caselles,et al.  Minimizing total variation flow , 2000, Differential and Integral Equations.

[21]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[22]  Abdul Rehman,et al.  SSIM-based non-local means image denoising , 2011, 2011 18th IEEE International Conference on Image Processing.

[23]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[24]  Chun-Ling Yang,et al.  Gradient-Based Structural Similarity for Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[25]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[26]  Samarth Bharadwaj,et al.  Biometric quality: a review of fingerprint, iris, and face , 2014, EURASIP Journal on Image and Video Processing.

[27]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[28]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[29]  J. Lubin A human vision system model for objective picture quality measurements , 1997 .

[30]  Thomas Malzbender,et al.  Frequency Analysis of Gradient Estimators in Volume Rendering , 1996, IEEE Trans. Vis. Comput. Graph..

[31]  Azeddine Beghdadi,et al.  Image Quality Assessment Using the Joint Spatial/Spatial-Frequency Representation , 2006, EURASIP J. Adv. Signal Process..

[32]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[33]  Zhou Wang,et al.  A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images , 2015, IEEE Signal Processing Letters.

[34]  Hua Yang,et al.  Sparse Feature Fidelity for Perceptual Image Quality Assessment , 2013, IEEE Transactions on Image Processing.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[37]  Zhou Wang,et al.  Applications of Objective Image Quality Assessment Methods , 2011 .

[38]  Ke Gu,et al.  Content-weighted mean-squared error for quality assessment of compressed images , 2016, Signal Image Video Process..

[39]  Homer H. Chen,et al.  SSIM-Based Perceptual Rate Control for Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Lawrence G. Roberts,et al.  Machine Perception of Three-Dimensional Solids , 1963, Outstanding Dissertations in the Computer Sciences.

[41]  Wotao Yin,et al.  A comparison of three total variation based texture extraction models , 2007, J. Vis. Commun. Image Represent..