A weighted full-reference image quality assessment based on visual saliency

A full reference image quality assessment based saliency map is proposed.Human visual system is taken account into image quality assessment.The pixels of an image make different contributions in image quality assessment. In full reference image quality assessment (IQA), the images without distortion are usually employed as reference, while the structures in both reference images and distorted images are ignored and all pixels are equally treated. In addition, the role of human visual system (HVS) is not taken account into subjective IQA metric. In this paper, a weighted full-reference image quality metric is proposed, where a weight imposed on each pixel indicates its importance in IQA. Furthermore, the weights can be estimated via visual saliency computation, which can approximate the subjective IQA via exploiting the HVS. In the experiments, the proposed metric is compared with several objective IQA metrics on LIVE release 2 and TID 2008 database. The results demonstrate that SROCC and PLCC of the proposed metric are 0.9647 and 0.9721, respectively,which are higher than other methods and it only takes 427.5s, which is lower than that of most other methods.

[1]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[2]  M. Valipour,et al.  Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir , 2013 .

[3]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[4]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[5]  Mohammad Valipour,et al.  Sprinkle and Trickle Irrigation System Design Using Tapered Pipes for Pressure Loss Adjusting , 2012 .

[6]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[7]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[8]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[9]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[10]  Tetsuya Shimamura,et al.  Exponentiated combination of two scores for image quality assessment , 2013, 2013 IEEE International Conference of IEEE Region 10 (TENCON 2013).

[11]  M. Valipour.  Optimization of neural networks for precipitation analysis in a humid region to detect drought and wet year alarms , 2016 .

[12]  Hao Zhu,et al.  Bottom-up saliency based on weighted sparse coding residual , 2011, ACM Multimedia.

[13]  David Zhang,et al.  A comprehensive evaluation of full reference image quality assessment algorithms , 2012, 2012 19th IEEE International Conference on Image Processing.

[14]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[15]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[16]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Hongyu Li,et al.  SR-SIM: A fast and high performance IQA index based on spectral residual , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[19]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[20]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[21]  Mohammad Valipour,et al.  Simulation of open- and closed-end border irrigation systems using SIRMOD , 2015 .

[22]  A. Bovik.  F Mean Squared Error: Love It or Leave It? , 2009 .

[23]  L. R. Yamamoto,et al.  Impact of network performance parameters on the end-to-end perceived speech quality , 1997 .

[24]  Hans-Peter Seidel,et al.  New measurements reveal weaknesses of image quality metrics in evaluating graphics artifacts , 2012, ACM Trans. Graph..

[25]  Fei Zhou,et al.  Image Quality Assessment Based on Inter-Patch and Intra-Patch Similarity , 2015, PloS one.

[26]  Mohammad Ali Gholami Sefidkouhi,et al.  Surface irrigation simulation models: a review , 2015 .

[27]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[28]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  Hanno Scharr,et al.  Optimal operators in digital image processing , 2000 .

[31]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.