The quest for the integration of visual saliency models in objective image quality assessment: A distraction power compensated combination strategy

Novel research on image quality metrics (IQMs) attempts to further improve their reliability by including visual attention aspects of the human visual system. Literature so far mainly focuses on the extension of a specific IQM with a specific visual saliency model. In this paper, we quest the integration of visual saliency models in IQMs, in terms of its statistical meaningfulness and combination strategy. In the first step an exhaustive evaluation is conducted by integrating twenty state-of-the-art saliency models into eight best-known IQMs for image quality assessment. It demonstrates linearly combining saliency and IQMs yields a statistically significant gain in performance. Based on the statistics, we revisit the combination strategy of saliency and IQMs and propose a new strategy taking into account the distraction power of local distortions. Results show that the proposed combination strategy consistently outperforms the conventionally used linear combination strategy.

[1]  Zhou Wang,et al.  Spatial Pooling Strategies for Perceptual Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[2]  Ingrid Heynderickx,et al.  Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Patrick Le Callet,et al.  Overt visual attention for free-viewing and quality assessment tasks Impact of the regions of interest on a video quality metric , 2010 .

[4]  David Zhang,et al.  A comprehensive evaluation of full reference image quality assessment algorithms , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  L. Ma,et al.  Visual saliency detection in image using ant colony optimisation and local phase coherence , 2010 .

[6]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[7]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[8]  Ingrid Heynderickx,et al.  Comparative Study of Fixation Density Maps , 2013, IEEE Transactions on Image Processing.

[9]  Abdelhakim Saadane,et al.  Blind Quality Metric using a Perceptual Importance Map for JPEG-20000 Compressed Images , 2006, 2006 International Conference on Image Processing.

[10]  Ali Borji,et al.  Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study , 2013, IEEE Transactions on Image Processing.

[11]  Ingrid Heynderickx,et al.  How Does Image Content Affect the Added Value of Visual Attention in Objective Image Quality Assessment? , 2013, IEEE Signal Processing Letters.

[12]  Tao Liu,et al.  Saliency based objective quality assessment of decoded video affected by packet losses , 2008, 2008 15th IEEE International Conference on Image Processing.

[13]  Liming Zhang,et al.  Image quality assessment with visual attention , 2008, 2008 19th International Conference on Pattern Recognition.

[14]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[15]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[16]  Louis K. H. Chan,et al.  Dimension-specific signal modulation in visual search: evidence from inter-stimulus surround suppression. , 2012, Journal of vision.

[17]  Glen P. Abousleman,et al.  A no-reference perceptual image sharpness metric based on saliency-weighted foveal pooling , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  Wei Zhang,et al.  Studying the added value of computational saliency in objective image quality assessment , 2014, 2014 IEEE Visual Communications and Image Processing Conference.