Benchmarking state-of-the-art visual saliency models for image quality assessment

A significant current research trend in image quality assessment is to investigate the added value of visual attention aspects. Previous approaches mainly focused on adopting a specific saliency model to improve a specific image quality metric (IQM). It is still not known yet which of the existing saliency models is generally applicable in IQMs; which of the IQMs can profit most/least from the addition of saliency; and how this improvement depends on the saliency model used and the IQM targeted. In this paper, a large-scale benchmark study is conducted to assess the capabilities and limitations of the state-of-the-art saliency models in the context of IQMs. The study provides guidance for the application of saliency models in IQMs, in terms of the effect of saliency model dependency, IQM dependency, and image distortion dependency.

[1]  Abdelhakim Saadane,et al.  Blind Quality Metric using a Perceptual Importance Map for JPEG-20000 Compressed Images , 2006, 2006 International Conference on Image Processing.

[2]  Tao Liu,et al.  Saliency based objective quality assessment of decoded video affected by packet losses , 2008, 2008 15th IEEE International Conference on Image Processing.

[3]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[4]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[5]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[6]  Lina J. Karam,et al.  A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) , 2009, IEEE Transactions on Image Processing.

[7]  J ValdésJulio,et al.  2006 Special issue , 2006 .

[8]  Wei Zhang,et al.  Studying the added value of computational saliency in objective image quality assessment , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[9]  Ulrich Engelke,et al.  Visual Attention in Quality Assessment , 2011, IEEE Signal Processing Magazine.

[10]  Glen P. Abousleman,et al.  A no-reference perceptual image sharpness metric based on saliency-weighted foveal pooling , 2008, 2008 15th IEEE International Conference on Image Processing.

[11]  Patrick Le Callet,et al.  Overt visual attention for free-viewing and quality assessment tasks Impact of the regions of interest on a video quality metric , 2010 .

[12]  Ali Borji,et al.  Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study , 2013, IEEE Transactions on Image Processing.

[13]  David Zhang,et al.  A comprehensive evaluation of full reference image quality assessment algorithms , 2012, 2012 19th IEEE International Conference on Image Processing.

[14]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[15]  Ingrid Heynderickx,et al.  Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Liming Zhang,et al.  Image quality assessment with visual attention , 2008, 2008 19th International Conference on Pattern Recognition.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.