Perceived interest versus overt visual attention in image quality assessment

We investigate the impact of overt visual attention and perceived interest on the prediction performance of image quality metrics. Towards this end we performed two respective experiments to capture these mechanisms: an eye gaze tracking experiment and a region-of-interest selection experiment. Perceptual relevance maps were created from both experiments and integrated into the design of the image quality metrics. Correlation analysis shows that indeed there is an added value of integrating these perceptual relevance maps. We reveal that the improvement in prediction accuracy is not statistically different between fixation density maps from eye gaze tracking data and region-of-interest maps, thus, indicating the robustness of different perceptual relevance maps for the performance gain of image quality metrics. Interestingly, however, we found that thresholding of region-of-interest maps into binary maps significantly deteriorates prediction performance gain for image quality metrics. We provide a detailed analysis and discussion of the results as well as the conceptual and methodological differences between capturing overt visual attention and perceived interest.

[1]  Patrick Le Callet,et al.  A coherent computational approach to model bottom-up visual attention , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Hans-Jürgen Zepernick,et al.  Psychophysical assessment of perceived interest in natural images: The ROI-D database , 2011, 2011 Visual Communications and Image Processing (VCIP).

[3]  John K. Tsotsos,et al.  Saliency, attention, and visual search: an information theoretic approach. , 2009, Journal of vision.

[4]  Ingrid Heynderickx,et al.  Comparative Study of Fixation Density Maps , 2013, IEEE Transactions on Image Processing.

[5]  Tsuhan Chen,et al.  DISCOV: A Framework for Discovering Objects in Video , 2008, IEEE Transactions on Multimedia.

[6]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[7]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[8]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[9]  Laurent Itti,et al.  Interesting objects are visually salient. , 2008, Journal of vision.

[10]  Patrick Le Callet,et al.  Visual Attention and Applications in Multimedia Technologies , 2013, Proceedings of the IEEE.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  A. M. Rohaly,et al.  Automatic detection of regions of interest in complex video sequences , 2001, IS&T/SPIE Electronic Imaging.

[13]  Anthony J. Maeder,et al.  Visual attention modeling: Region-of-interest versus fixation patterns , 2009, 2009 Picture Coding Symposium.

[14]  Anthony J. Maeder,et al.  Visual attention modelling for subjective image quality databases , 2009, 2009 IEEE International Workshop on Multimedia Signal Processing.

[15]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[16]  Hans-Jürgen Zepernick,et al.  Framework for optimal region of interest-based quality assessment in wireless imaging , 2010, J. Electronic Imaging.