Eye Movement-Based Analysis on Methodologies and Efficiency in the Process of Image Noise Evaluation

Noise level (image quality) evaluation is an important and popular topic in many applications. However, the knowledge of how people visually explore distorted images for making decision on noise evaluation is rather limited. In this paper, we conducted psychophysical eye-tracking studies to deeply understand the process of image noise evaluation. We identified two different types of methodologies in the evaluation processing, speed-driven and accuracy-driven respectively, in terms of both evaluation time and decision error. The speed-driven methodology, compared with the accuracy-driven one, uses less time to give evaluation results, with shorter fixation duration and stronger central bias. Furthermore, based on the utilization of temporal-spatial entropy analysis on eye movement data, a quantitative measure is obtained to show significant correlation with the decision-making efficiency of evaluation processing, which is characterized by evaluation time and decision error. As a result, the new measure may be used as a proxy definition for this decision-making efficiency.

[1]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[2]  Wei Zhang,et al.  Learning picture quality from visual distraction: Psychophysical studies and computational models , 2017, Neurocomputing.

[3]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[4]  Xiongkuo Min,et al.  Influence of compression artifacts on visual attention , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Brook Shiferaw,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[6]  Mateu Sbert,et al.  Random-valued impulse noise removal using adaptive ranked-ordered impulse detector , 2018, J. Electronic Imaging.

[7]  Mateu Sbert,et al.  Information Theory Tools for Image Processing , 2014, Information Theory Tools for Image Processing.

[8]  Randy C. Paffenroth,et al.  Detecting task demand via an eye tracking machine learning system , 2019, Decis. Support Syst..

[9]  D. S. Wooding,et al.  Fixation maps: quantifying eye-movement traces , 2002, ETRA.

[10]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[11]  Hans-Jurgen Zepernick,et al.  Visual fixation patterns in subjective quality assessment: The relative impact of image content and structural distortions , 2010, 2010 International Symposium on Intelligent Signal Processing and Communication Systems.

[12]  P. Cavanagh,et al.  Different processing strategies underlie voluntary averaging in low and high noise. , 2012, Journal of vision.

[13]  K. Guo,et al.  How does image noise affect actual and predicted human gaze allocation in assessing image quality? , 2015, Vision Research.