Eye-tracking-Based Quality Assessment for Image Interpolation

In an Image Quality Assessment (IQA) scenario, the Human Vision System (HVS) always acts as the ultimate receiver and valuator of generated images. As an important feature of HVS, the visual attention data has been demonstrated to be able to effectively improve the performance of existing objective quality metrics. However, this feature has not yet been well explored in the IQA of image interpolation. In this paper, we conduct an eye-tracking test on an interpolated image database and investigate the impact of visual attention on IQA of image interpolation. Two visual attention models, saliency map and Region Of Interest (ROI), are then obtained from the eye-tracking data. We further incorporate these models into non-integer interpolated IQA metric and examine their performances. Experiments show that the introduction of eye-tracking features obviously improves the conventional IQA metric for non-integer image interpolation.

[1]  Patrick Le Callet,et al.  Overt visual attention for free-viewing and quality assessment tasks Impact of the regions of interest on a video quality metric , 2010 .

[2]  Ingrid Heynderickx,et al.  Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ingrid Heynderickx,et al.  How the task of evaluating image quality influences viewing behavior , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[5]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[6]  Kai-Kuang Ma,et al.  Contrast-Guided Image Interpolation , 2013, IEEE Transactions on Image Processing.

[7]  Zhou Wang,et al.  Objective Quality Assessment of Interpolated Natural Images , 2015, IEEE Transactions on Image Processing.

[8]  Hoon Yoo,et al.  Design of piecewise weighted linear interpolation based on even-odd decomposition and its application to image resizing , 2009, IEEE Transactions on Consumer Electronics.

[9]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[10]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[11]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[12]  Xiongkuo Min,et al.  Visual attention data for image quality assessment databases , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[13]  Judith Redi,et al.  Effects of task and image properties on visual-attention deployment in image-quality assessment , 2015, J. Electronic Imaging.

[14]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[15]  Weisi Lin,et al.  Quality assessment for image super-resolution based on energy change and texture variation , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[16]  Wen Gao,et al.  Image interpolation via regularized local linear regression , 2011, 28th Picture Coding Symposium.

[17]  Rongrong Ji,et al.  Image Quality Assessment for Color Correction Based on Color Contrast Similarity and Color Value Difference , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Lihi Zelnik-Manor,et al.  What Makes a Patch Distinct? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Wei Zhang,et al.  Toward a Reliable Collection of Eye-Tracking Data for Image Quality Research: Challenges, Solutions, and Applications , 2017, IEEE Transactions on Image Processing.

[20]  Kede Ma,et al.  A Hybrid Quality Metric for Non-Integer Image Interpolation , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).