A Novel Quality Metric Using Spatiotemporal Correlational Data of Human Eye Maneuver

The popularly used subjective estimator- mean opinion score (MOS) is often biased by the testing environment, viewers mode, domain expertise, and many other factors that may actively influence on actual assessment. We therefore, devise a no- reference subjective quality assessment metric by exploiting the nature of human eye browsing on videos. The participants' eye-tracker recorded gaze-data indicate more concentrated eye- traversing approach for relatively better quality. We calculate the Length, Angle, Pupil-size, and Gaze-duration features from the recorded gaze trajectory. The content and resolution invariant operation is carried out prior to synthesizing them using an adaptive weighted function to develop a new quality metric using eye traversal (QMET). Tested results reveal that the quality evaluation carried out by QMET demonstrates a strong correlation with the most widely used peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and the MOS.

[1]  Wei Zhang,et al.  The Application of Visual Saliency Models in Objective Image Quality Assessment: A Statistical Evaluation , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[3]  Manoranjan Paul,et al.  QMET: A new quality assessment metric for no-reference video coding by using human eye traversal , 2016, 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[4]  Ingrid Heynderickx,et al.  Visual Attention in Objective Image Quality Assessment: Based on Eye-Tracking Data , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Vijayan K. Asari,et al.  No-Reference Video Quality Assessment Based on Artifact Measurement and Statistical Analysis , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[7]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[8]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Sebastian Möller,et al.  Using eye-tracking and correlates of brain activity to predict quality scores , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[10]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[11]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[12]  Wenjun Zhang,et al.  Quality Assessment Considering Viewing Distance and Image Resolution , 2015, IEEE Transactions on Broadcasting.

[13]  Hantao Liu,et al.  A no-reference metric for perceived ringing , 2009 .

[14]  Yuan Ma,et al.  A novel objective quality assessment method for perceptual video coding in conversational scenarios , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[15]  Wang-Chin Tsai,et al.  Eye Movements on Assessing Perceptual Image Quality , 2016, HCI.

[16]  Touradj Ebrahimi,et al.  Attention Driven Foveated Video Quality Assessment , 2014, IEEE Transactions on Image Processing.

[17]  Munchurl Kim,et al.  A Novel Fast CU Encoding Scheme Based on Spatiotemporal Encoding Parameters for HEVC Inter Coding , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Maria Grazia Albanesi,et al.  A new algorithm for objective video quality assessment on Eye Tracking data , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[20]  Dinei A. F. Florêncio,et al.  Crowdsourcing subjective image quality evaluation , 2011, 2011 18th IEEE International Conference on Image Processing.

[21]  Manoranjan Paul,et al.  Fast Mode Decision in the HEVC Video Coding Standard by Exploiting Region with Dominated Motion and Saliency Features , 2016, PloS one.

[22]  Yan Tu,et al.  No-reference video quality assessment model based on eye tracking datas , 2014 .

[23]  Thomas Martinetz,et al.  A software framework for simulating eye trackers , 2008, ETRA.

[24]  Yuukou Horita,et al.  Impact of subjective dataset on the performance of image quality metrics , 2008, 2008 15th IEEE International Conference on Image Processing.

[25]  Stefan Winkler,et al.  Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives , 2016, Multimedia Systems.