Spatial-Temporal Visual Attention Model for Video Quality Assessment

Objective assessment for videos has developed with mature technique. However, there are still some challenges, such as mimicking the behavior that human-beings do when they watch a video. In this paper, we introduce a model for full-reference (FR) video quality assessment (VQA) which is based on visual attention, optical flow, spatio-temporal slice (STS) images and center bias map. The experimental results show that our proposed model has better performance in wireless transmission distortion than other models in the LIVE video quality database.

[1]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[2]  Yan Liu,et al.  A semantic no-reference image sharpness metric based on top-down and bottom-up saliency map modeling , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[4]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[5]  Max Q.-H. Meng,et al.  Automatic Polyp Detection via a Novel Unified Bottom-Up and Top-Down Saliency Approach , 2018, IEEE Journal of Biomedical and Health Informatics.

[6]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Touradj Ebrahimi,et al.  Visual attention tuned spatio-velocity contrast sensitivity for video quality assessment , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[9]  Donald P. Greenberg,et al.  Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments , 2001, TOGS.

[10]  Tsung-Jung Liu,et al.  Study of Visual Quality Assessment on Pattern Images: Subjective Evaluation and Visual Saliency Effects , 2018, IEEE Access.

[11]  Damon M. Chandler,et al.  ViS3: an algorithm for video quality assessment via analysis of spatial and spatiotemporal slices , 2014, J. Electronic Imaging.

[12]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[13]  Damon M. Chandler,et al.  A spatiotemporal most-apparent-distortion model for video quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[14]  Mohamed-Chaker Larabi,et al.  Spatial-temporal Video Quality Metric based on an estimation of QoE , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[15]  Tsung-Jung Liu,et al.  Temporal information assisted video quality metric for multimedia , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[16]  Soo-Chang Pei,et al.  Spatio-Temporal Interactive Laws Feature Correlation Method to Video Quality Assessment , 2018, 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[17]  Frédo Durand,et al.  A Benchmark of Computational Models of Saliency to Predict Human Fixations , 2012 .

[18]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[19]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[21]  Weisi Lin,et al.  Visual quality assessment: recent developments, coding applications and future trends , 2013, APSIPA Transactions on Signal and Information Processing.

[22]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.