Modeling motion visual perception for video quality assessment

Contrast sensitivity of Human Visual System (HVS) plays an important role in perceiving visual stimuli, and consequently, it has a significant impact on the perceived video quality. This paper proposes a visual perception model based on foveated vision and motion perception. The reference and the distorted video sequences are processed by the visual perception model to generate the perceived stimuli in HVS. The perceived difference of the processed sequences is measured in spatial and temporal domains considering the visual sensitivity. An advanced pooling scheme is proposed based on the visual attention mechanism, eye movement type, and influence of temporal quality variation, in order to estimate the perceived video quality. Experimental results demonstrate that the proposed metric significantly outperforms state-of-the-art quality models with respect to a combined eye-tracking and subjective video quality assessment data set.

[1]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[2]  Snjezana Rimac-Drlje,et al.  Foveated mean squared error—a novel video quality metric , 2010, Multimedia Tools and Applications.

[3]  Wilson S. Geisler,et al.  Real-time simulation of arbitrary visual fields , 2002, ETRA.

[4]  A. Johnston,et al.  Spatiotemporal contrast sensitivity and visual field locus , 1983, Vision Research.

[5]  Andrew Perkis,et al.  Attention modeling for video quality assessment: Balancing global quality and local quality , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[6]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[7]  Marios S. Pattichis,et al.  Foveated video quality assessment , 2002, IEEE Trans. Multim..

[8]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[9]  Scott Daly,et al.  Engineering observations from spatiovelocity and spatiotemporal visual models , 1998, Electronic Imaging.