Saliency Region and Motion Characteristics Combined Video Quality Assessment

In order to accurately evaluate the video quality and make it consistent with the subjective evaluation result, a saliency region and motion characteristics combined video quality assessment is proposed in this paper. This method is based on traditional SSIM and improves its assessment performance. According to the relationship between human visual attention and video’s region of saliency, frame saliency is weighted by spatial saliency and temporal motion characteristics, in which the spatial saliency is extracted by spectrum analysis and the temporal one got by motion visual attention model. This saliency is weighted by SSIM index for single frame quality assessment. Finally, based on HVS characteristics and motion characteristics, the entire video quality SMWSSIM can be got by weighting single-frame quality. Experiment results prove that this method is faster, more convenient and accurate than other SSIM-based assessments.

[1]  Liang Yongsheng.  New scalable ROI algorithm based on visual attention , 2013 .

[2]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[3]  Qingming Huang,et al.  Visual Saliency and Distortion Weighting Based Video Quality Assessment , 2012, PCM.

[4]  Ying Zhou,et al.  Video Motion Characteristics based Spatial-Temporal Salient Region Extraction Method , 2015, J. Inf. Hiding Multim. Signal Process..

[5]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[6]  Man Jia-ju.  Video Quality Assessment Measurement Based on Motion Information and Structural Distortion , 2010 .

[7]  Lai-Man Po,et al.  Edge-Based Structural Similarity for Image Quality Assessment , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[8]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Zhang Ji-hong.  Content-Aware Based Sorting Approach of Scalable Video Bit Stream , 2013 .

[10]  Xuelong Li,et al.  Spatio-temporal salience based video quality assessment , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Lin Xinggang.  A Novel HVS-based SSIM on Video Quality Assessment , 2010 .

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  J. Koenderink.  Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[15]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.