Fuzzy Logic and Temporal Information Applied to Video Quality Assessment

Video Quality Assessment (VQA) plays an important role for video communications systems and services, mainly to determine, accurately, the ratio between the provided quality and the resource demand. The objective VQA is a fast and viable methodology to determine the video quality for video service providers, although it presents an unsatisfactory correlation with the scores of quality given by the Human Visual System (HVS). The authors propose a novel full reference objective video quality metric considering spatial and temporal analysis. The spatial analysis used an algorithm, based on fuzzy logic, to classify the regions in three components. Temporal analysis was performed by means of the perceptual weighted structural similarity index (PW-SSIM) between the frames that contained the differences of pixels in the same spatial position and in subsequent frames. To validate the proposed VQA algorithm, the correlation coeffcients between the objective measures and the subjective scores provided by the LIVE Video Quality Database were computed, considering the following distortions: H.264 and MPEG-2 encoding and transmission of H.264 bit-streams over IP and wireless networks. The results demonstrate that the proposed algorithm is a competitive alternative when compared with the classical objective algorithms such as MOVIE.

[1]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Alan C. Bovik,et al.  A subjective study to evaluate video quality assessment algorithms , 2010, Electronic Imaging.

[3]  José Vinícius de Miranda Cardoso,et al.  Performance of the objective video quality metrics with perceptual weighting considering first and second order differential operators , 2012, WebMedia.

[4]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Sachin Deshpande,et al.  ViMSSIM: from image to video quality assessment , 2012, MoVid '12.

[7]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[8]  José Vinícius de Miranda Cardoso,et al.  Video Quality Assessment Based on the Effect of the Estimation of the Spatial Perceptual Information , 2012 .

[9]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[10]  Weisi Lin,et al.  Low-Complexity Video Quality Assessment Using Temporal Quality Variations , 2012, IEEE Transactions on Multimedia.

[11]  M Corbetta,et al.  Frontoparietal cortical networks for directing attention and the eye to visual locations: identical, independent, or overlapping neural systems? , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Nariman Farvardin,et al.  A perceptually motivated three-component image model-Part I: description of the model , 1995, IEEE Trans. Image Process..

[13]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[14]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[15]  Chaofeng Li,et al.  Content-weighted video quality assessment using a three-component image model , 2010, J. Electronic Imaging.

[16]  Chaofeng Li,et al.  Content-partitioned structural similarity index for image quality assessment , 2010, Signal Process. Image Commun..

[17]  Mei Yu,et al.  A new four-component gradient-based structural similarity metric using adaptive weights , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[18]  Tiago Rosa Maria Paula Queluz,et al.  No-Reference Quality Assessment of H.264/AVC Encoded Video , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Mylène C. Q. Farias,et al.  On performance of image quality metrics enhanced with visual attention computational models , 2012 .

[20]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[21]  Zheru Chi,et al.  Image coding quality assessment using fuzzy integrals with a three-component image model , 2004, IEEE Transactions on Fuzzy Systems.

[22]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[23]  José Vinícius de Miranda Cardoso,et al.  Effect of visual attention areas on the objective video quality assessment , 2012, WebMedia.