AN INFORMATION THEORETIC VIDEO QUALITY METRIC BASED ON MOTION MODELS

Accurate objective quality metrics are of great potential benefit to the video industry, as they promise the means to evaluate the performance of acquisition, display, coding and communication systems. Although the area of image quality assessment has attained maturity in recent years, video quality assessment still has a long way to go to before it reaches the levels of success achieved by still image quality metrics. In this paper, we propose a novel quality metric for video sequences, which we call the Video Information Fidelity Criterion (V-IFC), that utilizes motion information in video sequences, which is the main difference in moving from images to video. We previously proposed a model that describes the statistics of natural video sequences and this model is used in the development of V-IFC. This metric is capable of capturing temporal artifacts in video sequences, in addition to spatial distortions. Results are presented that demonstrate the efficacy of our quality metric by comparing model performance against subjective scores on the database developed by the Video Quality Experts Group (VQEG).

[1]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[2]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[3]  Eero P. Simoncelli,et al.  Image compression via joint statistical characterization in the wavelet domain , 1999, IEEE Trans. Image Process..

[4]  Stefan Winkler,et al.  Perceptual distortion metric for digital color video , 1999, Electronic Imaging.

[5]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[6]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[7]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  David J. Heeger,et al.  Optical flow using spatiotemporal filters , 2004, International Journal of Computer Vision.

[9]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[10]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[11]  A. Bovik A VISUAL INFORMATION FIDELITY APPROACH TO VIDEO QUALITY ASSESSMENT , 2005 .

[12]  Alan C. Bovik,et al.  STATISTICAL VIDEO MODELS AND THEIR APPLICATION TO QUALITY ASSESSMENT , 2006 .