SV-CIELAB: Video Quality Assessment using Spatio-Velocity Contrast Sensitivity Function

Due to the development and popularization of high-definition televisions, digital video cameras, Blu-ray discs, digital broadcasting, IP television and so on, it plays an important role to identify and quantify video quality degradations. In this paper, we propose SV-CIELAB which is an objective video quality assessment (VQA) method using a spatio-velocity contrast sensitivity function (SV-CSF). In SV-CIELAB, motion information in videos is effectively utilized for filtering unnecessary information in the spatial frequency domain. As the filter to apply videos, we used the SV-CSF. It is a modulation transfer function of the human visual system, and consists of the relationship among contrast sensitivities, spatial frequencies and velocities of perceived stimuli. In the filtering process, the SV-CSF cannot be directly applied in the spatial frequency domain because spatial coordinate information is required when using velocity information. For filtering by the SV-CSF, we obtain video frames separated in spatial frequency domain. By using velocity information, the separated frames with limited spatial frequencies are weighted by contrast sensitivities in the SV-CSF model. In SV-CIELAB, the criteria are obtained by calculating image differences between filtered original and distorted videos. For the validation of SV-CIELAB, subjective evaluation experiments were conducted. The subjective experimental results were compared with SV-CIELAB and the conventional VQA methods such as CIELAB color difference, Spatial-CIELAB, signal to noise ratio and so on. From the experimental results, it was shown that SV-CIELAB is a more efficient VQA method than the conventional methods.

[1]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[2]  Stefan Winkler,et al.  Perceptual distortion metric for digital color video , 1999, Electronic Imaging.

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  D. H. Kelly Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[5]  Peter G. J. Barten,et al.  Contrast sensitivity of the human eye and its e ects on image quality , 1999 .

[6]  Jun Someya,et al.  Evaluation of liquid‐crystal‐display motion blur with moving‐picture response time and human perception , 2007 .

[7]  Thrasyvoulos N. Pappas,et al.  Perceptual criteria for image quality evaluation , 2005 .

[8]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[9]  D. H. Kelly Spatiotemporal variation of chromatic and achromatic contrast thresholds. , 1983, Journal of the Optical Society of America.

[10]  C. Spearman The proof and measurement of association between two things. , 2015, International journal of epidemiology.

[11]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Electronic Imaging.

[12]  Keita Hirai,et al.  Measurement and Modeling of Viewing-Condition-Dependent Spatio-Velocity Contrast Sensitivity Function , 2007, Color Imaging Conference.

[13]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[14]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Norimichi Tsumura,et al.  Evaluation of Image Corrected by Retinex Method Based on S-CIELAB and Gazing Information , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[16]  Xin Tong,et al.  Video quality evaluation using ST-CIELAB , 1999, Electronic Imaging.

[17]  Zhou Wang,et al.  Spatial Pooling Strategies for Perceptual Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[18]  Scott Daly,et al.  Engineering observations from spatiovelocity and spatiotemporal visual models , 1998, Electronic Imaging.

[19]  Keita Hirai,et al.  Correlation Analysis between Motion Blur Widths and Human Perception , 2008 .

[20]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[21]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[22]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[23]  Jeff B. Pelz,et al.  Spatio-velocity CSF as a function of retinal velocity using unstabilized stimuli , 2006, Electronic Imaging.

[24]  Hideaki Haneishi,et al.  Quantification of color motion picture quality considering human visual sensitivity , 2008, CGIV/MCS.