Depth perception and motion cue based 3D video quality assessment

In this paper, we propose a depth perception and motion cue based three-dimensional (3D) video quality assessment (VQA). Depth perception provides the real 3D impression during viewing the 3D video (3DV), and motion cue is also important factor to simulate a Human Visual Systems (HVS) for 3DV. We combine the depth perception and motion cue, and generate a weighting map for 3D VQA. For adjusting contribution of every index in traditional VQA which are unsuitable for 3D VQA, we propose the weighting map based Peak Signal-to-Noise Ratio (PSNR) and Structural SIMilarity (SSIM) to evaluate the quality of 3DV. In experimental results section, the proposed 3D VQA have been validated using both our subjective test scores as well as traditional VQA. Our proposed method yields high correlation with measured Mean Opinion Score (MOS) and consistent performance in an asymmetric coding condition.

[1]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[2]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[3]  Masayuki Tanimoto Overview of free viewpoint television , 2006, Signal Process. Image Commun..

[4]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[5]  Alan C. Bovik,et al.  Visual Importance Pooling for Image Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[6]  Jianjun Lei,et al.  New metric for stereo image quality assessment based on HVS , 2010, Int. J. Imaging Syst. Technol..

[7]  Patrick Le Callet,et al.  Using disparity for quality assessment of stereoscopic images , 2008, 2008 15th IEEE International Conference on Image Processing.

[8]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[10]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Constantin Paleologu,et al.  Perceptual Video Quality Assessment Based on Salient Region Detection , 2009, 2009 Fifth Advanced International Conference on Telecommunications.