No reference objective quality metric for stereoscopic 3D video

The stereoscopic three-dimensional (3D) video technologies have achieved significant success in providing enhanced immersive experience to consumers. However network delivery of 3D video content at good quality levels is challenging mostly due to the variable network conditions. In this context, efficient objective 3D video quality assessment is a critical aspect, in particular for video service providers who need to adjust the video delivery process to the network conditions in real-time. Current objective 3D video quality assessment methods are reference-based, requiring the availability of the original 3D video sequences, which is difficult to achieve in practice. Additionally, most of the existing 3D video quality metrics are developed for depth-enhanced 3D. This paper proposes the No reference objective Video Quality Metric (NVQM) for real-time 3D video quality assessment. NVQM considers the correlation between network packet loss and perceptual video quality for different bit-rate video sequences. NVQM is modeled based on the video quality model specified in ITU-T G.1070 and tuned according to results of extensive subjective tests. NVQM was developed for the evaluation of side-by-side stereoscopic 3D sequences, the most widely commercialized 3D video format. The performance of NVQM is studied by comparing against three state-of-the-art video quality objective models: structural similarity index (SSIM), video quality metric (VQM), and ITU-T G.1070. Results show that NVQM outperforms the existing objective metrics with up to 23% in terms of accuracy.

[1]  Alan F. Smeaton,et al.  Performance-Aware Replication of Distributed Pre-Recorded IPTV Content , 2009, IEEE Transactions on Broadcasting.

[2]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[3]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[4]  José C. López-Ardao,et al.  Enhancements to the opinion model for video-telephony applications , 2009, LANC.

[5]  Angela Orebaugh,et al.  Wireshark & Ethereal Network Protocol Analyzer Toolkit (Jay Beale's Open Source Security) , 2006 .

[6]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[7]  Xiangyang Ji,et al.  Quality assessment of 3D asymmetric view coding using spatial frequency dominance model , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[8]  M. Gross,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[9]  Ahmet M. Kondoz,et al.  Perceptual Video Quality Metric for 3D video quality assessment , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[10]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[11]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[12]  Angela Orebaugh,et al.  Wireshark & Ethereal Network Protocol Analyzer Toolkit , 2007 .

[13]  Zhou Wang,et al.  Video quality assessment using structural distortion measurement , 2002, Proceedings. International Conference on Image Processing.

[14]  Ismo Rakkolainen,et al.  A Survey of 3DTV Displays: Techniques and Technologies , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[16]  A. Murat Tekalp,et al.  Unequal inter-view rate allocation using scalable stereo video coding and an objective stereo video quality measure , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[17]  Sebastian Möller,et al.  Speech Quality Estimation: Models and Trends , 2011, IEEE Signal Processing Magazine.

[18]  Richard Bowden,et al.  Hollywood 3D: Recognizing Actions in 3D Natural Scenes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Phuoc Tran-Gia,et al.  Towards QoE Management for Scalable Video Streaming , 2011 .

[20]  Przemyslaw Dymarski,et al.  QoS Conditions for VoIP and VoD , 2011 .

[21]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[22]  Luigi Rizzo,et al.  Dummynet revisited , 2010, CCRV.