Extended no reference objective Quality Metric for stereoscopic 3D video

Currently, three-dimensional (3D) video is gaining increasing popularity by providing immersive user experience. Compared against conventional 2D video, 3D video excels at bringing a “live” scene closer to the users, and/or trying to place the users in the environment of the displayed content. However, streaming 3D video sequences over the IP networks is challenging due to the impact of dynamic network conditions on user quality. Accurate objective 3D video quality assessment is critical for advanced real-time video streaming adaptation solutions. Most state-of-the-art objective 3D video quality metrics are reference-based and require access to the original 3D video sequences, which is not possible for the real-time applications. This paper proposes the extended No-reference objective 3D Video Quality Metric (eNVQM) for real time 3D video quality assessment. eNVQM establishes a correlation between network packet loss and stereoscopic 3D video quality and was tuned according to extensive subjective testing results. Performance of eNVQM is studied in comparison with two state-of-the-art objective video quality metrics: structural similarity index (SSIM) and video quality metric (VQM).

[1]  Zhou Wang,et al.  Video quality assessment using structural distortion measurement , 2002, Proceedings. International Conference on Image Processing.

[2]  Jeremy Adler,et al.  Quantifying colocalization by correlation: The Pearson correlation coefficient is superior to the Mander's overlap coefficient , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[3]  Guihua Er,et al.  Objective quality assessment of depth image based rendering in 3DTV system , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[4]  Sebastian Möller,et al.  Speech Quality Estimation: Models and Trends , 2011, IEEE Signal Processing Magazine.

[5]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[6]  Alan F. Smeaton,et al.  Performance-Aware Replication of Distributed Pre-Recorded IPTV Content , 2009, IEEE Transactions on Broadcasting.

[7]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[8]  Richard Bowden,et al.  Hollywood 3 D : Recognizing Actions in 3 D Natural Scenes , 2013 .

[9]  Debajyoti Pal,et al.  Extending the ITU-T G.1070 Opinion Model to Support Current Generation H.265/HEVC Video Codec , 2016, ICCSA.

[10]  P. Callet,et al.  Stereoscopic 3 D video coding quality evaluation with 2 D objective metrics , 2013 .

[11]  Pedro Assuncao,et al.  Objective quality prediction model for lost frames in 3D video over TS , 2013, 2013 IEEE International Conference on Communications Workshops (ICC).

[12]  Ahmet M. Kondoz,et al.  Perceptual Video Quality Metric for 3D video quality assessment , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[13]  A. Murat Tekalp,et al.  Unequal inter-view rate allocation using scalable stereo video coding and an objective stereo video quality measure , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[14]  Gabriel-Miro Muntean,et al.  A Prioritized Adaptive Scheme for Multimedia Services over IEEE 802.11 WLANs , 2013, IEEE Transactions on Network and Service Management.

[15]  P. Le Callet,et al.  Stereoscopic 3D video coding quality evaluation with 2D objective metrics , 2013, Electronic Imaging.

[16]  Divesh Srivastava,et al.  CPM: Adaptive Video-on-Demand with Cooperative Peer Assists and Multicast , 2009, IEEE INFOCOM 2009.

[17]  Gabriel-Miro Muntean,et al.  iPAS: An user perceived quality-based intelligent Prioritized Adaptive Scheme for IPTV in Wireless Home Networks , 2010, 2010 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[18]  Phuoc Tran-Gia,et al.  Towards QoE Management for Scalable Video Streaming , 2011 .

[19]  Przemyslaw Dymarski,et al.  QoS Conditions for VoIP and VoD , 2011 .

[20]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[21]  Richard Bowden,et al.  Hollywood 3D: Recognizing Actions in 3D Natural Scenes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  M. Gross,et al.  Nonlinear disparity mapping for stereoscopic 3D , 2010, ACM Trans. Graph..

[23]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[24]  Xiangyang Ji,et al.  Quality assessment of 3D asymmetric view coding using spatial frequency dominance model , 2009, 2009 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[25]  Chia-Hsiang Menq,et al.  Smooth-surface approximation and reverse engineering , 1991, Comput. Aided Des..

[26]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[27]  Gabriel-Miro Muntean,et al.  No reference objective quality metric for stereoscopic 3D video , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.