A new reduced reference metric for color plus depth 3D video

A new reduced reference (RR) objective quality metric for 3D video is proposed that incorporates spatial neighboring information. The contrast measures from gray level co-occurrence matrices (GLCM) for both color and depth sections are main parts of spatial information. Side information is extracted from edge properties of reference 3D video and sent through an auxiliary channel. The other important factor in the proposed metric is the unequal weight of color and depth sections, which can maximize the performance of the proposed metric for some specific values. Performance of the proposed metric is validated through series of subjective tests. For validations, compression and transmission artifacts are considered. The average correlation of the proposed metric and subjective quality scores is 0.82 for compressed 3D videos when color to depth importance ratio is near 0.8. This measure for transmitted 3D videos is 0.857 for the same value of color to depth importance ratio.

[1]  Jeffrey Lubin,et al.  The use of psychophysical data and models in the analysis of display system performance , 1993 .

[2]  Stephen D. Voran,et al.  Objective video quality assessment system based on human perception , 1993, Electronic Imaging.

[3]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[4]  Borko Furht,et al.  Handbook of Video Databases: Design and Applications , 2003 .

[5]  Shinobu Ishihara.  Tests for Color Blindness , 1918 .

[6]  Shuichi Matsumoto,et al.  Objective measurement scheme for perceived picture quality degradation caused by MPEG encoding without any reference pictures , 2000, IS&T/SPIE Electronic Imaging.

[7]  Alan C. Bovik,et al.  DCT-domain blind measurement of blocking artifacts in DCT-coded images , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[8]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[9]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[10]  Chaminda T. E. R. Hewage,et al.  Edge-Based Reduced-Reference Quality Metric for 3-D Video Compression and Transmission , 2012, IEEE Journal of Selected Topics in Signal Processing.

[11]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[12]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[13]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[15]  Paolo Gastaldo,et al.  Objective assessment of MPEG-video quality: a neural-network approach , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[16]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[17]  C. Lambrecht.  Perceptual models and architectures for video coding applications , 1996 .

[18]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[19]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[20]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[21]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[22]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[23]  Ahmet M. Kondoz,et al.  Perceptual Video Quality Metric for 3D video quality assessment , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[24]  A. M. Kondoz,et al.  Extended VQM model for predicting 3D video quality considering ambient illumination context , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[25]  Alessandro Neri,et al.  A comparison between an objective quality measure and the mean annoyance values of watermarked videos , 2002, Proceedings. International Conference on Image Processing.

[26]  C. van den Branden Lambrecht.  A working spatio-temporal model of the human visual system for image restoration and quality assessment applications , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[27]  A. Aksay,et al.  Towards compound stereo-video quality metric: a specific encoder-based framework , 2006, 2006 IEEE Southwest Symposium on Image Analysis and Interpretation.