Edge-Based Reduced-Reference Quality Metric for 3-D Video Compression and Transmission

3-D video applications are delivered over a range of different transmission systems. In order to provide demanding customers with a better service over unreliable communication channels, compression and transmission system parameters can be changed “on the fly.” For interactive 3-D video services, video compression can be adapted (e.g., it can be made more robust and/or rate adaptive) based on the quality measured at the receiver. It has been shown that measuring the (3-D) video quality at the receiver-side, and using this information as a feedback to fine tune the system parameters, will result in improved performance in such systems. However, measuring 3-D video quality using Full-Reference (FR) quality metrics is not feasible due to the need of the original 3-D video sequence at the receiver-side for comparison. Therefore, this paper proposes a Reduced-Reference (RR) quality metric for color plus depth 3-D video compression and transmission, using the extracted edge information of color plus depth map 3-D video. This work is motivated by the fact that the edges/contours of the depth map can represent different depth levels and this can be considered for measuring structural degradations. Since depth map boundaries are also coincident with the corresponding color image object boundaries, edge information of the color image and of the depth map is compared to obtain a quality index (structural degradation) for the corresponding color image sequence. The performance of the method is evaluated for different compression ratios and network conditions. The proposed method achieves good results compared to its counterpart FR quality metric, with a lower overhead for side-information.

[1]  Adrian Hilton,et al.  Objective Quality Assessment in Free-Viewpoint Video Production , 2008, 3DTV-CON 2008.

[2]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[3]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[4]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[5]  Levent Onural,et al.  Television in 3-D: What Are the Prospects? , 2007 .

[6]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Patrick Le Callet,et al.  Quality Assessment of Stereoscopic Images , 2008, EURASIP J. Image Video Process..

[8]  John W. Woods Multidimensional Signal, Image, and Video Processing and Coding, Second Edition , 2011 .

[9]  Jyrki Huusko,et al.  Content adaptive network aware joint optimization of wireless video transmission , 2007, IEEE Communications Magazine.

[10]  Wijnand A. IJsselsteijn,et al.  Perceptual evaluation of JPEG-coded stereoscopic images , 2003, IS&T/SPIE Electronic Imaging.

[11]  Margaret H. Pinson Low Bandwidth Reduced Reference Video Quality Monitoring System , 2005 .

[12]  Kwanghoon Sohn,et al.  Depth map quality metric for three-dimensional video , 2009, Electronic Imaging.

[13]  R. Venkatesh Babu,et al.  NO-REFERENCE METRICS FOR VIDEO STREAMING APPLICATIONS , .

[14]  Philip J. Corriveau,et al.  Psychovisual aspects of viewing stereoscopic video sequences , 1998, Electronic Imaging.

[15]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[16]  Søren Forchhammer,et al.  Efficient Coding of Shape and Transparency for Video Objects , 2007, IEEE Transactions on Image Processing.

[17]  Lai-Man Po,et al.  Edge-Based Structural Similarity for Image Quality Assessment , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[18]  Wijnand A. IJsselsteijn,et al.  Subjective evaluation of stereoscopic images: effects of camera parameters and display duration , 2000, IEEE Trans. Circuits Syst. Video Technol..

[19]  Ahmet M. Kondoz,et al.  Quality analysis for 3D video using 2D video quality models , 2008, IEEE Transactions on Consumer Electronics.

[20]  Jean-Yves Guillemaut,et al.  Objective Quality Assessment in Free-Viewpoint Video Production , 2008, 2008 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[21]  Jörn Ostermann Efficient encoding of binary shapes using MPEG-4 , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[22]  Ahmet M. Kondoz,et al.  Edge adaptive upsampling of depth map videos for enhanced free-viewpoint video quality , 2009 .

[23]  A. Gotchev,et al.  Quality assessment of 3D video in rate allocation experiments , 2008, 2008 IEEE International Symposium on Consumer Electronics.

[24]  Ahmet M. Kondoz,et al.  Stereoscopic TV over IP , 2007 .

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Ahmet M. Kondoz,et al.  Prediction of stereoscopic video quality using objective quality models of 2-D video , 2008 .

[27]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[28]  Ahmet M. Kondoz,et al.  Quality Evaluation of Color Plus Depth Map-Based Stereoscopic Video , 2009, IEEE Journal of Selected Topics in Signal Processing.

[29]  Roushain Akhter,et al.  No-reference stereoscopic image quality assessment , 2010, Electronic Imaging.