Synthesis distortion estimation in 3D video using frequency and spatial analysis

We propose an analytical model to estimate the synthesized view quality in 3D video. Specifically, we estimate the depth-error induced distortion using an approach that combines frequency and spatial domain analysis. We also propose to decompose the spatial-variant video signals into gradient-based representations to capture the interaction between image gradients, depth errors and synthesis distortion. Experiment results with video sequences and coding/rendering tools used in MPEG 3DV activities show that our analytical model can accurately estimate the synthesis noise power.

[1]  Wen Gao,et al.  A Compact Stereoscopic Video Representation for 3D Video Generation and Coding , 2012, 2012 Data Compression Conference.

[2]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[3]  Minh N. Do,et al.  Depth Video Enhancement Based on Weighted Mode Filtering , 2012, IEEE Transactions on Image Processing.

[4]  Christophe Tillier,et al.  Adaptive wavelet coding of the depth map for stereoscopic view synthesis , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[5]  B. Achiriloaie,et al.  VI REFERENCES , 1961 .

[6]  Keita Takahashi,et al.  Theoretical Analysis of View Interpolation With Inaccurate Depth Information , 2012, IEEE Transactions on Image Processing.

[7]  Gene Cheung,et al.  Bit allocation for multiview image compression using cubic synthesized view distortion model , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[8]  Antonio Ortega,et al.  Depth map distortion analysis for view rendering and depth coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[9]  Aljoscha Smolic,et al.  The effects of multiview depth video compression on multiview rendering , 2009, Signal Process. Image Commun..

[10]  Thomas Maugey,et al.  Consistent view synthesis in interactive multiview imaging , 2012, 2012 19th IEEE International Conference on Image Processing.

[11]  Qingming Huang,et al.  Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model , 2009, Signal Process. Image Commun..

[12]  W. Matusik,et al.  Coding Approaches for End-To-End 3D TV Systems , 2004 .

[13]  Lu Fang,et al.  An Analytical Model for Synthesis Distortion Estimation in 3D Video , 2014, IEEE Transactions on Image Processing.

[14]  Antonio Ortega,et al.  Depth map coding with distortion estimation of rendered view , 2010, Electronic Imaging.

[15]  Antonio Ortega,et al.  Edge-preserving depth-map coding using graph-based wavelets , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[16]  Ha T. Nguyen,et al.  Error Analysis for Image-Based Rendering with Depth Information , 2009, 2006 International Conference on Image Processing.

[17]  Dong Tian,et al.  On modeling the rendering error in 3D video , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  Kwanghoon Sohn,et al.  2D/3D freeview video generation for 3DTV system , 2008, 2008 15th IEEE International Conference on Image Processing.

[19]  Dong Tian,et al.  A trellis-based approach for robust view synthesis , 2011, 2011 18th IEEE International Conference on Image Processing.