Fast disparity estimation for Multi-view plus depth video coding

Disparity estimation is used in Multi-view Video Coding (MVC) to remove the inter-view redundancies present in both color and depth multi-view video sequences. The standard H.264/MVC achieves high compression efficiency by deriving the optimal disparity vector through the exhaustive calculation of the Rate-Distortion cost function for all the possible search points. This makes disparity estimation highly computational expensive. This paper proposes an efficient technique that exploits both the multi-view and the epipolar geometries to determine the optimal search area, resulting in a reduction of search points and thus computations. Simulation results show that this technique can save up to 95% of the computational cost for disparity estimation, with negligible loss in coding efficiency for both the color and the depth multi-view video coding.

[1]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..

[3]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[4]  Mohammed Ebrahim Al-Mualla Chapter 4 – Basic Motion Estimation Techniques , 2002 .

[5]  T. Wiegand,et al.  Efficient Compression of Multi-View Depth Data Based on MVC , 2007, 2007 3DTV Conference.

[6]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[7]  Reuben A. Farrugia,et al.  Exploiting depth information for fast multi-view video coding , 2010, 28th Picture Coding Symposium.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  David Bull,et al.  Video Coding for Mobile Communications: Efficiency, Complexity and Resilience , 2002 .

[10]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[11]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[12]  J. Li,et al.  An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Aljoscha Smolic,et al.  Efficient Compression of Multi-View Video Exploiting Inter-View Dependencies Based on H.264/MPEG4-AVC , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[14]  Kwanghoon Sohn,et al.  Fast Disparity and Motion Estimation for Multi-view Video Coding , 2007, IEEE Transactions on Consumer Electronics.

[15]  N. Atzpadin,et al.  Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability , 2007, Signal Process. Image Commun..