Fast disparity and motion estimation based on correlations for multiview video coding

Recently, multiview video coding has attracted great attention from industries and research institutes. However, the heavy computational complexity limits its practical applications. In this paper, a fast disparity and motion estimation for multiview video coding is presented, based on the correlations between the neighboring cameras and between the motion and the disparity. In the proposed approach, first, a search region estimation is proposed to reduce the disparity estimation complexity according to that the camera set is usually fixed and therefore the disparity between the two neighboring views can be limited to an estimable range. Second, a motion vector derivation is given based on the geometric relationship between the motion and the disparity. In addition, an early termination scheme is provided to further reduce the number of reference frames. The experimental results show that roughly 50% time saving for disparity and motion computing can be reached when compared to the anchor in multiview video coding test model JSVM only with negligible coding efficiency loss.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[3]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[4]  Nikolaos Grammalidis,et al.  Object-based coding of stereo image sequences using joint 3-D motion/disparity compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[7]  Kwanghoon Sohn,et al.  Fast Disparity and Motion Estimation for Multi-view Video Coding , 2007, IEEE Transactions on Consumer Electronics.

[8]  J. Li,et al.  An Epipolar Geometry-Based Fast Disparity Estimation Algorithm for Multiview Image and Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Wen Gao,et al.  A Fast Inter Frame Prediction Algorithm for Multi-View Video Coding , 2007, 2007 IEEE International Conference on Image Processing.

[10]  W. Gao,et al.  Inter-View Direct Mode for Multiview Video Coding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..

[12]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Sehoon Yea,et al.  Depth Estimation for View Synthesis in Multiview Video Coding , 2007, 2007 3DTV Conference.

[14]  W. Yang,et al.  Joint Motion and Disparity Fields Estimation for Stereoscopic Video Sequences , 2005, Signal Process. Image Commun..

[15]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[16]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..