Edge-preserving Simultaneous Joint Motion-Disparity Estimation

We propose an energy-based joint motion and disparity estimation algorithm with an anisotropic diffusion operator to yield correct and dense displacement vectors. The model estimates the left and right motions simultaneously in order to increase accuracy. We use the Euler-Lagrange equation with variational methods and solve the equation with the finite difference method (FDM). Then, the method computes the initial disparity in the current frame with joint estimation constraint, and regularizes this disparity by using our energy model. Experimental results show that the proposed algorithm provides accurate motion-disparity maps, and preserve the discontinuities of the object boundaries well

[1]  Takeo Kanade,et al.  Three-dimensional scene flow , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  H. Ermert,et al.  Ultrasonic strain imaging of the female breast using phase root seeking and three-dimensional "optical flow" , 1998, 1998 IEEE Ultrasonics Symposium. Proceedings (Cat. No. 98CH36102).

[3]  Ye Zhang,et al.  On 3-D scene flow and structure recovery from multiview image sequences , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ebroul Izquierdo.  Stereo matching for enhanced telepresence in three-dimensional videocommunications , 1997, IEEE Trans. Circuits Syst. Video Technol..

[6]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[7]  Yoonsik Choe,et al.  Disparity estimation using a region-dividing technique and energy-based regularization , 2004 .

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  Rachid Deriche,et al.  Dense Disparity Map Estimation Respecting Image Discontinuities: A PDE and Scale-Space BasedApproach , 2002, MVA.