Image Registration, Optical Flow and Local Rigidity

We address the theoretical problems of optical flow estimation and image registration in a multi-scale framework in any dimension. Much work has been done based on the minimization of a distance between a first image and a second image after applying deformation or motion field. Usually no justification is given about convergence of the algorithm used. We start by showing, in the translation case, that convergence to the global minimum is made easier by applying a low pass filter to the images hence making the energy “convex enough”. In order to keep convergence to the global minimum in the general case, we introduce a local rigidity hypothesis on the unknown deformation. We then deduce a new natural motion constraint equation (MCE) at each scale using the Dirichlet low pass operator. This transforms the problem to solving the energy minimization in a finite dimensional subspace of approximation obtained through Fourier Decomposition. This allows us to derive sufficient conditions for convergence of a new multi-scale and iterative motion estimation/registration scheme towards a global minimum of the usual nonlinear energy instead of a local minimum as did all previous methods. Although some of the sufficient conditions cannot always be fulfilled because of the absence of the necessary a priori knowledge on the motion, we use an implicit approach. We illustrate our method by showing results on synthetic and real examples in dimension 1 (signal matching, Stereo) and 2 (Motion, Registration, Morphing), including large deformation experiments.

[1]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[2]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[3]  Gary Whitten A framework for adaptive scale space tracking solutions to problems in computational vision , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Michal Irani,et al.  Detecting and Tracking Multiple Moving Objects Using Temporal Integration , 1992, ECCV.

[5]  Shmuel Peleg,et al.  Motion Segmentation Using Convergence Properties , 1994 .

[6]  R. Rabbitt,et al.  3D brain mapping using a deformable neuroanatomy. , 1994, Physics in medicine and biology.

[7]  Nicholas Ayache,et al.  Medical computer vision, virtual reality and robotics , 1995, Image Vis. Comput..

[8]  Jean-Marc Odobez,et al.  Robust Multiresolution Estimation of Parametric Motion Models , 1995, J. Vis. Commun. Image Represent..

[9]  Jean-Philippe Thirion,et al.  Fast Non-Rigid Matching of 3D Medical Images , 1995 .

[10]  Jean-Philippe Thirion,et al.  Non-rigid matching using demons , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Morten Bro-Nielsen,et al.  Fast Fluid Registration of Medical Images , 1996, VBC.

[12]  Laurent D. Cohen,et al.  A multiresolution algorithm for signal and image registration , 1997, Proceedings of International Conference on Image Processing.

[13]  Darrel Greenhill,et al.  Recovering very large visual motion fields , 1997 .

[14]  Martin Lefébure Estimation de mouvement et recalage de signaux et d'images : formalisation et analyse , 1998 .

[15]  Joachim Weickert,et al.  On Discontinuity-Preserving Optic Flow , 1998 .

[16]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[17]  Patrick Pérez,et al.  Dense estimation and object-based segmentation of the optical flow with robust techniques , 1998, IEEE Trans. Image Process..

[18]  Christophe P. Bernard,et al.  Discrete Wavelet Analysis: A New Framework for Fast Optic Flow Computation , 1998, ECCV.

[19]  Rama Chellappa,et al.  Optical Flow Using Overlapped Basis Functions for Solving Global Motion Problems , 1998, ECCV.

[20]  Rachid Deriche,et al.  Computing Optical Flow via Variational Techniques , 1999, SIAM J. Appl. Math..

[21]  C. Stiller,et al.  Estimating motion in image sequences , 1999, IEEE Signal Process. Mag..

[22]  Julio Esclarín Monreal,et al.  A PDE model for computing the optimal flow , 1999 .

[23]  Demetri Terzopoulos,et al.  Signal matching through scale space , 1986, International Journal of Computer Vision.

[24]  Alain Trouvé,et al.  Diffeomorphisms Groups and Pattern Matching in Image Analysis , 1998, International Journal of Computer Vision.

[25]  David J. Fleet,et al.  Design and Use of Linear Models for Image Motion Analysis , 2000, International Journal of Computer Vision.

[26]  Michael J. Black,et al.  On the unification of line processes, outlier rejection, and robust statistics with applications in early vision , 1996, International Journal of Computer Vision.

[27]  Joachim Weickert,et al.  Reliable Estimation of Dense Optical Flow Fields with Large Displacements , 2000, International Journal of Computer Vision.

[28]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.