Motion from Fixation

We study the problem of estimating rigid motion from a sequence of monocular perspective images obtained by navigating around an object while fixating a particular feature-point. The motivation comes from the mechanics of the human eye, which either pursues smoothly some fixation point in the scene, or `saccades? between different fixation points. In particular, we are interested in understanding whether fixation helps the process of estimating motion in the sense that it makes it more robust, better conditioned or simpler to solve.We cast the problem in the framework of `Epipolar geometry?, and propose a filter based upon an implicit dynamical model for recursively estimating motion under the fixation constraint. This allows us to compare directly the quality of the estimates of motion obtained by imposing the fixation constraint against the estimates obtained assuming a general rigid motion simply by changing the geometry of the parameter space, while maintaining the same structure of the recursive estimator. We also present a closed-form static solution from two views, a recursive estimator of the relative attitude between the viewer and the scene and assess how the estimates degrade in the presence of disturbances in the tracking procedure. All recursive filters are suitable for real-time implementation.

[1]  M. Ali Taalebinezhaad Direct Recovery of Motion and Shape in the General Case by Fixation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  David J. Fleet,et al.  Performance of optical flow techniques , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Thomas Kailath,et al.  Linear Systems , 1980 .

[4]  P. Perona,et al.  Motion estimation via dynamic vision , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Stefano Soatto,et al.  3-D Structure from Visual Motion: Modeling, Representation and Observability , 1997, Autom..

[8]  Matthew J. Barth,et al.  Egomotion determination through an intelligent gaze control strategy , 1993, IEEE Trans. Syst. Man Cybern..

[9]  A. Jazwinski Stochastic Processes and Filtering Theory , 1970 .

[10]  Augusto Sarti,et al.  Control on the Sphere and Reduced Attitude Stabilization , 1995 .

[11]  Daniel Raviv,et al.  A Unified Approach to Camera Fixation and Vision-Based Road Following , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[12]  Ian D. Reid,et al.  Recursive Affine Structure and Motion from Image Sequences , 1994, ECCV.

[13]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[14]  P. Perona,et al.  Motion estimation via dynamic vision , 1996, IEEE Trans. Autom. Control..

[15]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Pietro Perona,et al.  Visual navigation using a single camera , 1995, Proceedings of IEEE International Conference on Computer Vision.

[17]  Alex Pentland,et al.  Recursive estimation of structure and motion using relative orientation constraints , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .