Determination of Egomotion and Environmental Layout from Noisy Time-Varying Image Velocity in Binocular Image Sequences

We address the problem of interpreting time-varying image velocity fields generated by a moving binocular observer viewing a stationary environment under perspective projection to obtain 3-D information about the absolute motion of the observer (egomotion) and the absolute depth of environmental surface points. We conduct a numerical study of our algorithm (which involves solving non-linear systems of equations) for best, random and worst case image velocity error. As well, we investigate how good the initial guess for the nonlinear system of equations has to be. Other results include the presence of multiple solutions in time, how the algorithm performs when the underlying assumptions it is based on are violated and the effect of varying the spatial extent of the image points used, of varying the spatial baseline (separation of the left and right cameras) and of varying the temporal extents of the image points used (effectively varying the temporal baselines). As well, we investigate the use of convergent/divergent as opposed to parallel stereo camera setups.

[1]  Thomas S. Huang,et al.  Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Thomas S. Huang,et al.  Solving three-dimensional small-rotation motion equations: Uniqueness, algorithms, and numerical results , 1983, Computer Vision Graphics and Image Processing.

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  K. Prazdny,et al.  Motion and Structure from Optical Flow , 1979, IJCAI.

[5]  Allen M. Waxman,et al.  Contour Evolution, Neighborhood Deformation, and Global Image Flow: Planar Surfaces in Motion , 1985 .

[6]  G. Arfken.  Mathematical Methods for Physicists , 1967 .

[7]  J. Hay,et al.  Optical motions and space perception: an extension of Gibson's analysis. , 1966, Psychological review.

[8]  John Aloimonos,et al.  Perception of Rigid Motion from Spatio-Temporal Derivatives of Optical Flow , 1985 .

[9]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[10]  John K. Tsotsos,et al.  Determinations of egomotion and environmental layout from noisy time varying image velocity information in monocular image sequences , 1988 .

[11]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  T. D. Williams,et al.  Depth from camera motion in a real world scene , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jake K. Aggarwal,et al.  Visually Interpreting the Motion of Objects in Space , 1981, Computer.

[14]  Allen M. Waxman,et al.  Surface Structure and Three-Dimensional Motion from Image Flow Kinematics , 1985 .

[15]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yiannis Aloimonos,et al.  Determining the 3-D motion of a rigid surface patch without correspondence, under perspective projection: I. planar surfaces. II. curved surfaces , 1986, AAAI 1986.

[17]  Thomas S. Huang,et al.  Some Experiments on Estimating the 3-D Motion Parameters of a Rigid Body from Two Consecutive Image Frames , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Kenichi Kanatani.  Structure from Motion Without Correspondence: General Principle , 1985, IJCAI.

[19]  Daryl T. Lawton,et al.  Processing translational motion sequences , 1983, Comput. Vis. Graph. Image Process..

[20]  R. Woodham,et al.  Determining the movement of objects from a sequence of images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  J. Gibson.  Optical motions and transformations as stimuli for visual perception. , 1957, Psychological review.

[22]  Michel Hénon,et al.  A simple model of Saturn's rings , 1981 .

[23]  J. Gibson,et al.  Motion parallax as a determinant of perceived depth. , 1959, Journal of experimental psychology.

[24]  John K. Tsotsos,et al.  The Sensitivity of Motion and Structure Computations , 1987, AAAI.

[25]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[26]  A. Waxman,et al.  On the Uniqueness of Image Flow Solutions for Planar Surfaces in Motion , 1985 .

[27]  Hans-Hellmut Nagel,et al.  Volumetric model and 3D trajectory of a moving car derived from monocular TV frame sequences of a street scene , 1981, Comput. Graph. Image Process..

[28]  S. Ullman,et al.  The interpretation of visual motion , 1977 .