Structure from motion: determining the range and orientation of surfaces by image interpolation

A new scheme is presented for determining the range and orientation of arbitrarily oriented surfaces directly from the apparent image motion captured by a moving camera. The mean range, slope, and tilt of the surface are computed by decomposition of the image motion into components representing translation, compression, and shear. These motion parameters are computed directly from intensity changes in the images by the solution of a set of linear equations, the coefficients of which are derived from the raw image data by a novel process of linear image interpolation. The advantages of this scheme over those of existing schemes are that (1) it involves no identification or tracking of features and therefore avoids the correspondence problem, (2) it does not require measurement of high-order spatial or temporal derivatives of the image and is therefore robust to noise, and (3) the three parameters characterizing the surface (mean range, slope, and tilt) are recovered in a noniterative calculation. The scheme is ideal for applications such as autonomous robot navigation in which information about slope and tilt can be used to determine the traversability of the surrounding terrain.

[1]  A. Lynn Abbott,et al.  Active Stereo: Integrating Disparity, Vergence, Focus, Aperture and Calibration for Surface Estimation , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jun Ma,et al.  Depth from zooming , 1990 .

[4]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .

[5]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[6]  Joseph K. Kearney,et al.  Optical Flow Estimation: An Error Analysis of Gradient-Based Methods with Local Optimization , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Andrew Blake,et al.  Shape from texture: Ideal observers and human psychophysics , 1993, Vision Research.

[8]  Tony Lindeberg,et al.  Direct Estimation of Local Surface Shape in a Fixating Binocular Vision System , 1994, ECCV.

[9]  S. Zucker,et al.  Shape-from-shading on a cloudy day , 1994 .

[10]  Ciro Cafforio,et al.  Methods for measuring small displacements of television images , 1976, IEEE Trans. Inf. Theory.

[11]  Jitendra Malik,et al.  Recovering Surface Curvature and Orientation From Texture Distortion: A Least Squares Algorithm and Sensitivity Analysis , 1994, ECCV.

[12]  Alex Pentland,et al.  Shading into Texture , 1984, Artif. Intell..

[13]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[14]  Mandyam V. Srinivasan,et al.  Measurement of optical flow by a generalized gradient scheme , 1991 .

[15]  Mandyam V. Srinivasan,et al.  Robust depth extraction for mobile robots , 1993, Other Conferences.

[16]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..