Surface-Based Structure-from-Motion using Feature Groupings

In this paper we describe a complete system from feature extraction to reconstruction of 3D models of indoor environments. The system uses a novel matching algorithm which matches groupings of features associated with boundaries of objects in the scene. We also present an extension of our structure-from-motion algorithm to incorporate surface constraints. We describe how planar surfaces can be incorporated into the model update procedure, and are hypothesised from the matched groupings of features between image frames. We present reconstructions of environments taken by an autonomous robot to demonstrate the improvement that can be achieved by this approach. Environment modelling, structure from motion, feature matching, mobile robotics

[1]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[2]  Richard Szeliski,et al.  Geometrically Constrained Structure from Motion: Points on Planes , 1998, SMILE.

[3]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[4]  F McLauchlanPhilip,et al.  Active Camera Calibration for a Head-Eye Platform Using the Variable State-Dimension Filter , 1996 .

[5]  Z. W. Birnbaum,et al.  An Introduction to Probability and Mathematical Statistics , 1963 .

[6]  Josef Kittler,et al.  Optimal Edge Detectors for Ramp Edges , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Josef Kittler,et al.  An Optimizing Line Finder Using a Hough Transform Algorithm , 1997, Comput. Vis. Image Underst..

[8]  Harpreet S. Sawhney.  Simplifying motion and structure analysis using planar parallax and image warping , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[9]  Didier Bondyfalat,et al.  Imposing Euclidean Constraints During Self-Calibration Processes , 1998, SMILE.

[10]  Olivier D. Faugeras,et al.  A Stability Analysis of the Fundamental Matrix , 1994, ECCV.

[11]  Narendra Ahuja,et al.  Integrated 3D Analysis of Flight Image Sequences , 1994, ECCV.

[12]  Bill Triggs.  Optimal Estimation of Matching Constraints , 1998, SMILE.

[13]  Olivier Faugeras,et al.  3D Dynamic Scene Analysis , 1992 .

[14]  Bill Triggs,et al.  Autocalibration from Planar Scenes , 1998, ECCV.

[15]  Jake K. Aggarwal,et al.  Line Correspondences from Cooperating Spatial and Temporal Grouping Processes for a Sequence of Images , 1997, Comput. Vis. Image Underst..

[16]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[17]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[20]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  David W. Murray,et al.  Active Camera Calibration for a Head-Eye Platform Using the Variable State-Dimension Filter , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[23]  David W. Murray,et al.  A unifying framework for structure and motion recovery from image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[24]  H. M. Karara,et al.  Non-topographic photogrammetry , 1989 .

[25]  J. Hannan,et al.  Introduction to probability and mathematical statistics , 1986 .