Building Models of Regular Scenes from Structure and Motion

This paper describes a method for generating a model-based reconstruction of a scene from image data. The method uses the camera models and point cloud typically generated by a structure-and-motion process as a starting point for developing a higher level model of the scene. The method relies on the user to provide a minimal amount of structural seeding information from which more complex geometry is extrapolated. The regularity typically present in man-made environments is used to minimise the interaction required, but also to improve the accuracy of fit. We demonstrate model based reconstructions obtained using this method.

[1]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[2]  Roberto Cipolla,et al.  An Interactive System for Constraint-Based Modelling , 2000, British Machine Vision Conference.

[3]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[4]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[5]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[6]  Peter F. Sturm,et al.  Using geometric constraints through parallelepipeds for calibration and 3D modeling , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Robert B. Fisher,et al.  Recognition of Complex 3-D Objects from Range Data , 1993 .

[8]  N. Given,et al.  Fitting multiple models to multiple images with minimal user interaction , 2006 .

[9]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[10]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[12]  Anton van den Hengel,et al.  Fitting multiple models to multiple images with minimal user interaction , 2006 .

[13]  Frederick R. Forst,et al.  On robust estimation of the location parameter , 1980 .