Automated architectural acquisition from a camera undergoing planar motion

Much recent research on structure and motion recovery has concentrated on the case of reconstruction of unstructured environments from an uncalibrated video sequence. Here we show the advantages that accrue to both the motion determination and structure recovery if constraints are available on the motion and environment. We consider the case of a camera with fixed internal parameters undergoing planar motion in an indoor environment for which several dominant directions occur. The novelty of this work is that it is shown that under these constraints the problems of both motion determination and 3D structure recovery can be reduced to a sequence of one parameter searches. This low dimensional search enables efficient, robust and reliable algorithms to be engineered. The resulting algorithms are demonstrated on images of very visually impoverished scenes, and the results are compared to ground truth.

[1]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[2]  Jaime López-Krahe,et al.  Contribution to the Determination of Vanishing Points Using Hough Transform , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Andrew W. Fitzgibbon,et al.  Real-time Panoramic Mosaics and Augmented Reality , 1998, BMVC.

[4]  Luc Van Gool,et al.  The cascaded Hough transform as an aid in aerial image interpretation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Robert T. Collins,et al.  Vanishing point calculation as a statistical inference on the unit sphere , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[6]  William H. Press,et al.  Numerical recipes in C , 2002 .

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  C. Coelho,et al.  Using geometrical rules and a priori knowledge for the understanding of indoor scenes , 1990, BMVC.

[10]  Beatrice Brillault-O'Mahony,et al.  New method for vanishing point detection , 1991, CVGIP Image Underst..

[11]  Roberto Cipolla,et al.  Camera Calibration from Vanishing Points in Image of Architectural Scenes , 1999, BMVC.

[12]  Amnon Shashua,et al.  A robust method for computing vehicle ego-motion , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[13]  G. F. McLean,et al.  Vanishing Point Detection by Line Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, ECCV.

[15]  Long Quan,et al.  Determining perspective structures using hierarchical Hough transform , 1989, Pattern Recognit. Lett..

[16]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[17]  Josechu J. Guerrero,et al.  Camera motion from brightness on lines. Combination of features and normal flow , 1999, Pattern Recognit..

[18]  Philip H. S. Torr,et al.  Outlier detection and motion segmentation , 1993, Other Conferences.

[19]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[20]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[21]  Olivier Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[22]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Vanishing Point Detection Techniques , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  J. A. Castellanos,et al.  Experiments in Multisensor Mobile Robot Localization and Map Building , 1998, IFAC Proceedings Volumes.

[24]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.