AUTOMATIC LINE MATCHING AND 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE VIEWS

This paper describes two developments in the automatic reconstruction of buildings from aerial images. The first is an algorithm for automatically matching line segments over multiple images. The algorithm employs geometric constraints based on the multi-view geometry together with photometric constraints derived from the line neighbourhood, and achieves a performance of better than 95% correct matches over three views. The second development is a method for automatically computing a piecewise planar reconstruction based on the matched lines. The novelty here is that a planar facet hypothesis can be generated from a single 3D line, using an inter-image homography applied to the line neighbourhood. The algorithm has successfully generated near complete roof reconstructions from multiple images. This work has been carried out as part of the EC IMPACT project. A summary of the project is included.

[1]  Pascal Fua,et al.  Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery , 1996, ECCV.

[2]  Norbert Haala,et al.  Data fusion for the detection and reconstruction of buildings , 1995 .

[3]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Patrick Gros,et al.  Matching and Clustering: Two Steps Toward Automatic Object Modeling in Computer Vision , 1995, Int. J. Robotics Res..

[5]  Henri Maître,et al.  Segmentation of urban scenes from aerial stereo imagery , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[6]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  G. Giraudon,et al.  High-resolution Stereo for the Detection of Buildings , 1995 .

[8]  Rachid Deriche,et al.  Tracking line segments , 1990, Image Vis. Comput..

[9]  Olivier D. Faugeras,et al.  Building a Consistent 3D Representation of a Mobile Robot Environment by Combining Multiple Stereo Views , 1987, IJCAI.

[10]  Ansgar Brunn,et al.  Hierarchical Bayesian nets for building extraction using dense digital surface models , 1998 .

[11]  Thierry Viéville,et al.  Canonical Representations for the Geometries of Multiple Projective Views , 1996, Comput. Vis. Image Underst..

[12]  Allen R. Hanson,et al.  The Ascender System: Automated Site Modeling from Multiple Aerial Images , 1998, Comput. Vis. Image Underst..

[13]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Amnon Shashua,et al.  Trilinearity in Visual Recognition by Alignment , 1994, ECCV.

[15]  Michel Roux,et al.  Feature matching for building extraction from multiple views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Zhengyou Zhang,et al.  Token tracking in a cluttered scene , 1994, Image Vis. Comput..

[18]  James L. Crowley,et al.  Measurement and Integration of 3-D Structures By Tracking Edge Lines , 1990, ECCV.

[19]  Michel Roux,et al.  Building detection from high-resolution color images , 1998, Remote Sensing.

[20]  Henri Matre,et al.  Building Detection From Multiple Views , 1999 .

[21]  Henri Maître,et al.  Surface reconstruction from multiple aerial images in dense urban areas , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[22]  J. Chris McGlone,et al.  Projective and object space geometry for monocular building extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[24]  Luc Van Gool,et al.  Automatic Modeling and 3D Reconstruction of Urban House Roofs from High Resolution Aerial Imagery , 1998, ECCV.

[25]  Radu Horaud,et al.  Stereo Correspondence Through Feature Grouping and Maximal Cliques , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[27]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[28]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..