The Ascender System: Automated Site Modeling from Multiple Aerial Images

The Ascender system acquires, extends, and refines 3D geometric site models from calibrated aerial imagery. To acquire a new site model, an automated building detector is run on one image to hypothesize potential building rooftops. Supporting evidence is located in other images via epipolar line segment matching in constrained search regions. The precise 3D shape and location of each building is then determined by multiimage triangulation under geometric constraints of 3D orthogonality, parallelness, colinearity, and coplanarity of lines and surfaces. Projective mapping of image intensity information onto these polyhedral building models results in a realistic site model that can be rendered using virtual “fly-through” graphics. As new images of the site become available, model extension and refinement procedures are performed to add previously unseen buildings and to improve the geometric accuracy of the existing 3D building models. In this way, the system gradually accumulates evidence over time to make the site model more complete and more accurate. An extensive performance evaluation of component algorithms and the full system has been carried out. Two-dimensional building detection accuracy, as well as accuracy of the three-dimensional building reconstruction, are presented for a representative data set.

[1]  Edward M. Riseman,et al.  Hybrid weak-perspective and full-perspective matching , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Norbert Haala,et al.  Data fusion for the detection and reconstruction of buildings , 1995 .

[4]  Robert T. Collins,et al.  Task driven perceptual organization for extraction of rooftop polygons , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[5]  Y. Q. Cheng Acquisition of 3D models from a set of 2D images , 1996 .

[6]  W. Förstner Mid-Level Vision Processes for Automatic Building Extraction , 1995 .

[7]  J. Beveridge,et al.  Optimal geometric model matching under full 3D perspective , 1995, Proceedings of 1994 IEEE 2nd CAD-Based Vision Workshop.

[8]  Taejung Kim,et al.  Building Extraction Building Extraction and Verification from Spaceborne and Aerial Imagery using Image Understanding Fusion Techniques , 1995 .

[9]  Ramakant Nevatia,et al.  Recovering building structures from stereo , 1992, [1992] Proceedings IEEE Workshop on Applications of Computer Vision.

[10]  David M. McKeowan Research in the Automated Analysis of Remotely Sensed Imagery: 1994-1995 , 1998 .

[11]  Michel Roux,et al.  Feature matching for building extraction from multiple views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Robert T. Collins,et al.  Automated Texture Extraction from Multiple Images to Support Site Model Refinement and Visualization , 1996 .

[13]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[14]  R. Bruce Irvin,et al.  Methods For Exploiting The Relationship Between Buildings And Their Shadows In Aerial Imagery , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[15]  Uwe Weidner,et al.  An Approach to Building Extraction from Digital Surface Models , 1996 .

[16]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[17]  Takeo Kanade,et al.  Incremental Reconstruction of 3D Scenes from Multiple, Complex Images , 1986, Artif. Intell..

[18]  J. Chris McGlone,et al.  Projective and object space geometry for monocular building extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Frank Ade,et al.  Project AMOBE, Automation of digital terrain model generation and Mad-made OBject Extraction from aerial images: strategies, current status and future work , 1996 .

[20]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[21]  Donald J. Gerson,et al.  RADIUS phase II: the RADIUS test-bed system , 1996, Other Conferences.

[22]  T. H. Kolbe,et al.  Integration of 2D and 3D reasoning for building reconstruction using a generic hierarchical model , 1997 .

[23]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Frank Ade,et al.  Project Amobe: Strategies, Current Status And Future Work , 1996 .

[25]  R. Collins,et al.  Triangulation without Correspondences , 1994 .

[26]  Anthony Hoogs,et al.  RADIUS common development environment , 1992, Other Conferences.

[27]  Howard J. Schultz,et al.  Retrieving Shape Information from Multiple Images of a Specular Surface , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Tuan Dang,et al.  Applying perceptual grouping and surface models to the detection and stereo reconstruction of buildings in aerial imagery , 1994, Other Conferences.

[29]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .

[31]  Yuan C. Hsieh,et al.  Performance analysis of object-space matching for building extraction using several images , 1995, Defense, Security, and Sensing.

[32]  Allen R. Hanson,et al.  Site Model Acquisition under the UMass RADIUS Project , 1994 .

[33]  Edward M. Riseman,et al.  Token-based extraction of straight lines , 1989, IEEE Trans. Syst. Man Cybern..