3-D Reconstruction of Urban Scenes from Aerial Stereo Imagery: A Focusing Strategy

A contribution to the automatic 3-D reconstruction of complex urban scenes from aerial stereo pairs is proposed. It consists of segmenting the scene into two different kinds of components: the ground and the above-ground objects. The above-ground objects are classified either as buildings or as vegetation. The idea is to define appropriate regions of interest in order to achieve a relevant 3-D reconstruction. For that purpose, a digital elevation model of the scene is first computed and segmented into above-ground regions using a Markov random field model. Then a radiometric analysis is used to classify above-ground regions as building or vegetation, leading to the determination of the final above-ground objects. The originality of the method is its ability to cope with extended above-ground areas, even in case of a sloping ground surface. This characteristic is necessary in a urban environment. Results are very robust to image and scene variability, and they enable the utilization of appropriate local 3-D reconstruction algorithms.

[1]  Norbert Haala,et al.  Data fusion for the detection and reconstruction of buildings , 1995 .

[2]  O. Dissard,et al.  Analyse automatique d'images aériennes stéréoscopiques pour la restitution 3D des milieux urbains , 1998 .

[3]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  R. Bruce Irvin,et al.  Methods For Exploiting The Relationship Between Buildings And Their Shadows In Aerial Imagery , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[5]  Clive S. Fraser.  GIS: BETWEEN VISIONS AND APPLICATIONS , 1999 .

[6]  Christoph Hug,et al.  Extracting Artificial Surface Objects from Airborne Laser Scanner Data , 1997 .

[7]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[8]  Tuan Dang,et al.  Applying perceptual grouping and surface models to the detection and stereo reconstruction of buildings in aerial imagery , 1994, Other Conferences.

[9]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[10]  C Baillard,et al.  A STEREO MATCHING ALGORITHM FOR URBAN DIGITAL ELEVATION MODELS , 2000 .

[11]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[12]  J. Chris McGlone,et al.  Projective and object space geometry for monocular building extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[14]  Michel Roux,et al.  Feature matching for building extraction from multiple views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Matthieu Cord,et al.  Building Detection and Reconstruction from Mid- and High-Resolution Aerial Imagery , 1998, Comput. Vis. Image Underst..

[16]  E. Baltsavias,et al.  Use of DTMs/DSMs and orthoimages to support building extraction , 1995 .

[17]  Uwe Weidner,et al.  An Approach to Building Extraction from Digital Surface Models , 1996 .

[18]  Hsi-Jian Lee,et al.  Region matching and depth finding for 3D objects in stereo aerial photographs , 1990, Pattern Recognit..

[19]  Olivier Monga,et al.  Crestlines contribution to the automatic building extraction , 1997 .

[20]  Caroline Baillard.  Analyse d'images aeriennes stereoscopiques pour la restitution 3-d des milieux urbains. Detection et caracterisation du sursol , 1997 .

[21]  Olof Henricsson,et al.  The Role of Color Attributes and Similarity Grouping in 3-D Building Reconstruction , 1998, Comput. Vis. Image Underst..

[22]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Michel Roux.  Cooperation for analysis of maps and aerial images for urban scene description , 1997, Remote Sensing.

[24]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[25]  Michel Roux,et al.  Building detection from high-resolution color images , 1998, Remote Sensing.

[26]  Henri Maître,et al.  Surface reconstruction from multiple aerial images in dense urban areas , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[27]  Jefferey A. Shufelt,et al.  Fusion of monocular cues to detect man-made structures in aerial imagery , 1993 .

[28]  Frank Ade,et al.  Project AMOBE, Automation of digital terrain model generation and Mad-made OBject Extraction from aerial images: strategies, current status and future work , 1996 .

[29]  Wolfgang Eckstein,et al.  Fusion of digital terrain models and texture for object extraction , 1996 .

[30]  G. Giraudon,et al.  High-resolution Stereo for the Detection of Buildings , 1995 .

[31]  Jp Muller,et al.  Automated building height estimation and object extraction from multiresolution imagery , 1995, Defense, Security, and Sensing.

[32]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[33]  Norbert Haala.  Detection of buildings by fusion of range and image data , 1994, Other Conferences.

[34]  Luc Van Gool,et al.  Automatic Modeling and 3D Reconstruction of Urban House Roofs from High Resolution Aerial Imagery , 1998, ECCV.