The Role of Color Attributes and Similarity Grouping in 3-D Building Reconstruction

This paper addresses two major issues: 3-D building reconstruction and the role of color attributes and similarity grouping. We present ARUBA, a general framework for automated 3-D building reconstruction from multiple color aerial images. After highlighting the strategy and concisely describing the framework and its 2-D and 3-D processing modules, we will evaluate the reconstructed roofs with respect to accurate reference data. The second part of the paper shows that geometry, although important, should not be the only source of information exploited in the reconstruction process. The main objectives are to demonstrate that (1) color is a very important cue in reconstructing a general class of objects, (2) it is crucial to retain all information during the entire processing chain, (3) a general class of objects parts can be efficiently extracted by grouping edges and lines by means of similarity, and (4) a mutual interaction between 2-D and 3-D processing is important.

[1]  Allen R. Hanson,et al.  Automatic Extraction of Buildings and Terrain from Aerial Images , 1995 .

[2]  Olof Henricsson,et al.  Analysis of image structures using color attributes and similarity relations , 1996 .

[3]  Christian Heipke,et al.  Digital photogrammetric systems , 1991 .

[4]  Ramakant Nevatia,et al.  Detection and description of buildings from multiple aerial images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Frank Ade,et al.  Project Amobe: Strategies, Current Status And Future Work , 1996 .

[6]  Taejung Kim,et al.  Building Extraction Building Extraction and Verification from Spaceborne and Aerial Imagery using Image Understanding Fusion Techniques , 1995 .

[7]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Michel Roux,et al.  Feature matching for building extraction from multiple views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[10]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[11]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[12]  J. Hothmer.  Book reviewInternational archives of photogrammetry and remote sensing: ISPRS, Editor S. Murai: volume 27 part A, Tokyo-Japan-Japan 1989 , 1989 .

[13]  H. Maas.  Automatic DEM generation by multi-image feature based matching , 1996 .

[14]  Jefferey A. Shufelt,et al.  Fusion of monocular cues to detect man-made structures in aerial imagery , 1993 .

[15]  Steven W. Zucker,et al.  Computing Contour Closure , 1996, ECCV.

[16]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Pascal Fua,et al.  Model-Based Optimization: Accurate and Consistent Site Modeling , 1996 .

[18]  Roberto Cipolla,et al.  Computer Vision — ECCV '96 , 1996, Lecture Notes in Computer Science.

[19]  Martin A. Fischler,et al.  Detection of roads and linear structures in low-resolution aerial imagery using a multisource knowledge integration technique☆ , 1981 .

[20]  Uwe Weidner,et al.  An Approach to Building Extraction from Digital Surface Models , 1996 .

[21]  Mehmet Celenk,et al.  A color clustering technique for image segmentation , 1990, Comput. Vis. Graph. Image Process..

[22]  Pascal Fua,et al.  Automatic Extraction of Generic House Roofs from High Resolution Aerial Imagery , 1996, ECCV.

[23]  Dirk Stallmann,et al.  High precision photogrammetric data set for building reconstruction and terrain modelling , 1994 .

[24]  Emmanuel P. Baltsavias,et al.  Multiphoto geometrically constrained matching , 1991 .

[25]  E. Baltsavias,et al.  3-D Building Reconstruction with ARUBA: A Qualitative and Quantitative Evaluation , 1997 .

[26]  E. Baltsavias,et al.  Automatic Extraction of Man-Made Objects from Aerial and Space Images (II) , 1995 .

[27]  Donald Michie,et al.  Machine intelligence 11 , 1988 .

[28]  Fiona Lang,et al.  3D-city modeling with a digital one-eye stereo system , 1996 .

[29]  G. Giraudon,et al.  High-resolution Stereo for the Detection of Buildings , 1995 .

[30]  Tuan Dang,et al.  Applying perceptual grouping and surface models to the detection and stereo reconstruction of buildings in aerial imagery , 1994, Other Conferences.

[31]  Kim L. Boyer,et al.  Perceptual organization in computer vision: a review and a proposal for a classificatory structure , 1993, IEEE Trans. Syst. Man Cybern..