Detecting and parsing architecture at city scale from range data

We present a method for detecting and parsing buildings from unorganized 3D point clouds into a compact, hierarchical representation that is useful for high-level tasks. The input is a set of range measurements that cover large-scale urban environment. The desired output is a set of parse trees, such that each tree represents a semantic decomposition of a building – the nodes are roof surfaces as well as volumetric parts inferred from the observable surfaces. We model the above problem using a simple and generic grammar and use an efficient dependency parsing algorithm to generate the desired semantic description. We show how to learn the parameters of this simple grammar in order to produce correct parses of complex structures. We are able to apply our model on large point clouds and parse an entire city.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  J. McDermott,et al.  Rule-Based Interpretation of Aerial Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[4]  Allen R. Hanson,et al.  The Ascender System: Automated Site Modeling from Multiple Aerial Images , 1998, Comput. Vis. Image Underst..

[5]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[6]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Monocular Building Extraction From Aerial Imagery , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  George Vosselman,et al.  Two algorithms for extracting building models from raw laser altimetry data , 1999 .

[8]  Harpreet S. Sawhney,et al.  Learning-based building outline detection from multiple aerial images , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[10]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[11]  Robert B. Fisher,et al.  Quality Enhancement of Reconstructed 3D Models Using Coplanarity and Constraints , 2002, DAGM-Symposium.

[12]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[13]  Aron Culotta,et al.  Dependency Tree Kernels for Relation Extraction , 2004, ACL.

[14]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[15]  Feng Han,et al.  Bottom-up/top-down image parsing by attribute graph grammar , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Koby Crammer,et al.  Online Large-Margin Training of Dependency Parsers , 2005, ACL.

[17]  Vivek Verma,et al.  3D Building Detection and Modeling from Aerial LIDAR Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Claus Brenner,et al.  Reconstruction of Façade Structures Using a Formal Grammar and RjMCMC , 2006, DAGM-Symposium.

[19]  N. Haala,et al.  CELL DECOMPOSITION FOR THE GENERATION OF BUILDING MODELS AT MULTIPLE SCALES , 2006 .

[20]  Jitendra Malik,et al.  Parsing Images of Architectural Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Marc Pierrot Deseilligny,et al.  3D Building Reconstruction with Parametric Roof Superstructures , 2007, 2007 IEEE International Conference on Image Processing.

[22]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[23]  Supun Samarasekera,et al.  Building segmentation for densely built urban regions using aerial LIDAR data , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Georgios Tziritas,et al.  Single view reconstruction using shape grammars for urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[25]  Suya You,et al.  Automatic reconstruction of cities from remote sensor data , 2009, CVPR.

[26]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.