Describing Paris: Automated 3D Scene Analysis via Distinctive Low-Level Geometric Features

The automated analysis of 3D point clouds has become a topic of great importance in photogrammetry, remote sensing, computer vision and robotics. One avenue of research directly addresses the analysis of urban environments, where recent investigations focus on 3D reconstruction [18, 33, 13], consolidation of imperfect scan data [32, 5], object detection [24, 28, 4], extraction of roads and curbstones or road markings [2, 34, 9], urban accessibility analysis [25], recognition of powerline objects [12], extraction of building structures [27], vegetation mapping [31], large-scale city modeling [14], semantic perception for ground robotics [10] and semantization of complex 3D scenes [1]. A common task for many of these different applications consists of point cloud classification [11, 19], where each 3D point is assigned a specific class label. Addressing the issue of urban point cloud classification – where the spatial 3D data may be collected via airborne, terrestrial and/or mobile laser scanning – we face a variety of challenges arising from the complexity of respective 3D scenes caused by an irregular sampling and very different types of objects. Since the results of urban 3D scene analysis may vary from one dataset to another, publicly available standard datasets are desirable in order to compare the performance of different methodologies. Consequently, there has been a steadily increasing avail-

[1]  Ulrich Neumann,et al.  Complete residential urban area reconstruction from dense aerial LiDAR point clouds , 2013, Graph. Model..

[2]  Boris Jutzi,et al.  Feature relevance assessment for the semantic interpretation of 3D point cloud data , 2013 .

[3]  Andrés Serna,et al.  Urban accessibility diagnosis from mobile laser scanning data , 2013 .

[4]  Niloy J. Mitra,et al.  Coupled structure-from-motion and 3D symmetry detection for urban facades , 2014, ACM Trans. Graph..

[5]  Daniel G. Aliaga,et al.  Automatic Extraction of Manhattan-World Building Masses from 3D Laser Range Scans , 2012, IEEE Transactions on Visualization and Computer Graphics.

[6]  George Vosselman,et al.  Mapping curbstones in airborne and mobile laser scanning data , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[7]  Niloy J. Mitra,et al.  Non-local scan consolidation for 3D urban scenes , 2010, SIGGRAPH 2010.

[8]  V. Wichmann,et al.  Eigenvalue and graph-based object extraction from mobile laser scanning point clouds , 2013 .

[9]  Cheng Wang,et al.  Using mobile laser scanning data for automated extraction of road markings , 2014 .

[10]  Boris Jutzi,et al.  Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features , 2014 .

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Niloy J. Mitra,et al.  Estimating surface normals in noisy point cloud data , 2003, SCG '03.

[13]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[14]  K. Daniilidis,et al.  Semantic perception for ground robotics , 2012, Defense, Security, and Sensing.

[15]  Alexandre Boulch,et al.  Semantizing Complex 3D Scenes using Constrained Attribute Grammars , 2013, SGP '13.

[16]  Markus H. Gross,et al.  Multi‐scale Feature Extraction on Point‐Sampled Surfaces , 2003, Comput. Graph. Forum.

[17]  Martial Hebert,et al.  Efficient 3-D scene analysis from streaming data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Martial Hebert,et al.  Scale selection for classification of point-sampled 3D surfaces , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[19]  Konrad Schindler,et al.  IMPLICIT SHAPE MODELS FOR OBJECT DETECTION IN 3D POINT CLOUDS , 2012, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[20]  Wolfram Burgard,et al.  Identifying vegetation from laser data in structured outdoor environments , 2014, Robotics Auton. Syst..

[21]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[22]  Aleksey Boyko,et al.  Extracting roads from dense point clouds in large scale urban environment , 2011 .

[23]  François Goulette,et al.  Paris-rue-Madame Database - A 3D Mobile Laser Scanner Dataset for Benchmarking Urban Detection, Segmentation and Classification Methods , 2014, ICPRAM.

[24]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[25]  J. Demantké,et al.  DIMENSIONALITY BASED SCALE SELECTION IN 3D LIDAR POINT CLOUDS , 2012 .

[26]  N. David,et al.  Stereopolis II: A multi-purpose and multi-sensor 3D mobile mapping system for street visualisation and 3D metrology , 2014 .

[27]  George Vosselman,et al.  Recognizing basic structures from mobile laser scanning data for road inventory studies , 2011 .

[28]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, CVPR.

[29]  G. Sohn,et al.  Random Forests Based Multiple Classifier System for Power-Line Scene Classification , 2012 .

[30]  Florent Lafarge,et al.  Surface Reconstruction through Point Set Structuring , 2013, Comput. Graph. Forum.

[31]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.