Semantic evaluation of 3D city models

The automatic generation of 3D urban models from geospa-tial data is now a standard procedure. However, practitioners still have to visually assess, at city-scale, the correctness of these models and detect inevitable reconstruction errors. Such a process relies on experts, and is highly time-consuming (2 h/km 2 /expert). In this work, we propose an approach for automatically evaluating the quality of 3D building models. Potential errors are compiled in a hierarchical, versatile and parameter-izable taxonomy. This allows for the first time to disentangle fidelity and modeling errors, whatever the level of details of the modeled buildings. The quality of models is predicted using the geometric properties of buildings and, when available, image and depth data. A baseline of handcrafted, yet generic features, is fed to a Random Forest classifier. Both multi-class and multi-label cases are considered. Due to the interdependence between classes of errors, we have the ability to retrieve all errors at the same time while predicting erroneous buildings. We tested our framework on an urban area with more than 1,000 building models. We can satisfactorily detect, on average 96% of the most frequent errors.

[1]  Ulrich Neumann,et al.  2.5D building modeling by discovering global regularities , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Armin Gruen,et al.  Quality assessment of 3D building data , 2010 .

[3]  Juha Hyyppä,et al.  ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences , 2016 .

[4]  Peter Wonka,et al.  PolyFit: Polygonal Surface Reconstruction from Point Clouds , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Fabio Remondino,et al.  From DSM to 3D building models : a quantitative evaluation , 2013 .

[6]  Josiane Zerubia,et al.  Building Outline Extraction from Digital Elevation Models Using Marked Point Processes , 2007, International Journal of Computer Vision.

[7]  Marc Pierrot Deseilligny,et al.  3D Building Reconstruction with Parametric Roof Superstructures , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Filip Biljecki,et al.  An improved LOD specification for 3D building models , 2016, Comput. Environ. Urban Syst..

[9]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[10]  Vivek Verma,et al.  3D Building Detection and Modeling from Aerial LIDAR Data , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Marc Pollefeys,et al.  Geometric Change Detection in Urban Environments Using Images , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  George Vosselman,et al.  Accuracy of 3D city models: EuroSDR comparison , 2005 .

[13]  Horst Bischof,et al.  Fusion of Feature- and Area-Based Information for Urban Buildings Modeling from Aerial Imagery , 2008, ECCV.

[14]  Charalambos Poullis,et al.  A Framework for Automatic Modeling from Point Cloud Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  T. H. Kolbe,et al.  CityGML: Interoperable Access to 3D City Models , 2005 .

[16]  Hugo Ledoux,et al.  val3dity: validation of 3D GIS primitives according to the international standards , 2018, Open Geospatial Data, Software and Standards.

[17]  Florent Lafarge,et al.  Creating Large-Scale City Models from 3D-Point Clouds: A Robust Approach with Hybrid Representation , 2012, International Journal of Computer Vision.

[18]  Jaewook Jung,et al.  Results of the ISPRS benchmark on urban object detection and 3D building reconstruction , 2014 .

[19]  Sander Oude Elberink QUALITY MEASURES FOR BUILDING RECONSTRUCTION FROM AIRBORNE LASER SCANNER DATA , 2010 .

[20]  Franck Taillandier,et al.  AUTOMATIC BUILDING RECONSTRUCTION FROM A DIGITAL ELEVATION MODEL AND CADASTRAL DATA : AN OPERATIONAL APPROACH , 2010 .

[21]  Li Fei-Fei,et al.  Crowdsourcing in Computer Vision , 2016, Found. Trends Comput. Graph. Vis..

[22]  Daniel G. Aliaga,et al.  A Survey of Urban Reconstruction , 2013, Comput. Graph. Forum.

[23]  Gabriel Taubin,et al.  A benchmark for surface reconstruction , 2013, TOGS.

[24]  Filip Biljecki,et al.  Applications of 3D City Models: State of the Art Review , 2015, ISPRS Int. J. Geo Inf..

[25]  Ting Zhao,et al.  A Multicriteria Evaluation Method for 3-D Building Reconstruction , 2014, IEEE Geoscience and Remote Sensing Letters.

[26]  M. Pierrot-Deseilligny,et al.  A SUPERVISED CLASSIFICATION APPROACH TOWARDS QUALITY SELF-DIAGNOSIS OF 3 D BUILDING MODELS USING DIGITAL AERIAL IMAGERY , 2010 .

[27]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  Tsuhan Chen,et al.  Active learning for piecewise planar 3D reconstruction , 2011, CVPR 2011.

[30]  William Nguatem,et al.  Modeling Urban Scenes from Pointclouds , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[31]  Peter Wonka,et al.  Manhattan-World Urban Reconstruction from Point Clouds , 2016, ECCV.

[32]  Pascal Neis,et al.  Towards Automatic Vandalism Detection in OpenStreetMap , 2012, ISPRS Int. J. Geo Inf..

[33]  Allen R. Hanson,et al.  Recognition and reconstruction of buildings from multiple aerial images , 2003, Comput. Vis. Image Underst..

[34]  Florent Lafarge,et al.  LOD Generation for Urban Scenes , 2015, ACM Trans. Graph..

[35]  Florence Tupin,et al.  Quality evaluation of 3D city building Models with automatic error diagnosis , 2013 .

[36]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[37]  E. Steinle,et al.  ON THE QUALITY OF OBJECT CLASSIFICATION AND AUTOMATED BUILDING MODELLING BASED ON LASERSCANNING DATA , 2003 .