Comprehensive Automated 3D Urban Environment Modelling Using Terrestrial Laser Scanning Point Cloud

In this paper we present a novel street scene modelling framework, which takes advantage of 3D point cloud captured by a high definition LiDAR laser scanner. We propose an automatic and robust approach to detect, segment and classify urban objects from point clouds hence reconstructing a comprehensive 3D urban environment model. Our system first automatically segments grounds point cloud. Then building facades will be detected by using binary range image processing. Remained point cloud will be grouped into voxels and subsequently transformed into super voxels. Local 3D features are extracted from super voxels and classified by trained boosted decision trees with semantic classes e.g. tree, pedestrian, and car. Given labeled point cloud the proposed algorithm reconstructs the realistic model in two phases. Firstly building facades will be rendered by ShadVis algorithm. In the second step we apply a novel and fast method for fitting the solid predefined template mesh models to non-building labeled point cloud. The proposed method is evaluated both quantitatively and qualitatively on a challenging TLS NAVTEQ True databases.

[1]  Ioannis Stamos,et al.  3D Modeling Using Planar Segments and Mesh Elements , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[2]  Bastian Leibe,et al.  Joint 2D-3D temporally consistent semantic segmentation of street scenes , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  James J. Little,et al.  A Hybrid Conditional Random Field for Estimating the Underlying Ground Surface From Airborne LiDAR Data , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[4]  J. Li-Chee-Ming,et al.  Generation of three dimensional photo-realistic models from Lidar and image data , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[5]  Jianxiong Xiao,et al.  Multiple view semantic segmentation for street view images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Claus Brenner,et al.  Registration of terrestrial laser scanning data using planar patches and image data , 2006 .

[7]  Martin Buss,et al.  Comparison of surface normal estimation methods for range sensing applications , 2009, 2009 IEEE International Conference on Robotics and Automation.

[8]  Antonio Torralba,et al.  Nonparametric scene parsing: Label transfer via dense scene alignment , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Stefano Soatto,et al.  A semi-direct approach to structure from motion , 2003, The Visual Computer.

[10]  Tania Landes,et al.  AUTOMATIC SEGMENTATION OF BUILDING FACADES USING TERRESTRIAL LASER DATA , 2007 .

[11]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Nelson L. Max,et al.  Horizon mapping: shadows for bump-mapped surfaces , 1988, The Visual Computer.

[13]  T. Pavlidis.  Algorithms for Graphics and Image Processing , 1981, Springer Berlin Heidelberg.

[14]  Gabriela Csurka,et al.  A Simple High Performance Approach to Semantic Segmentation , 2008, BMVC.

[15]  N. Haala,et al.  COMBINED FEATURE EXTRACTION FOR FAÇADE RECONSTRUCTION , 2007 .

[16]  Sidan Du,et al.  Super-Segments Based Classification of 3D Urban Street Scenes , 2012 .

[17]  Yoram Singer,et al.  Logistic Regression, AdaBoost and Bregman Distances , 2000, Machine Learning.

[18]  Beatriz Marcotegui,et al.  Point cloud segmentation towards urban ground modeling , 2009, 2009 Joint Urban Remote Sensing Event.

[19]  Lixin Fan,et al.  Object Recognition in 3D Point Cloud of Urban Street Scene , 2014, ACCV Workshops.

[20]  George Drettakis,et al.  A Point-Based Approach for Capture, Display and Illustration of Very Complex Archeological Artefacts , 2004, VAST.

[21]  George Vosselman,et al.  3D BUILDING MODEL RECONSTRUCTION FROM POINT CLOUDS AND GROUND PLANS , 2001 .

[22]  George Drettakis,et al.  Flexible point-based rendering on mobile devices , 2004, IEEE Computer Graphics and Applications.

[23]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[24]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[25]  Stefano Soatto,et al.  A semi-direct approach to structure from motion , 2001, Proceedings 11th International Conference on Image Analysis and Processing.