SLAM-driven robotic mapping and registration of 3D point clouds

Abstract With the rapid advancement of laser scanning and photogrammetry technologies, frequent geometric data collection at construction sites by contractors has been increased for the purpose of improving constructability, productivity, and onsite safety. However, the conventional static laser scanning method suffers from operational limitations due to the presence of many occlusions commonly found in a typical construction site. Obtaining a complete scan of a construction site without information loss requires that laser scans are obtained from multiple scanning locations around the site, which also necessitates extra work for registering each scanned point cloud. As an alternate solution to this problem, this paper introduces an autonomous mobile robot which navigates a scan site based on a continuously updated point cloud map. This mobile robot system utilizes the 2D Hector Simultaneous Localization and Mapping (SLAM) technique to estimate real-time positions and orientations of the robot in the x-y plane. Then, the 2D localization information is used to create 3D point clouds of unknown environments in real time to determine its navigation paths as a pre-scanning process. The advantage of this framework is the ability to determine the optimal scan position and scan angle to reduce the scanning time and effort for gathering high resolution point cloud data in real-time. The mobile robot system is able to capture survey-quality RGB-mapped point cloud data, and automatically register the scans for geometric reconstruction of the site. The performance of the overall system was tested in an indoor environment and validated with promising results.

[1]  Changyoon Kim,et al.  4D CAD model updating using image processing-based construction progress monitoring , 2013 .

[2]  Jingdao Chen,et al.  A framework for real-time pro-active safety assistance for mobile crane lifting operations , 2016 .

[3]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[4]  Jianzhong Zhang,et al.  Using Scanning Lasers for Real-Time Pavement Thickness Measurement , 2005 .

[5]  Yong K. Cho,et al.  Light-weight 3D LADAR System for Construction Robotic Operations , 2009 .

[6]  Michael Bosse,et al.  Continuous 3D scan-matching with a spinning 2D laser , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  Frédéric Bosché,et al.  Automated retrieval of 3D CAD model objects in construction range images , 2008 .

[8]  Danijel Rebolj,et al.  Automated construction activity monitoring system , 2008, Adv. Eng. Informatics.

[9]  Ioannis Brilakis,et al.  Machine Vision-Based Infrastructure As-Built Documentation Using Edge Points , 2012 .

[10]  Jules White,et al.  Fast and scalable 3D cyber-physical modeling for high-precision mobile augmented reality systems , 2015, Personal and Ubiquitous Computing.

[11]  Lucio Soibelman,et al.  Shape-Based Retrieval of Construction Site Photographs , 2008 .

[12]  Edward J. Jaselskis,et al.  Pilot Study on Laser Scanning Technology for Transportation Projects , 2003 .

[13]  Yong K. Cho,et al.  Real-time 3D Mobile Mapping for the Built Environment , 2016 .

[14]  Antonio Adán,et al.  3D Reconstruction of Interior Wall Surfaces under Occlusion and Clutter , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[15]  Changwan Kim,et al.  Rapid, on-site spatial information acquisition and its use for infrastructure operation and maintenance , 2005 .

[16]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[17]  T. Pock,et al.  Point Clouds: Lidar versus 3D Vision , 2010 .

[18]  Chao Wang,et al.  Smart scanning and near real-time 3D surface modeling of dynamic construction equipment from a point cloud , 2015 .

[19]  Pileun Kim,et al.  Target-Free Automatic Registration of Point Clouds , 2016 .

[20]  Edward J. Jaselskis,et al.  Improving transportation projects using laser scanning , 2005 .

[21]  R. Navon,et al.  Research in automated measurement of project performance indicators , 2007 .

[22]  Osama Moselhi,et al.  Integrating 3D laser scanning and photogrammetry for progress measurement of construction work , 2008 .

[23]  Y. Charlie Hu,et al.  Multi-robot SLAM with topological/metric maps , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  S. V. Sreenivasan,et al.  A framework for rapid local area modeling for construction automation , 2002 .

[25]  Piyush Kumar,et al.  Fast construction of k-nearest neighbor graphs for point clouds , 2010, IEEE Transactions on Visualization and Computer Graphics.

[26]  Geraldine S. Cheok,et al.  Ladars for construction assessment and update , 2000 .

[27]  Mani Golparvar-Fard,et al.  Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques , 2011 .

[28]  Andrey Dimitrov,et al.  Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections , 2014, Adv. Eng. Informatics.

[29]  Frédéric Bosché,et al.  Automating surface flatness control using terrestrial laser scanning and building information models , 2014 .

[30]  Guzide Atasoy,et al.  A comparative study on the use of laser scanners for construction quality control and progress monitoring purposes , 2009 .

[31]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[32]  Burcu Akinci,et al.  Assessment of the quality of as-is building information models generated from point clouds using deviation analysis , 2011, Electronic Imaging.

[33]  Jingdao Chen,et al.  Principal Axes Descriptor for Automated Construction-Equipment Classification from Point Clouds , 2017, J. Comput. Civ. Eng..

[34]  Soon-Wook Kwon,et al.  Fitting range data to primitives for rapid local 3D modeling using sparse range point clouds , 2004 .

[35]  Frédéric Bosché,et al.  Towards Automated Retrieval of 3D Designed Data in 3D Sensed Data , 2007 .

[36]  Pileun Kim,et al.  Automated Point Cloud Registration Using Visual and Planar Features for Construction Environments , 2018, J. Comput. Civ. Eng..

[37]  Chao Wang,et al.  Automatic BIM component extraction from point clouds of existing buildings for sustainability applications , 2015 .

[38]  Chao Wang,et al.  Target-Focused Local Workspace Modeling for Construction Automation Applications , 2012 .

[39]  Yong K. Cho,et al.  Projection-Recognition-Projection Method for Automatic Object Recognition and Registration for Dynamic Heavy Equipment Operations , 2014 .

[40]  Burcu Akinci,et al.  Quantification of edge loss of laser scanned data at spatial discontinuities , 2009 .

[41]  Emilio Frazzoli,et al.  Synthetic 2D LIDAR for precise vehicle localization in 3D urban environment , 2013, 2013 IEEE International Conference on Robotics and Automation.

[42]  Fernanda Leite,et al.  Evaluation of accuracy of as-built 3D modeling from photos taken by handheld digital cameras , 2012 .

[43]  Pedro Arias,et al.  Low-cost aerial unit for outdoor inspection of building façades , 2013 .

[44]  Christoph Stiller,et al.  Velodyne SLAM , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[45]  Burcu Akinci,et al.  TECHNOLOGY AND PROCESS ASSESSMENT OF USING LADAR AND EMBEDDED SENSING FOR CONSTRUCTION QUALITY CONTROL , 2005 .

[46]  Burcu Akinci,et al.  A formalism for utilization of sensor systems and integrated project models for active construction quality control , 2006 .

[47]  Jeffrey S. Bohn,et al.  Construction Project Monitoring Using High-Resolution Automated Cameras , 2010 .

[48]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[50]  Feniosky Peña-Mora,et al.  Application of Visualization Techniques for Construction Progress Monitoring , 2007 .

[51]  José Ruíz Ascencio,et al.  Visual simultaneous localization and mapping: a survey , 2012, Artificial Intelligence Review.

[52]  Ji Zhang,et al.  LOAM: Lidar Odometry and Mapping in Real-time , 2014, Robotics: Science and Systems.

[53]  Y. K. Cho,et al.  Performance Test for Rapid Surface Modeling of DynamicConstruction Equipment from Laser Scanner Data , 2014 .