Evaluation of image-based modeling and laser scanning accuracy for emerging automated performance monitoring techniques

Abstract Accurate and rapid assessment of the as-built status on any construction site provides the opportunity to understand the current performance of a project easily and quickly. Rapid project assessment further identifies discrepancies between the as-built and as-planned progress, and facilitates decision making on the necessary remedial actions. Currently, manual visual observations and surveying are the most dominant data capturing techniques but they are time-consuming, error-prone, and infrequent, making quick and reliable decision-making difficult. Therefore, research on new approaches that allow automatic recognition of as-built performance and visualization of construction progress is essential. This paper presents and compares two methods for obtaining point cloud models for detection and visualization of as-built status for construction projects: (1) A new method of automated image-based reconstruction and modeling of the as-built project status using unordered daily construction photo collections through analysis of Structure from Motion (SfM); (2) 3D laser scanning and analysis of the as-built dense point cloud models. These approaches provide robust means for recognition of progress, productivity, and quality on a construction site. In this paper, an overview of the newly developed automated image-based reconstruction approach and exclusive features which distinct it from other image-based or conventional photogrammetric techniques is presented. Subsequently the terrestrial laser scanning approach carried out for reconstruction and comparison of as-built scenes is presented. Finally the accuracy and usability of both of these techniques for metric reconstruction, automated production of point cloud models, 3D CAD shape modeling, and as-built visualizations is evaluated and compared on eight different case studies. It is shown that for precise defect detection or alignment tasks, image-based point cloud models may not be as accurate and dense as laser scanners' point cloud models. Nonetheless image-based point cloud models provide an opportunity to extract as-built semantic information (i.e., progress, productivity, quality and safety) through the content of the images, are easy to use, and do not need add burden on the project management teams by requiring expertise for data collection or analysis. Finally image-based reconstruction automatically provides photo alignment with point cloud models and enables image-based renderings which can remarkably impact automated performance monitoring and as-built visualizations.

[1]  David Nister,et al.  Bundle Adjustment Rules , 2006 .

[2]  Manolis I. A. Lourakis,et al.  The design and implementation of a generic sparse bundle adjustment software package based on the Le , 2004 .

[3]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[4]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Stephen Mak,et al.  Using a real-time integrated communication system to monitor the progress and quality of construction works , 2008 .

[6]  Dima Damen,et al.  British Machine Vision Conference (BMVC) , 2007 .

[7]  Burcu Akinci,et al.  Automated Recognition of 3D CAD Objects in Site Laser Scans for Project 3D Status Visualization and Performance Control , 2009 .

[8]  David Nister,et al.  Alignment of continuous video onto 3D point clouds , 2004, CVPR 2004.

[9]  Steven M. Seitz,et al.  Finding paths through the world's photos , 2008, SIGGRAPH 2008.

[10]  Edward J. Jaselskis,et al.  Pilot Study on Laser Scanning Technology for Transportation Projects , 2003 .

[11]  Mani Golparvar-Fard,et al.  Sparse Reconstruction and Geo-Registration of Site Photographs for As-Built Construction Representation and Automatic Progress Data Collection , 2009 .

[12]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[13]  Ming Lu,et al.  Photo-based 3D modeling of construction resources for visualization of operations simulation: Case of modeling a precast façade , 2008, 2008 Winter Simulation Conference.

[14]  Silvio Savarese,et al.  3D generic object categorization, localization and pose estimation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[16]  Michael Goesele,et al.  Multi-View Stereo for Community Photo Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[17]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[18]  Osama Moselhi,et al.  Integrating 3D laser scanning and photogrammetry for progress measurement of construction work , 2008 .

[19]  S. V. Sreenivasan,et al.  A framework for rapid local area modeling for construction automation , 2002 .

[20]  Carlos H. Caldas,et al.  Framework for Real-Time Three-Dimensional Modeling of Infrastructure , 2005 .

[21]  Wolfgang Boehler,et al.  Investigating Laser Scanner Accuracy , 2005 .

[22]  Jeffrey S. Bohn,et al.  Construction Project Monitoring Using High-Resolution Automated Cameras , 2010 .

[23]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[24]  Frédéric Bosché,et al.  Automated retrieval of 3D CAD model objects in construction range images , 2008 .

[25]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[26]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[27]  Burcu Akinci,et al.  Technological assessment and process implications of field data capture technologies for construction and facility/infrastructure management , 2008, J. Inf. Technol. Constr..

[28]  Feniosky Peña-Mora,et al.  Application of Visualization Techniques for Construction Progress Monitoring , 2007 .

[29]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[31]  Matthew A. Brown,et al.  Unsupervised 3D object recognition and reconstruction in unordered datasets , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[32]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[33]  Burcu Akinci,et al.  Automated processing of construction specifications to support inspection and quality control , 2007 .

[34]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[35]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2006, BMVC.

[36]  Ioannis Brilakis,et al.  Comparison of Civil Infrastructure Optical-based Spatial Data Acquisition Techniques , 2007 .

[37]  J. G. Lahoz,et al.  LASER SCANNING OR IMAGE-BASED MODELING? A COMPARATIVE THROUGH THE MODELIZATION OF SAN NICOLAS CHURCH , 2005 .

[38]  Mani Golparvar-Fard,et al.  Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs , 2009 .