Analyzing context and productivity of tunnel earthmoving processes using imaging and simulation

Abstract This study presents an integrated method of construction-process simulation and vision-based context reasoning for productivity analysis of an earthmoving process in a tunnel. Convolutional networks are used to detect construction equipment in the tunnel CCTV video and the context of the earthmoving process is inferred by the context reasoning process. The construction equipment detection model exhibited enhanced performance, with a mean average precision of 99.09%, and the error rate of the estimated context information was only 1.6% of the actual earthmoving context measured by a human. The estimated context information was used as an input for the WebCYCLONE simulation to generate a productivity and cost analysis report. Sensitivity analysis regarding construction equipment provided a new equipment allocation plan that could reduce the cost of the current earthmoving process by 12.25%.

[1]  Zhi Chen,et al.  Visual Tracking of Construction Jobsite Workforce and Equipment with Particle Filtering , 2016, J. Comput. Civ. Eng..

[2]  Photios G. Ioannou,et al.  Comparison of Construction Alternatives Using Matched Simulation Experiments , 1996 .

[3]  Paul M. Goodrum,et al.  Validation Methodologies and Their Impact in Construction Productivity Research , 2014 .

[4]  Seokho Chi,et al.  Adaptive Detector and Tracker on Construction Sites Using Functional Integration and Online Learning , 2017 .

[5]  Tao-Ming Cheng,et al.  Simulation of NATM Tunneling Construction in Gravel Formation — Lessons Learned from Pakuashan Highway Tunnel Project in Taiwan , 2009 .

[6]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[7]  Simaan M. AbouRizk,et al.  Identification of Invariant Average Weighted Haul Distance to Simplify Earthmoving Simulation Modeling in Planning Site Grading Operations , 2014 .

[8]  Simaan M. AbouRizk,et al.  Role of Simulation in Construction Engineering and Management , 2010 .

[9]  Hyeran Byun,et al.  Detecting Construction Equipment Using a Region-Based Fully Convolutional Network and Transfer Learning , 2018, J. Comput. Civ. Eng..

[10]  Chang Liu,et al.  Optimizing Earthmoving Job Planning Based on Evaluation of Temporary Haul Road Networks Design for Mass Earthworks Projects , 2015 .

[11]  Jonathan Jingsheng Shi.  Three methods for verifying and validating the simulation of a construction operation , 2002 .

[12]  Simon J. D. Prince,et al.  Computer Vision: Models, Learning, and Inference , 2012 .

[13]  Man-Woo Park,et al.  Hardhat-Wearing Detection for Enhancing On-Site Safety of Construction Workers , 2015 .

[14]  ShahinA.,et al.  Simulation modeling of weather-sensitive tunnelling construction activities subject to cold weather , 2014 .

[15]  Michael Forde,et al.  Analysis of earth-moving systems using discrete-event simulation , 1995 .

[16]  Daniel W. Halpin,et al.  Planning and analysis of construction operations , 1992 .

[17]  Deva Ramanan,et al.  Efficiently Scaling up Crowdsourced Video Annotation , 2012, International Journal of Computer Vision.

[18]  Daniel W. Halpin,et al.  CYCLONE — Method for Modeling Job Site Processes , 1977 .

[19]  Mani Golparvar-Fard,et al.  Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors , 2013 .

[20]  Arindam Gan Chowdhury,et al.  Imaging-to-Simulation Framework for Improving Disaster Preparedness of Construction Projects and Neighboring Communities , 2017 .

[21]  Photios G. Ioannou,et al.  General-purpose systems for effective construction simulation , 1999 .

[22]  Kinam Kim,et al.  Vision-Based Object-Centric Safety Assessment Using Fuzzy Inference: Monitoring Struck-By Accidents with Moving Objects , 2016, J. Comput. Civ. Eng..

[23]  Brenda McCabe,et al.  Automated Visual Recognition of Dump Trucks in Construction Videos , 2012, J. Comput. Civ. Eng..

[24]  Seung-Woo Han.  Productivity Analysis Comparison of Different Types of Earthmoving Operations by Means of Various Productivity Measurements , 2010 .

[25]  Jie Gong,et al.  Computer Vision-Based Video Interpretation Model for Automated Productivity Analysis of Construction Operations , 2010 .

[26]  Ioannis Brilakis,et al.  Continuous localization of construction workers via integration of detection and tracking , 2016 .

[27]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[28]  AlshibaniAdel,et al.  Estimating productivity of earthmoving operations using spatial technologies11This paper is one of a selection of papers in this Special Issue on Construction Engineering and Management. , 2012 .

[29]  Patricio A. Vela,et al.  Fusion of Photogrammetry and Video Analysis for Productivity Assessment of Earthwork Processes , 2017, Comput. Aided Civ. Infrastructure Eng..

[30]  Juan Carlos Niebles,et al.  Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers , 2013, Adv. Eng. Informatics.

[31]  Simon Smith,et al.  Earthmoving productivity estimation using linear regression techniques , 1999 .

[32]  Ali Touran,et al.  SIMULATION OF TUNNELING OPERATIONS , 1987 .

[33]  Sven J. Dickinson,et al.  Server-Customer Interaction Tracker: Computer Vision-Based System to Estimate Dirt-Loading Cycles , 2013 .

[34]  John-Paris Pantouvakis,et al.  Computer simulation and analysis framework for floating caisson construction operations , 2013 .

[35]  Seung-Woo Han,et al.  Technical comparisons of simulation-based productivity prediction methodologies by means of estimation tools focusing on conventional earthmovings , 2011 .

[36]  Simaan M. AbouRizk,et al.  Research in Modeling and Simulation for Improving Construction Engineering Operations , 2011 .

[37]  Osama Moselhi,et al.  Estimating productivity of earthmoving operations using spatial technologies 1 , 2012 .

[38]  Makarand Hastak,et al.  Simulation study on construction process of FRP bridge deck panels , 2007 .

[39]  Osama Moselhi,et al.  Optimization of Earthmoving Operations in Heavy Civil Engineering Projects , 2009 .

[40]  Brenda McCabe,et al.  Part based model and spatial–temporal reasoning to recognize hydraulic excavators in construction images and videos , 2012 .

[41]  John Christian,et al.  Improving earthmoving estimating by more realistic knowledge , 1996 .