Automated activity and progress analysis based on non-monotonic reasoning of construction operations

PurposeReal-time location sensing (RTLS) systems offer a significant potential to advance the management of construction processes by potentially providing real-time access to the locations of workers and equipment. Many location-sensing technologies tend to perform poorly for indoor work environments and generate large data sets that are somewhat difficult to process in a meaningful way. Unfortunately, little is still known regarding the practical benefits of converting raw worker tracking data into meaningful information about construction project progress, effectively impeding widespread adoption in construction.Design/methodology/approachThe presented framework is designed to automate as many steps as possible, aiming to avoid manual procedures that significantly increase the time between progress estimation updates. The authors apply simple location tracking sensor data that does not require personal handling, to ensure continuous data acquisition. They use a generic and non-site-specific knowledge base (KB) created through domain expert interviews. The sensor data and KB are analyzed in an abductive reasoning framework implemented in Answer Set Programming (extended to support spatial and temporal reasoning), a logic programming paradigm developed within the artificial intelligence domain.FindingsThis work demonstrates how abductive reasoning can be applied to automatically generate rich and qualitative information about activities that have been carried out on a construction site. These activities are subsequently used for reasoning about the progress of the construction project. Our framework delivers an upper bound on project progress (“optimistic estimates”) within a practical amount of time, in the order of seconds. The target user group is construction management by providing project planning decision support.Research limitations/implicationsThe KB developed for this early-stage research does not encapsulate an exhaustive body of domain expert knowledge. Instead, it consists of excerpts of activities in the analyzed construction site. The KB is developed to be non-site-specific, but it is not validated as the performed experiments were carried out on one single construction site.Practical implicationsThe presented work enables automated processing of simple location tracking sensor data, which provides construction management with detailed insight into construction site progress without performing labor-intensive procedures common nowadays.Originality/valueWhile automated progress estimation and activity recognition in construction have been studied for some time, the authors approach it differently. Instead of expensive equipment, manually acquired, information-rich sensor data, the authors apply simple data, domain knowledge and a logical reasoning system for which the results are promising.

[1]  Mario Alviano,et al.  The ASP System DLV: Advancements and Applications , 2018, KI - Künstliche Intelligenz.

[2]  Victor W. Marek,et al.  Stable models and an alternative logic programming paradigm , 1998, The Logic Programming Paradigm.

[3]  Pedro Mêda,et al.  Worker 4.0: The Future of Sensored Construction Sites , 2020, Buildings.

[4]  Ryszard S. Michalski,et al.  Inferential theory of learning as a conceptual basis for multistrategy learning , 1993, Machine Learning.

[5]  James P. Womack,et al.  Lean Thinking: Banish Waste and Create Wealth in Your Corporation , 1996 .

[6]  Burcu Akinci,et al.  Data Fusion Approaches and Applications for Construction Engineering , 2011 .

[7]  Lamine Mahdjoubi,et al.  Towards an automated photogrammetry-based approach for monitoring and controlling construction site activities , 2018, Comput. Ind..

[8]  Mojtaba Noghabaei,et al.  An integrated UGV-UAV system for construction site data collection , 2020 .

[9]  Manolis I. A. Lourakis,et al.  Toward automated generation of parametric BIMs based on hybrid video and laser scanning data , 2010, Adv. Eng. Informatics.

[10]  Jochen Teizer,et al.  Real-time construction worker posture analysis for ergonomics training , 2012, Adv. Eng. Informatics.

[11]  Susanne Neubert,et al.  Model Consruction in MIKE (MOdel-Based and Incremental Knowledge Engineering) , 1993, EKAW.

[12]  Andrea Cantini.  PROOF-THEORETICAL ASPECTS OF SELF-REFERENTIAL TRUTH , 1997 .

[13]  Liu Yang,et al.  Semi-automated generation of parametric BIM for steel structures based on terrestrial laser scanning data , 2020 .

[14]  Paul M. Goodrum,et al.  Assessing the impact of materials tracking technologies on construction craft productivity , 2009 .

[15]  Rüdiger Dillmann,et al.  Towards Cognitive Robots: Building Hierarchical Task Representations of Manipulations from Human Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  Francesco Scarcello,et al.  Abductive logic programs with penalization: semantics, complexity and implementation , 2003, Theory and Practice of Logic Programming.

[17]  Uwe Stilla,et al.  Improving progress monitoring by fusing point clouds, semantic data and computer vision , 2020, Automation in Construction.

[18]  Carl T. Haas,et al.  Analysis of Relationships between Body Load and Training, Work Methods, and Work Rate: Overcoming the Novice Mason’s Risk Hump , 2020 .

[19]  Patricio A. Vela,et al.  Automated Construction Resource Location Tracking to Support the Analysis of Lean Principles , 2010 .

[20]  Anu Pradhan,et al.  A taxonomy of reasoning mechanisms and data synchronization framework for road excavation productivity monitoring , 2012, Adv. Eng. Informatics.

[21]  Jochen Teizer,et al.  An information fusion approach for filtering GNSS data sets collected during construction operations , 2014, Adv. Eng. Informatics.

[22]  L. A. Hermens,et al.  A machine-learning apprentice for the completion of repetitive forms , 1994, IEEE Expert.

[23]  Jack Chin Pang Cheng,et al.  A BIM Based Construction Site Layout Planning Framework Considering Actual Travel Paths , 2014 .

[24]  Tao Cheng,et al.  Data Fusion of Real-Time Location Sensing and Physiological Status Monitoring for Ergonomics Analysis of Construction Workers , 2013, J. Comput. Civ. Eng..

[25]  Huahui Lai,et al.  INTEROPERABILITY ANALYSIS OF IFC-BASED DATA EXCHANGE BETWEEN HETEROGENEOUS BIM SOFTWARE , 2018, JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT.

[26]  Stephen Emmitt,et al.  Beyond the third dimension of BIM: A systematic review of literature and assessment of professional views , 2018, Journal of Building Engineering.

[27]  Weijie Shen,et al.  Technical feasibility analysis on applying ultra-wide band technology in construction progress monitoring , 2020 .

[28]  Jochen Teizer,et al.  Mobile 3D Mapping for Surveying Earthwork Using an Unmanned Aerial Vehicle (UAV) , 2013 .

[29]  K. Harald Gjermundrød,et al.  privacyTracker: A Privacy-by-Design GDPR-Compliant Framework with Verifiable Data Traceability Controls , 2016, ICWE Workshops.

[30]  Xiaochun Luo,et al.  Towards efficient and objective work sampling: Recognizing workers' activities in site surveillance videos with two-stream convolutional networks , 2018, Automation in Construction.

[31]  Urs Ramer,et al.  An iterative procedure for the polygonal approximation of plane curves , 1972, Comput. Graph. Image Process..

[32]  Ioannis K. Brilakis,et al.  State-of-Practice on As-Is Modelling of Industrial Facilities , 2018, EG-ICE.

[33]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[34]  Antonis C. Kakas,et al.  Abduction in Logic Programming , 2002, Computational Logic: Logic Programming and Beyond.

[35]  Jochen Teizer,et al.  Heat map generation for predictive safety planning: preventing struck-by and near miss interactions between workers-on-foot and construction equipment , 2016 .

[36]  Markus König,et al.  Recognition of process patterns for BIM-based construction schedules , 2017, Adv. Eng. Informatics.

[37]  Ibrahim Yitmen,et al.  The Impact of Field Data Capturing Technologies on Automated Construction Project Progress Monitoring , 2016 .

[38]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[39]  Amin Hammad,et al.  Predicting movements of onsite workers and mobile equipment for enhancing construction site safety , 2016 .

[40]  Heng Wang,et al.  Feasibility Study of UAV use for RFID Material Tracking on Construction Sites , 2015 .

[41]  Martin Gebser,et al.  Theory Solving Made Easy with Clingo 5 , 2016, ICLP.

[42]  Hyoungkwan Kim,et al.  UAV-based automatic generation of high-resolution panorama at a construction site with a focus on preprocessing for image stitching , 2017 .

[43]  Ioannis Brilakis,et al.  Construction worker detection in video frames for initializing vision trackers , 2012 .

[44]  Remon F. Aziz,et al.  Applying lean thinking in construction and performance improvement , 2013 .

[45]  Frédéric Bosché,et al.  Musculoskeletal disorders in construction: A review and a novel system for activity tracking with body area network. , 2016, Applied ergonomics.

[46]  Patricio A. Vela,et al.  Performance evaluation of ultra wideband technology for construction resource location tracking in harsh environments , 2011 .

[47]  Esin Ergen,et al.  Tracking major resources for automated progress monitoring of construction activities: masonry work case , 2021 .

[48]  Michael Gelfond,et al.  Applications of Answer Set Programming , 2016, AI Mag..

[49]  Patricio A. Vela,et al.  Fusion of Photogrammetry and Video Analysis for Productivity Assessment of Earthwork Processes , 2017, Comput. Aided Civ. Infrastructure Eng..

[50]  Tao Cheng,et al.  Automating the Task-level Construction Activity Analysis through Fusion of Real Time Location Sensor , 2013 .

[51]  Moncef L. Nehdi,et al.  Data acquisition technologies for construction progress tracking , 2016 .

[52]  Jochen Teizer,et al.  Determining the Relationship between Direct Work and Construction Labor Productivity in North America: Four Decades of Insights , 2020 .

[53]  Zhongke Shi,et al.  Vision-Based Tower Crane Tracking for Understanding Construction Activity , 2014, J. Comput. Civ. Eng..

[54]  Mani Golparvar-Fard,et al.  Automated 2D detection of construction equipment and workers from site video streams using histograms of oriented gradients and colors , 2013 .

[55]  Martin Gebser,et al.  clasp : A Conflict-Driven Answer Set Solver , 2007, LPNMR.

[56]  Silvio Savarese,et al.  Application of D4AR - A 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication , 2009, J. Inf. Technol. Constr..

[57]  Frédéric Bosché,et al.  The value of integrating Scan-to-BIM and Scan-vs-BIM techniques for construction monitoring using laser scanning and BIM: The case of cylindrical MEP components , 2015 .

[58]  Bob J. Wielinga,et al.  CommonKADS: a comprehensive methodology for KBS development , 1994, IEEE Expert.

[59]  Jochen Teizer,et al.  Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites , 2015, Adv. Eng. Informatics.