Coupling human activity recognition and wearable sensors for data-driven construction simulation

Construction discrete event simulation (DES) models consist of a complex system of interrelated activities. An essential step in DES design is the process of input modeling which entails the estimation of the attributes (e.g. duration, precedence logic) of simulated activities. The quality of the simulation output is directly proportional to the quality of the input modeling. Traditional simulation models are commonly built upon engineering assumptions and subject matter expert opinions of simulation parameters. In this paper, a machine learning-based framework is designed and implemented to extract durations of activities performed by construction workers from wearable sensors. This framework uses accelerometer and gyroscope sensors embedded in smartphones that are worn by field workers. Data analysis and processing is applied to the collected data to train machine learning algorithms capable of detecting and classifying construction workers’ activities. Once the activities are identified, their durations are calculated using the time stamps of the collected data. Results indicate that smartphones can be used as cost-effective, ubiquitous, and computationally powerful means of enabling data-driven DES models with enhanced reliability over traditional simulation models.

[1]  Amir H. Behzadan,et al.  Construction equipment activity recognition for simulation input modeling using mobile sensors and machine learning classifiers , 2015, Adv. Eng. Informatics.

[2]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[3]  Michael L. Littman,et al.  Activity Recognition from Accelerometer Data , 2005, AAAI.

[4]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[5]  Burcu Akinci,et al.  Modeling and analyzing the impact of technology on data capture and transfer processes at construction sites: A case study , 2006 .

[6]  Photios G. Ioannou,et al.  General purpose simulation with Stroboscope , 1994, Proceedings of Winter Simulation Conference.

[7]  Juan-Luis Gorricho,et al.  Activity Recognition from Accelerometer Data on a Mobile Phone , 2009, IWANN.

[8]  Amir H. Behzadan,et al.  Smartphone-based construction workers' activity recognition and classification , 2016 .

[9]  Julio C. Martinez,et al.  Stroboscope: State and resource based simulation of construction processes. , 1996 .

[10]  C. Yu,et al.  Threats to validity of Research Design , 2017 .

[11]  Daniel W. Halpin,et al.  CYCLONE — Method for Modeling Job Site Processes , 1977 .

[12]  Burcu Akinci,et al.  Data Fusion Approaches and Applications for Construction Engineering , 2011 .

[13]  Lingguang Song,et al.  Adaptive real-time tracking and simulation of heavy construction operations for look-ahead scheduling , 2012 .

[14]  Mehmet C. Vuran,et al.  Semi-supervised near-miss fall detection for ironworkers with a wearable inertial measurement unit , 2016 .

[15]  Amir H. Behzadan,et al.  Evaluation of queuing systems for knowledge-based simulation of construction processes , 2014 .

[16]  Steven J. Simske,et al.  Performance analysis of pattern classifier combination by plurality voting , 2003, Pattern Recognit. Lett..

[17]  Feniosky Peña-Mora,et al.  Application of Low-Cost Accelerometers for Measuring the Operational Efficiency of a Construction Equipment Fleet , 2015, J. Comput. Civ. Eng..

[18]  Luís A. Castro,et al.  Activity Recognition for Context-aware Hospital Applications: Issues and Opportunities for the Deployment of Pervasive Networks , 2007, Mob. Networks Appl..

[19]  SangHyun Lee,et al.  Automated cycle time measurement and analysis of excavator's loading operation using smart phone-embedded IMU sensors , 2015 .

[20]  Ioannis Brilakis,et al.  Testing in harsh conditions: Tracking resources on construction sites with machine vision , 2011 .

[21]  Koshy Varghese,et al.  Accelerometer-Based Activity Recognition in Construction , 2011, J. Comput. Civ. Eng..

[22]  Daniel W. Halpin,et al.  Planning and analysis of construction operations , 1992 .

[23]  Anu Pradhan,et al.  Sensing and Field Data Capture for Construction and Facility Operations , 2011 .

[24]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[25]  Jie Gong,et al.  Computer Vision-Based Video Interpretation Model for Automated Productivity Analysis of Construction Operations , 2010 .

[26]  Yong K. Cho,et al.  Visualization, Information Modeling, and Simulation: Grand Challenges in the Construction Industry , 2016, J. Comput. Civ. Eng..

[27]  Amir H. Behzadan,et al.  Knowledge-Based Simulation Modeling of Construction Fleet Operations Using Multimodal-Process Data Mining , 2013 .