Towards a Cyber-Physical Gaming System for Training in the Construction and Engineering Industry

Introducing serious gaming systems (SGS) has the potential to enhance trainee experience and performance across the construction industry and its supply chain, such as mechanical engineering services. SGS as an ‘enabler’ in architectural engineering has received limited research in its role to assess and enhance the performance of its workforce. In a personnel high-risk environment, improving training standards to eliminate or reduce health and safety risks, in addition to providing an understanding of workers’ ergonomics, ensures sustainability of both the project and its workforce.This paper presents an activity tracking and feedback system that captures the physical activity of a construction worker climbing a ladder. Climbing is captured with a 3D motion capture system and processed in real-time to identify potential areas of underperformance. A simple and representative scoring method was established as a reporting method (game statistics) for giving feedback about the correctness of the activity. It can nonetheless be tuned to characterise and adjust to various complexity levels in-line with the required training standards. Furthermore, the motion data and feedback information are fed into a virtual gaming environment enabling the real-time visualisation of the trainee’s motion and experiential learning of the performance through visual and audio feedback. The gaming concepts are employed here with multiple purposes, particularly for accelerating and facilitating the learning process of the trainee. In addition to the 3D motion capturing system, this paper outlines and tests a proposed serious cyber-physical gaming system that incorporates wearable technologies that has the potential to support both construction training and practice.Copyright © 2014 by ASME

[1]  Tariq S. Abdelhamid,et al.  Identifying Root Causes of Construction Accidents , 2001 .

[2]  Mani Golparvar-Fard,et al.  Automated Vision-based Recognition of Construction Worker Actions for Building Interior Construction , 2012 .

[3]  SangHyun Lee,et al.  Computer Vision Techniques for Worker Motion Analysis to Reduce Musculoskeletal Disorders in Construction , 2011 .

[4]  Jie Gong,et al.  Learning and Classifying Motions of Construction Workers and Equipment Using Bag of Video Feature Words and Bayesian Learning Methods , 2011 .

[5]  Abdullatif Alwasel,et al.  Sensing Construction Work-Related Musculoskeletal Disorders (WMSDs) , 2011 .

[6]  Yong K. Cho,et al.  A framework for Virtual Interactive Construction Education (VICE) , 2011 .

[7]  Vian Ahmed,et al.  Use of a simulation game in delivering blended lifelong learning in the construction industry - Opportunities and Challenges , 2008, Comput. Educ..

[8]  Zhongke Shi,et al.  A performance evaluation of vision and radio frequency tracking methods for interacting workforce , 2011, Adv. Eng. Informatics.

[9]  Jochen Teizer,et al.  Real-time construction worker posture analysis for ergonomics training , 2012, Adv. Eng. Informatics.

[10]  Edward J. Jaselskis,et al.  Implementing Radio Frequency Identification in the Construction Process , 2003 .

[11]  S E P T E M B,et al.  U.S.BUREAU OF LABOR STATISTICS , 2004 .

[12]  Saad H.S. Al-Jibouri,et al.  Design and experience with a computer game for teaching construction project planning and control , 2001 .

[13]  Perry Forsythe,et al.  The Construction Game — Using Physical Model Making to Simulate Realism in Construction Education , 2009 .

[14]  Mark O'Rourke.  Using immersive 3D computer games to help engage learners and deliver skill sets , 2013 .

[15]  Aviad Shapira,et al.  Feasibility of automated monitoring of lifting equipment in support of project control , 2005 .

[16]  K. Squire.  From Content to Context: Videogames as Designed Experience , 2006 .

[17]  Tao Cheng,et al.  Location tracking and data visualization technology to advance construction ironworkers' education and training in safety and productivity , 2013 .

[18]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[19]  Frank C. Harris,et al.  Road Construction—Simulation Game for Site Managers , 1977 .

[20]  Abhinav Peddi.  Development of human pose analyzing algorithms for the determination of construction productivity in real-time , 2009 .

[21]  Patricio A. Vela,et al.  Personnel tracking on construction sites using video cameras , 2009, Adv. Eng. Informatics.

[22]  F P Rivara,et al.  Prevention of falls in the construction industry: evidence for program effectiveness. , 2000, American journal of preventive medicine.

[23]  Tao Cheng,et al.  Data Fusion of Real-Time Location Sensing and Physiological Status Monitoring for Ergonomics Analysis of Construction Workers , 2013, J. Comput. Civ. Eng..

[24]  Gary A. Mirka,et al.  Accuracy of a three-dimensional lumbar motion monitor for recording dynamic trunk motion characteristics , 1992 .