Can mixed reality enhance safety communication on construction sites? An industry perspective

Abstract Effective communication plays a vital role in hazard identification in construction workplaces. Unfortunately, current practices that rely on modes such as phone calls, walking to people and talk, and video conferencing do not facilitate instant access to information, context-based perception, and visual interaction that are essential for effective communication in modern construction workplaces. This research assessed the feasibility of applying mixed reality in enhancing safety risk communication on construction sites. A holographic application that enables to turn the field of view of mixed reality head mounted display into a collaborative environment where others can see and interact was prototyped. This was followed by an assessment of its feasibility through trials and feedback from potential users in the construction industry. The performance metrics for the assessment included accuracy, efficiency, ease-of-use, and acceptability of mixed reality benchmarked against the existing communication methods (i.e., phone calls, walking to people and talk, video conferencing, and emails). Analyses results showed the potential of mixed reality for visualization, communication, and remote collaboration of safety-related issues on construction sites. The research findings provided better understanding of feasibility, benefits, and limitations of applying the technology in workplaces, which may ameliorate its improvement and adoption in safety management practices in order to reduce the incidences of injuries and fatalities on construction sites.

[1]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[2]  Jill C. Bradley,et al.  Workplace safety: a meta-analysis of the roles of person and situation factors. , 2009, The Journal of applied psychology.

[3]  Simon Smith,et al.  Safety hazard identification on construction projects , 2006 .

[4]  Peng Lin,et al.  A labor consumption measurement system based on real-time tracking technology for dam construction site , 2015 .

[5]  Xiangyu Wang,et al.  Mixed Reality Technology Applications in Construction Equipment Operator Training , 2004 .

[6]  Amir H. Behzadan,et al.  Deep learning for site safety: Real-time detection of personal protective equipment , 2020 .

[7]  Michael Murray,et al.  Communication in Construction: Theory and Practice , 2006 .

[8]  Arto Kiviniemi,et al.  A review of risk management through BIM and BIM-related technologies , 2017 .

[9]  Yuichi Ohta,et al.  Mixed Reality: Merging Real and Virtual Worlds , 1999 .

[10]  I. Shohet,et al.  Integrated Communication, Control, and Command of Construction Safety and Quality , 2019, Journal of Construction Engineering and Management.

[11]  Tao Cheng,et al.  Location tracking and data visualization technology to advance construction ironworkers' education and training in safety and productivity , 2013 .

[12]  Xiaochun Luo,et al.  Detecting non-hardhat-use by a deep learning method from far-field surveillance videos , 2018 .

[13]  Salman Azhar,et al.  IMPLEMENTING VIRTUAL REALITY AND MIXED REALITY TECHNOLOGIES IN CONSTRUCTION EDUCATION: STUDENTS’ PERCEPTIONS AND LESSONS LEARNED , 2018, ICERI2018 Proceedings.

[14]  Mingyuan Zhang,et al.  A critical review of vision-based occupational health and safety monitoring of construction site workers , 2020, Safety Science.

[15]  M. Hoffman The future of three-dimensional thinking , 2016, Science.

[16]  Keith D. Hampson,et al.  Using BIM for smarter and safer scaffolding and formwork construction: a preliminary methodology , 2012 .

[17]  SangHyun Lee,et al.  Wearable Sensing Technology Applications in Construction Safety and Health , 2019, Journal of Construction Engineering and Management.

[18]  Tak Wing Yiu,et al.  Identifying behaviour patterns of construction safety using system archetypes. , 2015, Accident; analysis and prevention.

[19]  Heng Li,et al.  Using game technologies to improve the safety of construction plant operations. , 2012, Accident; analysis and prevention.

[20]  P. Ray,et al.  Occupational injury and accident research: A comprehensive review , 2012 .

[21]  Xiaochun Luo,et al.  Hierarchical Bayesian Model of Worker Response to Proximity Warnings of Construction Safety Hazards: Toward Constant Review of Safety Risk Control Measures , 2017 .

[22]  J. Francis,et al.  Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework , 2017, BMC Health Services Research.

[24]  Amin Hammad,et al.  Remote interactive collaboration in facilities management using BIM-based mixed reality , 2019, Automation in Construction.

[25]  Phillip S. Dunston,et al.  Tangible mixed reality for remote design review: a study understanding user perception and acceptance , 2013 .

[26]  Allan St John Holt,et al.  Principles of construction safety , 2001 .

[27]  Houtan Jebelli,et al.  EEG-based workers' stress recognition at construction sites , 2018, Automation in Construction.

[28]  Rafael Sacks,et al.  Hazard recognition and risk perception in construction , 2014 .

[29]  Zhiliang Ma,et al.  Construction automation and robotics for high-rise buildings over the past decades: A comprehensive review , 2019, Adv. Eng. Informatics.

[30]  Frédéric Bosché,et al.  Towards a Mixed Reality System for Construction Trade Training , 2016, J. Comput. Civ. Eng..

[31]  Tariq S. Abdelhamid,et al.  Identifying Root Causes of Construction Accidents , 2001 .

[32]  SangHyun Lee,et al.  Computer vision techniques for construction safety and health monitoring , 2015, Adv. Eng. Informatics.

[33]  Wei Wu,et al.  Design Assessment in Virtual and Mixed Reality Environments: Comparison of Novices and Experts , 2019, Journal of Construction Engineering and Management.

[34]  Sathyanarayanan Rajendran,et al.  Measuring and Evaluating Safety Maturity of Construction Contractors: Multicriteria Decision-Making Approach , 2018, Journal of Construction Engineering and Management.

[35]  Yantao Yu,et al.  Visualization technology-based construction safety management: A review , 2017 .

[36]  Miroslaw J. Skibniewski,et al.  Information and Communication Technology Applications in Architecture, Engineering, and Construction Organizations: A 15-Year Review , 2015 .

[37]  Chenbo Yin,et al.  Flexible virtual fixtures for human-excavator cooperative system , 2019 .

[38]  Steven K. Ayer,et al.  Using Mixed Reality for electrical construction design communication , 2018 .

[39]  A R Duff,et al.  Contributing factors in construction accidents. , 2005, Applied ergonomics.

[40]  Matthew R. Hallowell,et al.  Measuring and modelling safety communication in small work crews in the US using social network analysis , 2013 .

[41]  Carol K.H. Hon,et al.  Real-time locating systems and safety in construction sites: A literature review , 2019, Safety Science.

[42]  Ying Zhou,et al.  Implementation of augmented reality for segment displacement inspection during tunneling construction , 2017 .

[43]  Wen Yi,et al.  A critical review of virtual and augmented reality (VR/AR) applications in construction safety , 2018 .

[44]  Ming Lu,et al.  Photogrammetry Assisted Measurement of Interstory Drift for Rapid Post-disaster Building Damage Reconnaissance , 2011 .

[45]  Norbert Schwarz,et al.  Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation , 2014 .

[46]  Kang Liu,et al.  Book Review: Sentiment Analysis: Mining Opinions, Sentiments, and Emotions by Bing Liu , 2015, CL.

[47]  Simaan M. AbouRizk,et al.  An integrated ergonomics framework for evaluation and design of construction operations , 2018, Automation in Construction.

[48]  John C. Tang,et al.  3D Collaboration Method over HoloLens™ and Skype™ End Points , 2015, ImmersiveME@ACM Multimedia.

[49]  Daniel Fong,et al.  Factors affecting safety performance on construction sites , 1999 .

[50]  Stephen R. Thomas,et al.  Critical Communications Variables , 1998 .

[51]  Jesús M. de la Garza,et al.  Latent Effect of Safety Interventions , 2020 .

[52]  Igal M. Shohet,et al.  Optimal allocation of resources in construction safety: Analytical-empirical model , 2018 .

[53]  Bhavana Pandit,et al.  Focus on the fatal-four: Implications for construction hazard recognition , 2020 .

[54]  John Ahmet Erkoyuncu,et al.  Structured authoring for AR-based communication to enhance efficiency in remote diagnosis for complex equipment , 2020, Adv. Eng. Informatics.

[55]  Salman Azhar,et al.  Role of Visualization Technologies in Safety Planning and Management at Construction Jobsites , 2017 .

[56]  Vineet R. Kamat,et al.  Uncertainty-aware visualization and proximity monitoring in urban excavation: a geospatial augmented reality approach , 2013 .

[57]  Rod Furlan The future of augmented reality: Hololens - Microsoft's AR headset shines despite rough edges [Resources_Tools and Toys] , 2016, IEEE Spectrum.

[58]  Charles M. Eastman,et al.  BIM-based fall hazard identification and prevention in construction safety planning , 2015 .

[59]  Chan-Sik Park,et al.  A framework for construction safety management and visualization system , 2013 .