A Task-Centred Methodology to Evaluate the Design of Virtual Reality User Interactions: A Case Study on Hazard Identification

Virtual reality (VR) is a computer-based technology that can be used by professionals of many different fields to simulate an environment with a high feeling of presence and immersion. Nonetheless, one main issue when designing such environments is to provide user interactions that are adapted to the tasks performed by the users. Thus, we propose here a task-centred methodology to design and evaluate these user interactions. Our methodology allows for the determination of user interaction designs based on previous VR studies, and for user evaluations based on a task-related computation of usability. Here, we applied it on the hazard identification case study, since VR can be used in a preventive approach to improve worksite safety. Once this task and its related user interactions were analysed with our methodology, we obtained two possible designs of interaction techniques for the worksite exploration subtask. About their usability evaluation, we proposed in this study to compare our task-centred evaluation approach to a non-task-centred one. Our hypothesis was that our approach could lead to different interpretations of user study results than a non-task-centred one. Our results confirmed our hypothesis by comparing weighted usability scores from our task-centred approach to unweighted ones for our two interaction techniques.

[1]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[2]  Xiaochun Cheng,et al.  Secure and energy-efficient smart building architecture with emerging technology IoT , 2021, Comput. Commun..

[3]  Luca Longo,et al.  Experienced mental workload, perception of usability, their interaction and impact on task performance , 2018, PloS one.

[4]  Frédéric Mérienne,et al.  BIM-based Mixed Reality Application for Supervision of Construction , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[5]  Peter Williams,et al.  Construction planning, programming, and control , 1998 .

[6]  Philippe Fuchs,et al.  Virtual Reality: Concepts and Technologies , 2011 .

[7]  Semra Comu,et al.  Effectiveness of Serious Games for Safety Training: A Mixed Method Study , 2021 .

[8]  Doug A. Bowman,et al.  A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2002, Presence: Teleoperators & Virtual Environments.

[9]  John A. Gambatese,et al.  Factors that influence the development and diffusion of technical innovations in the construction industry , 2011 .

[10]  Hans-Jörg Bullinger,et al.  Towards user centred design (UCD) in architecture based on immersive virtual environments , 2010, Comput. Ind..

[11]  Jerzy Pasławski,et al.  Industry 4.0 Concept Introduction into Construction SMEs , 2017 .

[12]  Charles M. Eastman,et al.  Preliminary report on a system for general space planning , 1972, CACM.

[13]  K. Vtt,et al.  4 D-BIM for Construction Safety Planning , 2010 .

[14]  Vineet R. Kamat,et al.  Interactive Augmented Reality Visualization for Improved Damage Prevention and Maintenance of Underground Infrastructure , 2009 .

[15]  Chia-Fen Chi,et al.  Classification scheme and prevention measures for caught-in-between occupational fatalities. , 2018, Applied ergonomics.

[16]  Mark Mon-Williams,et al.  What does virtual reality NEED?: human factors issues in the design of three-dimensional computer environments , 1996, Int. J. Hum. Comput. Stud..

[17]  Kasper Hornbæk,et al.  Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? , 2000, CHI.

[18]  Yu-Cheng Lin,et al.  A Real-Time Construction Safety Monitoring System for Hazardous Gas Integrating Wireless Sensor Network and Building Information Modeling Technologies , 2018, Sensors.

[19]  Zhipeng Zhou,et al.  Overview and analysis of safety management studies in the construction industry , 2015 .

[20]  Jimmie Hinze,et al.  Use of Building Information Modeling in Design to Prevent Construction Worker Falls , 2014, J. Comput. Civ. Eng..

[21]  Charles M. Eastman,et al.  BIM Handbook , 2018 .

[22]  Mel Slater,et al.  Depth of Presence in Virtual Environments , 1994, Presence: Teleoperators & Virtual Environments.

[23]  Joschka Mütterlein,et al.  The Three Pillars of Virtual Reality? Investigating the Roles of Immersion, Presence, and Interactivity , 2018, HICSS.

[24]  Deborah Hix,et al.  User-Centered Design and Evaluation of Virtual Environments , 1999, IEEE Computer Graphics and Applications.

[25]  Charles M. Eastman,et al.  Building Information Modeling (BIM) and Safety: Automatic Safety Checking of Construction Models and Schedules , 2013 .

[26]  Jimmie Hinze,et al.  Integration of Safety in Design through the Use of Building Information Modeling , 2011 .

[27]  Kinam Kim,et al.  Image-based construction hazard avoidance system using augmented reality in wearable device , 2017 .

[28]  Rafael Sacks,et al.  Hazard recognition and risk perception in construction , 2014 .

[29]  Ivan Poupyrev,et al.  A framework and testbed for studying manipulation techniques for immersive VR , 1997, VRST '97.

[30]  Jason Jerald,et al.  The VR Book: Human-Centered Design for Virtual Reality , 2015 .

[31]  Bhavana Pandit,et al.  Focus on the fatal-four: Implications for construction hazard recognition , 2020 .

[32]  Sungkon Moon,et al.  Development of BIM, IoT and AR/VR technologies for fire safety and upskilling , 2021 .

[33]  Ehsan Harirchian,et al.  ML-EHSAPP: a prototype for machine learning-based earthquake hazard safety assessment of structures by using a smartphone app , 2021, European Journal of Environmental and Civil Engineering.

[34]  Doug A. Bowman,et al.  Domain-Specific Design of 3D Interaction Techniques: An Approach for Designing Useful Virtual Environment Applications , 2009, PRESENCE: Teleoperators and Virtual Environments.

[35]  Doug A. Bowman,et al.  Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[36]  Hazar Dib,et al.  Design for Safety (DFS) and Building Information Modeling (BIM): A Review , 2017 .

[37]  Walid Y. Thabet,et al.  Using virtual environments to support electrical safety awareness in construction , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[38]  Jakob Nielsen,et al.  Measuring usability: preference vs. performance , 1994, CACM.

[39]  Zheng Xu,et al.  Incorporating Virtual Reality Technology in Safety Training Solution for Construction Site of Urban Cities , 2020, Sustainability.

[40]  Wen Yi,et al.  A critical review of virtual and augmented reality (VR/AR) applications in construction safety , 2018 .

[41]  Fatih Yilmaz,et al.  Analysis of occupational accidents in construction sector in Turkey , 2014 .

[42]  Wei Zhou,et al.  Safety by design: dialogues between designers and builders using virtual reality , 2015 .

[43]  Eric Marks,et al.  A Framework for Developing an As-built Virtual Environment to Advance Training of Crane Operators , 2014 .

[44]  Yu Wang,et al.  Implementing Virtual Reality technology for safety training in the precast/ prestressed concrete industry. , 2020, Applied ergonomics.

[45]  Reza Zaker,et al.  Virtual reality-integrated workflow in BIM-enabled projects collaboration and design review: a case study , 2018, Visualization in Engineering.

[46]  M. Bohanec,et al.  The Analytic Hierarchy Process , 2004 .

[47]  Charles M. Eastman,et al.  BIM-based fall hazard identification and prevention in construction safety planning , 2015 .

[48]  Fernanda Aranha Saffaro,et al.  Guidelines for exploring construction sites in virtual reality environments for hazard identification , 2020, International journal of occupational safety and ergonomics : JOSE.

[49]  Xun Xu,et al.  A Framework for BIM-Enabled Life-Cycle Information Management of Construction Project , 2014 .

[50]  Steve Rowlinson,et al.  Integration of virtually real construction model and design-for-safety-process database , 2002 .

[51]  Jochen Teizer,et al.  Visibility-related fatalities related to construction equipment , 2011 .

[52]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[53]  Charalambos Poullis,et al.  Reflecting on the Design Process for Virtual Reality Applications , 2019, Int. J. Hum. Comput. Interact..

[54]  Andrew Shepherd,et al.  Hierarchical task analysis , 2001 .

[55]  Evan Suma Rosenberg,et al.  Evaluating immersive experiences during Covid-19 and beyond , 2020, Interactions.

[56]  Imriyas Kamardeen,et al.  8D BIM modelling tool for accident prevention through design , 2010 .

[57]  Dong Zhao,et al.  Virtual reality simulation for construction safety promotion , 2015, International journal of injury control and safety promotion.

[58]  Ruoyu Jin,et al.  A science mapping approach based review of construction safety research , 2019, Safety Science.

[59]  Ehsan Harirchian,et al.  A Review on Application of Soft Computing Techniques for the Rapid Visual Safety Evaluation and Damage Classification of Existing Buildings , 2021 .

[60]  María Martínez-Rojas,et al.  Building information modeling and safety management: A systematic review , 2018 .

[61]  Carolina Cruz-Neira,et al.  A new taxonomy for locomotion in virtual environments , 2002 .

[62]  S. D. Gisi,et al.  Using an innovative criteria weighting tool for stakeholders involvement to rank MSW facility sites with the AHP. , 2010 .

[63]  Rafael Sacks,et al.  Construction safety training using immersive virtual reality , 2013 .

[64]  Yau-Ren Shiau,et al.  Early intervention mechanism for preventing electrocution in construction engineering. , 2020 .

[65]  Jimmie Hinze,et al.  Addressing construction worker safety in the design phase: Designing for construction worker safety , 1999 .