Situational Awareness-based Augmented Reality Instructional (ARI) Module for Building Evacuation

Emergency response in indoor building evacuation is essential for effective rescue and safety management. First responders often lack the situational awareness capability to quickly assess the layout of a building upon initial entry. For occupants of the building, situational awareness becomes more important in cases of active shooter events or circumstances of fire and smoke. One of the challenges is to provide user-specific personalized evacuation routes in real-time. In multilevel building environments, the complexity of the architecture creates problems for both visual and mental representation of the 3D spaces. This paper presents three cutting edge Augmented Reality Instructional (ARI) modules that overcome the visual limitations associated with the traditional, static 2D methods of communicating evacuation plans for multilevel buildings. Using existing building features, the authors demonstrate how the three modules provide contextualized 3D visualizations that promote and support spatial knowledge acquisition and cognitive mapping thereby enhancing situational awareness. These ARI visualizations are developed for first responders and building occupants to help increase emergency preparedness and mitigate the evacuation related risks in multilevel building rescues and safety management. Specifically, the paper describes the design and implementation of the ARI modules and reports the results of the pilot studies conducted to evaluate their perceived usefulness, ease-of-use, and usability. The results suggest the desirability of further heuristic examination of three-dimensional situational awareness-based ARI application effectiveness in multilevel building evacuations.

[1]  Rosaldo J. F. Rossetti,et al.  Gamifying evacuation drills , 2013, 2013 8th Iberian Conference on Information Systems and Technologies (CISTI).

[2]  Sandrine de Ribaupierre,et al.  VR and AR simulator for neurosurgical training , 2015, 2015 IEEE Virtual Reality (VR).

[3]  Ricardo Fuentes Covarrubias,et al.  Mobile Guide to Augmented Reality for Campus of the Autonomous University of Nayarit , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[4]  James Stigall,et al.  Mobile Augmented Reality Application for Building Evacuation Using Intelligent Signs , 2017 .

[5]  Nassir Navab,et al.  mirracle: An augmented reality magic mirror system for anatomy education , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[6]  Jan Guhl,et al.  Concept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLens , 2017, 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[7]  Wei Liang,et al.  Earthquake Safety Training through Virtual Drills , 2017, IEEE Transactions on Visualization and Computer Graphics.

[8]  Faisal Kaleem,et al.  Smart augmented reality glasses in cybersecurity and forensic education , 2016, 2016 IEEE Conference on Intelligence and Security Informatics (ISI).

[9]  Marin B. Marinov,et al.  Mixed Reality Smart Glasses Application for Interactive Working , 2018, 2018 IEEE XXVII International Scientific Conference Electronics - ET.

[10]  Vasaka Visoottiviseth,et al.  A Prototype of Collaborative Augment Reality Environment for HoloLens , 2018, 2018 22nd International Computer Science and Engineering Conference (ICSEC).

[11]  Sharad Sharma,et al.  An indoor augmented reality mobile application for simulation of building evacuation , 2015, Electronic Imaging.

[12]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[13]  Hiroyuki Mitsuhara,et al.  Evacuation instruction training system using augmented reality and a smartphone-based head mounted display , 2016, 2016 3rd International Conference on Information and Communication Technologies for Disaster Management (ICT-DM).

[14]  Joseph J. LaViola,et al.  Determining Design Requirements for AR Physics Education Applications , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[15]  James Birt,et al.  Piloting mobile mixed reality simulation in paramedic distance education , 2017, 2017 IEEE 5th International Conference on Serious Games and Applications for Health (SeGAH).

[16]  Myeung-Sook Yoh,et al.  The reality of virtual reality , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[17]  Zhongning Guo,et al.  Application of Augmented Reality in Engineering Graphics Education , 2011, 2011 IEEE International Symposium on IT in Medicine and Education.

[18]  Erik Kucera,et al.  Interactive and virtual/mixed reality applications for mechatronics education developed in unity engine , 2018, 2018 Cybernetics & Informatics (K&I).

[19]  Liron Pantanowitz,et al.  Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology. , 2018, Archives of pathology & laboratory medicine.

[20]  Sumbul Ghulamani,et al.  Educating students in remote areas using augmented reality , 2018, 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET).

[21]  Naphtali Rishe,et al.  Integrating Building Information Modeling with Augmented Reality for Interdisciplinary Learning , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[22]  Sri Teja Bodempudi,et al.  Emergency Response Using HoloLens for Building Evacuation , 2019, HCI.

[23]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[24]  Andreas Hein,et al.  TutAR: Semi-Automatic Generation of Augmented Reality Tutorials for Medical Education , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

[25]  Hideo Saito,et al.  First Deployment of Diminished Reality for Anatomy Education , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[26]  Mohammad Chuttur,et al.  Overview of the Technology Acceptance Model: Origins, Developments and Future Directions , 2009 .

[27]  Hiroyuki Mitsuhara,et al.  Game-Based Evacuation Drills Using Simple Augmented Reality , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[28]  Tone Vold,et al.  Flipped Gaming - testing three simulation games , 2018, 2018 17th International Conference on Information Technology Based Higher Education and Training (ITHET).

[29]  Richard Han,et al.  RescueMe: An Indoor Mobile Augmented-Reality Evacuation System by Personalized Pedometry , 2011, 2011 IEEE Asia-Pacific Services Computing Conference.