Usability Evaluation of Information Technology in Disaster and Emergency Management

Apart from technical reliability, usability is one of the major criteria for safe and efficient usage of interactive information technology in disaster and emergency management. However, in this setting, usability evaluation is difficult due to the heterogeneity and unpredictability of operation conditions, as well as the difficult, usually mobile, context. However, there are ways to conduct usability evaluations in disaster and emergency settings. Thus, in this paper, advantages and disadvantages of empirical and analytical usability evaluation methods for interactive systems in disaster and emergency management are discussed. The importance of formative evaluation measures within an iterative human-centered design process is emphasized. It is illustrated by two case studies dealing with paramedics’ and emergency physicians’ usage of mobile and wearable devices in mass casualty incidents.

[1]  David G. Novick,et al.  Using the cognitive walkthrough for operating procedures , 1999, INTR.

[2]  T Mentler,et al.  Routine Mobile Applications for Emergency Medical Services in Mass Casualty Incidents , 2012, Biomedizinische Technik. Biomedical engineering.

[3]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[4]  Thomas Kirste,et al.  Design Challenges for an Integrated Disaster Management Communication and Information System , 2002 .

[5]  Patrick Robertson,et al.  Providing real-time assistance in disaster relief by leveraging crowdsourcing power , 2014, Personal and Ubiquitous Computing.

[6]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1999, CHI Extended Abstracts.

[7]  Glenda H. Eoyang.  Complex? Yes! Adaptive? Well, maybe… , 1996, INTR.

[8]  Alan Cooper,et al.  About Face 3: the essentials of interaction design , 1995 .

[9]  Michael Herczeg,et al.  Optical Head-Mounted Displays in Mass Casualty Incidents: Keeping an Eye on Patients and Hazardous Materials , 2015, Int. J. Inf. Syst. Crisis Response Manag..

[10]  Jane Li,et al.  Design of an advanced telemedicine system for emergency care , 2006, OZCHI.

[11]  Michael Herczeg,et al.  Software-Ergonomie: Theorien, Modelle und Kriterien für gebrauchstaugliche interaktive Computersysteme , 2009 .

[12]  David Benyon.  Designing interactive systems : a comprehensive guide to HCI, UX and interaction design , 2013 .

[13]  Keith A. Butler,et al.  Usability engineering turns 10 , 1996, INTR.

[14]  Farah Magrabi.  Using cognitive models to evaluate safety-critical interfaces in healthcare , 2008, CHI Extended Abstracts.

[15]  Michael Herczeg,et al.  Human Factors and Ergonomics in Mobile Computing for Emergency Medical Services , 2014 .

[16]  George G. Robertson.  Reflections on user interface software and technology , 1997, INTR.

[17]  Michael Herczeg,et al.  Applying ISO 9241-110 dialogue principles to tablet applications in emergency medical services , 2013, ISCRAM.

[18]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[19]  Michael Herczeg,et al.  Smartglasses for the Triage of Casualties and the Identification of Hazardous Materials , 2016, i-com.

[20]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[21]  M. Scriven.  The methodology of evaluation , 1966 .

[22]  Michael Herczeg,et al.  Care & Prepare - Usability Engineering for Mass Casualty Incidents , 2011, EICS4Med.

[23]  Karen Holtzblatt,et al.  Contextual design , 1997, INTR.

[24]  Marita Franzke,et al.  Usability evaluation with the cognitive walkthrough , 1995, CHI 95 Conference Companion.

[25]  Mary Beth Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[26]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[27]  Gerhard Leitner,et al.  Usability of Mobile Computing in Emergency Response Systems - Lessons Learned and Future Directions , 2007, USAB.

[28]  Oswald Huber.  Das psychologische experiment : eine Einführung , 1987 .

[29]  Kristina Höök,et al.  Using cognitive walkthrough for evaluating a CSCW application , 1994, CHI Conference Companion.

[30]  Florian Klompmaker,et al.  Enriching disaster control management based on human-centered design , 2012, ISCRAM.

[31]  Barbara M. Walsh,et al.  Do You See What I See? Insights from Using Google Glass for Disaster Telemedicine Triage , 2015, Prehospital and Disaster Medicine.

[32]  Michael Herczeg,et al.  Interactive cognitive artifacts for enhancing situation awareness of incident commanders in mass casualty incidents , 2014, Journal of Interaction Science.

[33]  Davide Colombo,et al.  Disaster medicine through Google Glass. , 2015, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[34]  Michael Herczeg,et al.  Routine- und Ausnahmebetrieb im mobilen Kontext des Rettungsdienstes , 2013, MuC.

[35]  M. Good,et al.  User-derived impact analysis as a tool for usability engineering , 1986, CHI '86.