The Next Generation of Human-Drone Partnerships: Co-Designing an Emergency Response System

The use of semi-autonomous Unmanned Aerial Vehicles (UAV) to support emergency response scenarios, such as fire surveillance and search and rescue, offers the potential for huge societal benefits. However, designing an effective solution in this complex domain represents a "wicked design" problem, requiring a careful balance between trade-offs associated with drone autonomy versus human control, mission functionality versus safety, and the diverse needs of different stakeholders. This paper focuses on designing for situational awareness (SA) using a scenario-driven, participatory design process. We developed SA cards describing six common design-problems, known as SA demons, and three new demons of importance to our domain. We then used these SA cards to equip domain experts with SA knowledge so that they could more fully engage in the design process. We designed a potentially reusable solution for achieving SA in multi-stakeholder, multi-UAV, emergency response applications.

[1]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[2]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[3]  Leonardo Castro Botega,et al.  Development of a User Interface for the Enrichment of Situational Awareness in Emergency Management Systems , 2016 .

[4]  Tim Claudius Stratmann,et al.  Demon Hunt - The Role of Endsley's Demons of Situation Awareness in Maritime Accidents , 2016, HCSE/HESSD.

[5]  Martin Glinz,et al.  A Qualitative Study on using GuideGen to Keep Requirements and Acceptance Tests Aligned , 2018, 2018 IEEE 26th International Requirements Engineering Conference (RE).

[6]  Richard Coyne,et al.  Wicked problems revisited , 2005 .

[7]  M. Endsley.  Autonomous Driving Systems: A Preliminary Naturalistic Study of the Tesla Model S , 2017 .

[8]  Jane Cleland-Huang,et al.  Discovering, Analyzing, and Managing Safety Stories in Agile Projects , 2018, 2018 IEEE 26th International Requirements Engineering Conference (RE).

[9]  George A. Miller,et al.  Human memory and the storage of information , 1956, IRE Trans. Inf. Theory.

[10]  Debbie Richards,et al.  The reuse of knowledge: a user-centred approach , 2000, Int. J. Hum. Comput. Stud..

[11]  B.R. Upadhyaya,et al.  Advanced automation concepts for large-scale systems , 1991, IEEE Control Systems.

[12]  Kellogg S. Booth,et al.  An evaluation of a multiple interface design solution for bloated software , 2002, CHI.

[13]  J. Fereday,et al.  Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development , 2006 .

[14]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[15]  K.M. Passino,et al.  An introduction to autonomous control systems , 1990, IEEE Control Systems.

[16]  Jiafu Wan,et al.  A survey of Cyber-Physical Systems , 2011, 2011 International Conference on Wireless Communications and Signal Processing (WCSP).

[17]  Mica R. Endsley,et al.  Designing for Situation Awareness : An Approach to User-Centered Design , 2003 .

[18]  Axel van Lamsweerde,et al.  Managing Conflicts in Goal-Driven Requirements Engineering , 1998, IEEE Trans. Software Eng..

[19]  Jane Cleland-Huang,et al.  Dronology: An Incubator for Cyber-Physical Systems Research , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering: New Ideas and Emerging Technologies Results (ICSE-NIER).

[20]  Carman Neustaedter,et al.  Exploring Drones to Assist Firefighters During Emergencies , 2019 .

[21]  Mohamed Guiatni,et al.  Tactile Display Design for Flight Envelope Protection and Situational Awareness , 2019, IEEE Transactions on Haptics.

[22]  Avi Parush,et al.  Can teamwork and situational awareness (SA) in ED resuscitations be improved with a technological cognitive aid? Design and a pilot study of a team situation display , 2017, J. Biomed. Informatics.

[23]  Susanne Bødker,et al.  Participatory Design that Matters—Facing the Big Issues , 2018, ACM Trans. Comput. Hum. Interact..

[24]  E. Onal,et al.  From Theory to Practice: How Designing for Situation Awareness Can Transform Confusing, Overloaded Shovel Operator Interfaces, Reduce Costs, and Increase Safety , 2013 .

[25]  PhD MSc BSc Fbcs Citp Lili Yang,et al.  Situation awareness oriented user interface design for fire emergency response , 2009 .

[26]  Guy H. Walker,et al.  A review of sociotechnical systems theory: a classic concept for new command and control paradigms , 2008 .

[27]  H. Rittel,et al.  Dilemmas in a general theory of planning , 1973 .

[28]  John M. Rushby.  Modeling the Human in Human Factors , 2001, SAFECOMP.

[29]  Colin M. Gray.  "It's More of a Mindset Than a Method": UX Practitioners' Conception of Design Methods , 2016, CHI.

[30]  Mickaël Causse,et al.  Formal Detection of Attentional Tunneling in Human Operator–Automation Interactions , 2014, IEEE Transactions on Human-Machine Systems.

[31]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[32]  Allison Druin,et al.  Children's Perspectives on Ethical Issues Surrounding Their Past Involvement on a Participatory Design Team , 2016, CHI.

[33]  Atul Gupta,et al.  A systematic literature review of use case specifications research , 2015, Inf. Softw. Technol..

[34]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[35]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[36]  Jonathan M. Aitken,et al.  Towards artificial situation awareness by autonomous vehicles , 2017 .

[37]  Ian Sommerville,et al.  Socio-technical systems: From design methods to systems engineering , 2011, Interact. Comput..

[38]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[39]  Leah Kaufman,et al.  Too much of a good thing?: identifying and resolving bloat in the user interface , 1998, SGCH.

[40]  Alistair Cockburn,et al.  Writing Effective Use Cases , 2000 .

[41]  Angelica BACIVAROV,et al.  A Neuro-Classification Model for Socio-Technical Systems , 2009 .

[42]  Nancy J. Cooke,et al.  Stories of Modern Technology Failures and Cognitive Engineering Successes , 2007 .

[43]  Ratna Babu Chinnam,et al.  Design reuse framework: a perspective for lean development , 2007 .

[44]  Francesco Orciuoli,et al.  Adaptive Goal Selection for improving Situation Awareness: the Fleet Management case study , 2017, ANT/SEIT.

[45]  Clayton Lewis,et al.  TASK-CENTERED USER INTERFACE DESIGN A Practical Introduction , 2006 .

[46]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[47]  Jeroen van den Hoven,et al.  Meaningful Human Control over Autonomous Systems: A Philosophical Account , 2018, Front. Robot. AI.

[48]  Frank Heidmann,et al.  Interaction Design for Situation Awareness －Eyetracking and Heuristics for Control Centers－ , 2009 .

[49]  Julie A. Shah,et al.  Computational design of mixed-initiative human–robot teaming that considers human factors: situational awareness, workload, and workflow preferences , 2017, Int. J. Robotics Res..

[50]  Nicole Radziwill,et al.  Designing for Situation Awareness: An Approach to User-Centered Design, Second Edition , 2017 .

[51]  Alexander Verbraeck,et al.  The participatory design of a simulation training game , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[52]  David L. Strayer,et al.  80 MPH and out-of-the-loop: Effects of real-world semi-automated driving on driver workload and arousal , 2018, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[53]  C. Marano,et al.  To err is human. Building a safer health system , 2005 .

[54]  Deborah G. Tatar,et al.  The Design Tensions Framework , 2007, Hum. Comput. Interact..

[55]  Colin Potts,et al.  Using schematic scenarios to understand user needs , 1995, Symposium on Designing Interactive Systems.

[56]  Hermann Kaindl,et al.  A design process based on a model combining scenarios with goals and functions , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[57]  Gary Klein,et al.  Improving Users' Mental Models of Intelligent Software Tools , 2011, IEEE Intelligent Systems.

[58]  David R. Thomas,et al.  A General Inductive Approach for Analyzing Qualitative Evaluation Data , 2006 .