18th ICCRTS: C2 in an Underdeveloped and/or Denied Environment

The DoD’s envisioned role shift for humans from operators to future autonomous systems supervisors presents significant challenges for developing effective decision support. What decision support will supervisors need to effectively oversee autonomous systems? What will their task needs be and how can we support them with usable and useful supervisory human-machine interfaces (HMIs) and tools? Here, we inform the requirements and design of future decision support through a systematic cognitive engineering and analysis process. Structured interviews with 27 unmanned systems experts were carefully sequenced across four groups, with results and artifacts from one group informing the next interviews. Interviews focused on supervisory monitoring and intervention tasks and were designed to feed a userand task-centered, scientifically-principled HMI design process to develop the decision support. The interviews informed this design process by populating three key design artifacts: (1) a model of current and future tasks, (2) their allocation across humans and automation, and (3) the necessary supporting human-automation exchanges. A framework for system designers to allocate tasks across humans and automation was extended to provide an objective basis for subject matter experts to contribute their expectations for future automation. The interview results show how today’s task needs are not met by current HMIs and tools, and how persisting with them is unlikely to meet the future needs of more nuanced supervisory decision making. Our results inform the design of future supervisory HMIs that target and mitigate today’s capability gaps and shed light on how to begin to achieve the DoD vision.

[1]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[2]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[3]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[4]  L. Bainbridge Ironies of Automation , 1982 .

[5]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[6]  Donald A. Norman,et al.  User-centered systems design , 1986 .

[7]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[8]  Emilie M. Roth,et al.  Cognitive Engineering: Human Problem Solving with Tools , 1988 .

[9]  B. Rouse William,et al.  Adaptive Aiding for Human/Computer Control , 1988 .

[10]  John R. Anderson A Spreading Activation Theory of Memory , 1988 .

[11]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[12]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[13]  Philip J. Smith,et al.  Design of a Cooperative Problem-Solving System for En-Route Flight Planning: An Empirical Evaluation , 1994 .

[14]  Christopher D. Wickens,et al.  When Users Want What's not Best for Them , 1995 .

[15]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[16]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[17]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[18]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[19]  Nancy J. Cooke,et al.  A Synthetic Task Environment for Team Cognition Research , 1999 .

[20]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[21]  Catherine M. Burns,et al.  There Is More to Monitoring a Nuclear Power Plant than Meets the Eye , 2000, Hum. Factors.

[22]  Matthew Bransby DESIGN OF ALARM SYSTEMS , 2001 .

[23]  Harvey S. Smallman,et al.  The Use of 2D and 3D Displays for Shape-Understanding versus Relative-Position Tasks , 2001, Hum. Factors.

[24]  Nancy J. Cooke,et al.  Knowledge Elicitation , 2003 .

[25]  Frank Spillers,et al.  Task Analysis through Cognitive Archeology. , 2003 .

[26]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[27]  Kevin W Williams,et al.  A Summary of Unmanned Aircraft Accident/Incident Data: Human Factors Implications , 2004 .

[28]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[29]  Harvey S. Smallman,et al.  Naive Realism: Misplaced Faith in Realistic Displays , 2005 .

[30]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[31]  Catherine M. Burns Towards proactive monitoring in the petrochemical industry , 2006 .

[32]  Stacey D. Scott,et al.  Cognitive Task Analysis for the LCS Operator , 2006 .

[33]  Stacey D. Scott,et al.  Generating Requirements for Futuristic Hetrogenous Unmanned Systems , 2006 .

[34]  Erik Hollnagel,et al.  Joint Cognitive Systems: Patterns in Cognitive Systems Engineering , 2006 .

[35]  Anthony P Tvaryanas,et al.  Human factors in remotely piloted aircraft operations: HFACS analysis of 221 mishaps over 10 years. , 2006, Aviation, space, and environmental medicine.

[36]  Mary L. Cummings,et al.  Automation Architecture for Single Operator, Multiple UAV Command and Control, , 2007 .

[37]  J. Crandall,et al.  12 TH ICCRTS “ Adapting C 2 to the 21 st Century ” An Operator Function Taxonomy for Unmanned Aerial Vehicle Missions Track 4 : Cognitive and Social Issues , 2007 .

[38]  Stacey D. Scott,et al.  Awareness in Unmanned Aerial Vehicle Operations , 2008 .

[39]  A.,et al.  Cognitive Engineering , 2008, Encyclopedia of GIS.

[40]  Neville A. Stanton,et al.  Book preview , 2003, INTR.

[41]  Harvey S. Smallman,et al.  When Plans Change: Task Analysis and Taxonomy of 3-D Situation Awareness Challenges of UAV Replanning , 2010 .

[42]  Harvey S. Smallman,et al.  Naïve Realism: Folk Fallacies in the Design and Use of Visual Displays , 2011, Top. Cogn. Sci..

[43]  Kevin B. Bennett,et al.  Display and Interface Design: Subtle Science, Exact Art , 2011 .

[44]  S. Greenberg,et al.  The Psychology of Everyday Things , 2012 .

[45]  Harvey S. Smallman,et al.  Proactive Supervisory Decision Support from Trend-Based Monitoring of Autonomous and Automated Systems: A Tale of Two Domains , 2013, HCI.

[46]  Michael E. Miller,et al.  Human systems integration , 2013 .

[47]  Mark W. Scerbo,et al.  Theoretical Perspectives on Adaptive Automation , 2019, Human Performance in Automated and Autonomous Systems.