The Evolution of Human-Autonomy Teams in Remotely Piloted Aircraft Systems Operations

The focus of this current research is two-fold: (1) to understand how team interaction in human-autonomy teams (HAT)s evolve in the Remotely Piloted Aircraft Systems (RPAS) task context, and (2) to understand how HATs respond to three types of failures (automation, autonomy, and cyber-attack) over time. We summarize the findings from three of our recent experiments regarding the team interaction within HAT over time in the dynamic context of RPAS. For the first and the second experiments, we summarize general findings related to team member interaction of a three-member team over time, by comparison of HATs with all-human teams. In the third experiment, which extends beyond the first two experiments, we investigate HAT evolution when HATs are faced with three types of failures during the task. For all three of these experiments, measures focus on team interactions and temporal dynamics consistent with the theory of interactive team cognition. We applied Joint Recurrence Quantification Analysis, to communication flow in the three experiments. One of the most interesting and significant findings from our experiments regarding team evolution is the idea of entrainment, that one team member (the pilot in our study, either agent or human) can change the communication behaviors of the other teammates over time, including coordination, and affect team performance. In the first and second studies, behavioral passiveness of the synthetic teams resulted in very stable and rigid coordination in comparison to the all-human teams that were less stable. Experimenter teams demonstrated metastable coordination (not rigid nor unstable) and performed better than rigid and unstable teams during the dynamic task. In the third experiment, metastable behavior helped teams overcome all three types of failures. These summarized findings address three potential future needs for ensuring effective HAT: (1) training of autonomous agents on the principles of teamwork, specifically understanding tasks and roles of teammates, (2) human-centered machine learning design of the synthetic agent so the agents can better understand human behavior and ultimately human needs, and (3) training of human members to communicate and coordinate with agents due to current limitations of Natural Language Processing of the agents.

[1]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[2]  Esther Thelen,et al.  Dynamic Systems Theories , 2007 .

[3]  Nancy J. Cooke,et al.  Designing a Synthetic Task Environment , 2017 .

[4]  Kerstin Dautenhahn,et al.  A Paradigm Shift in Artificial Intelligence: Why Social Intelligence Matters in the Design and Development of Robots with Human-Like Intelligence , 2006, 50 Years of Artificial Intelligence.

[5]  Joseph E. McGrath,et al.  Time matters in groups , 1990 .

[6]  S. Guastello Nonlinear dynamical systems for theory and research in ergonomics , 2017, Ergonomics.

[7]  Polemnia G. Amazeen,et al.  From physics to social interactions: Scientific unification via dynamics , 2018, Cognitive Systems Research.

[8]  Nancy J. Cooke,et al.  Coordinated Awareness of Situation by Teams (CAST): Measuring Team Situation Awareness of a Communication Glitch , 2005 .

[9]  Nancy J. Cooke,et al.  The Impact of Perceived Autonomous Agents on Dynamic Team Behaviors , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[10]  Michael M. Cox Goal-Driven Autonomy and Question-Based Problem Recognition , 2013 .

[11]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[12]  U. Krogmann From Automation to Autonomy-Trends Towards Autonomous Combat Systems , 2000 .

[13]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[14]  Nancy J. Cooke,et al.  Synthetic Task Environments for Teams: CERTT‚Äôs UAV-STE , 2004 .

[15]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[16]  Nancy J. Cooke,et al.  Teaming With a Synthetic Teammate: Insights into Human-Autonomy Teaming , 2018, Hum. Factors.

[17]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[18]  Nancy J. Cooke,et al.  Team situation awareness within the context of human-autonomy teaming , 2017, Cognitive Systems Research.

[19]  G. Ermentrout Dynamic patterns: The self-organization of brain and behavior , 1997 .

[20]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[21]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[22]  Nancy J. Cooke,et al.  Synthetic Teammate Communication and Coordination With Humans , 2015 .

[23]  Moreno I. Coco,et al.  Cross-recurrence quantification analysis of categorical and continuous time series: an R package , 2013, Front. Psychol..

[24]  Hermann Haken Intelligent Behavior: a Synergetic View , 2003 .

[25]  F.E. Cellier,et al.  High-autonomy control of space resource processing plants , 1993, IEEE Control Systems.

[26]  Nancy J. Cooke,et al.  Human-Robot Teaming in Urban Search and Rescue , 2015 .

[27]  Nancy J. Cooke,et al.  Team Coordination and Effectiveness in Human-Autonomy Teaming , 2019, IEEE Transactions on Human-Machine Systems.

[28]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[29]  Nancy J. Cooke,et al.  Human Teaming Changes Driven by Expectations of a Synthetic Teammate , 2014 .

[30]  Mustafa Demir,et al.  The Impact of Coordination Quality on Coordination Dynamics and Team Performance: When Humans Team with Autonomy , 2017 .

[31]  Travis J. Wiltshire,et al.  Technology as Teammate: Examining the Role of External Cognition in Support of Team Cognitive Processes , 2016, Front. Psychol..

[32]  Yu Zhang,et al.  A human factors analysis of proactive support in human-robot teaming , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Nancy J. Cooke,et al.  Interactive Team Cognition , 2013, Cogn. Sci..

[34]  Nancy J. Cooke,et al.  Systems Level Evaluation of Resilience in Human-Autonomy Teaming under Degraded Conditions , 2018, 2018 Resilience Week (RWS).

[35]  Nancy J. Cooke,et al.  Team coordination dynamics. , 2010, Nonlinear dynamics, psychology, and life sciences.

[36]  D. Vicinanza,et al.  CROSS RECURRENCE QUANTIFICATION ANALYSIS OF INTER-LEG RELATIONS ACROSS THE GAIT TRANSITION , 2018 .

[37]  Nancy J. Cooke,et al.  Dyadic Team Interaction and Shared Cognition to Inform Human-Robot Teaming , 2018 .

[38]  N. Marwan,et al.  Recurrence quantification analysis : theory and best practices , 2015 .

[39]  Nancy J. Cooke,et al.  The synthetic teammate project , 2009, Comput. Math. Organ. Theory.

[40]  Nancy J. Cooke,et al.  Team communication behaviors of the human-automation teaming , 2016, 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[41]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[42]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[43]  Nancy J. Cooke,et al.  Measuring team situation awareness in decentralized command and control environments , 2006, Ergonomics.

[44]  Nancy J. Cooke,et al.  A conceptual model of team dynamical behaviors and performance in human-autonomy teaming , 2018, Cognitive Systems Research.

[45]  Nancy J. Cooke,et al.  The Complex Dynamics of Team Situation Awareness in Human-Autonomy Teaming , 2018, 2018 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA).

[46]  Michael A. Goodrich,et al.  Toward Task-Based Mental Models of Human-Robot Teaming: A Bayesian Approach , 2013, HCI.

[47]  J. Kurths,et al.  Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  Ronald H. Stevens,et al.  Cognitive Neurophysiologic Synchronies , 2012, Hum. Factors.

[49]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..