Training and Verbal Communications in Human-Autonomy Teaming Under Degraded Conditions

Verbal communication is important for coordination and performance in many team settings. However, the inclusion of autonomous artificial agents presents challenges to teamwork. This study sought to examine the effects of three different training approaches on team communication behaviors in human-autonomy teams (HATs) under normal and degraded conditions. Teams were split into three conditions prior to execution of missions in a remotely piloted aircraft system task environment: coordination training, calibration training, and control training. Analysis of text communications indicated that teams that received coordination training push information more frequently compared to teams that received control or calibration training, though this effect appeared to diminish over time. Teams in all three conditions pulled information equally, with a reduction in frequency over time. It was also found that teams that received coordination training were more likely to overcome failures attributed to the autonomous agent's cognitive capacities. This research suggests that coordination training in HATs may be effective at influencing team verbal behaviors, however the extent of this effect requires further examination.

[1]  Nancy J. Cooke,et al.  Designing a Synthetic Task Environment , 2017 .

[2]  Marissa L. Shuffler,et al.  The Design, Delivery and Evaluation of Crew Resource Management Training , 2010 .

[3]  Jessie Y. C. Chen,et al.  A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction , 2011, Hum. Factors.

[4]  Elliot E. Entin,et al.  Adaptive Team Coordination , 1999, Hum. Factors.

[5]  Nancy J. Cooke,et al.  Acquisition and Retention of Team Coordination in Command-and-Control , 2007 .

[6]  J. Hendler,et al.  Amplify scientific discovery with artificial intelligence , 2014, Science.

[7]  Joseph L. C. Cheng Organizational Coordination, Uncertainty, and Performance: An Integrative Study , 1984 .

[8]  Nancy J. Cooke,et al.  Coordinated Awareness of Situation by Teams (CAST): Measuring Team Situation Awareness of a Communication Glitch , 2005 .

[9]  Stephen J. Guastello,et al.  Nonlinear Dynamics of Team Performance and Adaptability in Emergency Response , 2010, Hum. Factors.

[10]  Travis J. Wiltshire,et al.  Technology as Teammate: Examining the Role of External Cognition in Support of Team Cognitive Processes , 2016, Front. Psychol..

[11]  Nancy J. Cooke,et al.  Team communication behaviors of the human-automation teaming , 2016, 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[12]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[13]  E. Entin,et al.  Communication overhead: The hidden cost of team cognition. , 2004 .

[14]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..

[15]  Nancy J. Cooke,et al.  Training Adaptive Teams , 2010, Hum. Factors.

[16]  Nancy J. Cooke,et al.  Team Coordination of Team Situation Awareness in Human-Autonomy Teaming , 2019, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[17]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[18]  Chirag Shah,et al.  Collaborative Information Seeking: A Literature Review , 2010 .

[19]  Nancy J. Cooke,et al.  Team situation awareness within the context of human-autonomy teaming , 2017, Cognitive Systems Research.

[20]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[21]  R. Mayer,et al.  IN MANAGEMENT , 2006 .

[22]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[23]  Nancy J. Cooke,et al.  Autonomous Intelligent Agents for Team Training , 2019, IEEE Intelligent Systems.

[24]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[25]  Nancy J. Cooke,et al.  Effective Team Interaction for Adaptive Training and Situation Awareness in Human-Autonomy Teaming , 2019, 2019 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA).

[26]  Mark A. Neerincx,et al.  Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams , 2019, International Journal of Social Robotics.

[27]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[28]  Nancy J. Cooke,et al.  Team Coordination and Effectiveness in Human-Autonomy Teaming , 2019, IEEE Transactions on Human-Machine Systems.

[29]  Nancy J. Cooke,et al.  The Evolution of Human-Autonomy Teams in Remotely Piloted Aircraft Systems Operations , 2019, Front. Commun..

[30]  Nancy J. Cooke,et al.  Teaming With a Synthetic Teammate: Insights into Human-Autonomy Teaming , 2018, Hum. Factors.