Two Many Cooks: Understanding Dynamic Human-Agent Team Communication and Perception Using Overcooked 2

This paper describes a research study that aims to investigate changes in effective communication during human-AI collaboration with special attention to the perception of competence among team members and varying levels of task load placed on the team. We will also investigate differences between human-human teamwork and human-agent teamwork. Our project will measure differences in the communication quality, team perception and performance of a human actor playing a Commercial Off The Shelf game (COTS) with either a human teammate or a simulated AI teammate under varying task load. We argue that the increased cognitive workload associated with increases task load will be negatively associated with team performance and have a negative impact on communication quality. In addition, we argue that positive team perceptions will have a positive impact on the communication quality between a user and teammate in both the human and AI teammate conditions. This project will offer more refined insights on Human AI relationship dynamics in collaborative tasks by considering communication quality, team perception, and performance under increasing cog-

[1]  Tyler H. Shaw,et al.  A single-item assessment for remaining mental resources: development and validation of the Gas Tank Questionnaire (GTQ) , 2017 .

[2]  Tyler H. Shaw,et al.  Team Structure and Team Building Improve Human–Machine Teaming With Autonomous Agents , 2019, Journal of Cognitive Engineering and Decision Making.

[3]  Ass,et al.  Can computers be teammates? , 1996 .

[4]  Eduardo Salas,et al.  Communication in virtual teams: a conceptual framework and research agenda , 2017 .

[5]  Beau G. Schelble,et al.  Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature , 2020, Hum. Factors.

[6]  Chris Martens,et al.  An intentional AI for hanabi , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[7]  Zahra Ashktorab,et al.  Human-AI Collaboration in a Cooperative Game Setting , 2020, Proc. ACM Hum. Comput. Interact..

[8]  Tom Williams,et al.  Deconstructed Trustee Theory: Disentangling Trust in Body and Identity in Multi-Robot Distributed Systems , 2021, 2021 16th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Beau G. Schelble,et al.  What Happens When Humans Believe Their Teammate is an AI? An Investigation into Humans Teaming with Autonomy , 2021, Comput. Hum. Behav..

[10]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[11]  Thomas Lukasiewicz,et al.  Diversity-Driven Extensible Hierarchical Reinforcement Learning , 2018, AAAI.

[12]  Clint A. Bowers,et al.  Effects of Workload and Structure on Team Processes and Performance: Implications for Complex Team Decision Making , 1996, Hum. Factors.

[13]  Yi Mou,et al.  The media inequality: Comparing the initial human-human and human-AI social interactions , 2017, Comput. Hum. Behav..

[14]  Xiaofeng Gao,et al.  Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[15]  Anca D. Dragan,et al.  On the Utility of Learning about Humans for Human-AI Coordination , 2019, NeurIPS.

[16]  Dustin K. Jundt,et al.  Teams in organizations: from input-process-output models to IMOI models. , 2005, Annual review of psychology.

[17]  Kevin T. Wynne,et al.  An integrative model of autonomous agent teammate-likeness , 2018 .

[18]  Shannon L. Marlow,et al.  Does team communication represent a one-size-fi ts-all approach ? : A meta-analysis of team communication and performance , 2018 .

[19]  Tyler H. Shaw,et al.  CHAOPT: A Testbed for Evaluating Human-Autonomy Team Collaboration Using the Video Game Overcooked!2 , 2020, 2020 Systems and Information Engineering Design Symposium (SIEDS).

[20]  Mark A. Neerincx,et al.  Towards a Theory of Longitudinal Trust Calibration in Human–Robot Teams , 2019, International Journal of Social Robotics.

[21]  Wojciech M. Czarnecki,et al.  Grandmaster level in StarCraft II using multi-agent reinforcement learning , 2019, Nature.

[22]  Julia E. Hoch,et al.  Virtual teams in organizations , 2017 .

[23]  Yongmei Liu,et al.  A Meta-analysis of Virtual Team Communication Based on IPO Model , 2010, ICE-B 2010.

[24]  Colin F. Mackenzie,et al.  Team Communication Patterns as Measures of Team Processes: Exploring the Effects of Task Urgency and Shared Team Experience , 2003 .

[25]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[26]  Joshua B. Tenenbaum,et al.  Too Many Cooks: Bayesian Inference for Coordinating Multi-Agent Collaboration , 2020, Top. Cogn. Sci..

[27]  Matthias Scheutz,et al.  A Framework for Developing and Using Shared Mental Models in Human-Agent Teams , 2017 .