Employing Models of Human Social Motor Behavior for Artificial Agent Trainers

Many everyday tasks require individuals to work together as a team to achieve a task goal. For many complex or high-stakes multi-agent activities, team members are required to participate in simulated training exercises to develop the taskand team-work (coordination) skills needed tomaximize task performance. Such training, however, can be both timeand labor-intensive, requiring the participation of full teams and expert instructors. One way to minimize these costs is to augment team training scenarios with interactive artificial agents (AAs) capable of robust, ‘human-like’ behavioral interaction. With regard to perceptual-motor tasks specifically, recent research suggests that this can be achieved using task dynamical models derived from the dynamical primitives of human motor behavior. To investigate the degree to which such models can be employed for human team training, we examined whether a task dynamical model of human herding behavior could be embedded in the control architecture of an AA to train novice human-actors to learn various simulated multi-agent herding tasks. Three experiments were conducted that (i) first modeled human team performance during a set of novel herding tasks adapted from [19, 21], (ii) tested an AA utilizing this model to complete the tasks with human novices, and (iii) demonstrated how this AA could effectively train novices in a manner comparable to a human-expert trainer.

[1]  Patrick Nalepka,et al.  Practical Applications of Multiagent Shepherding for Human-Machine Interaction , 2019, PAAMS.

[2]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[3]  Mark A. Neerincx,et al.  Developing Effective and Resilient Human-Agent Teamwork Using Team Design Patterns , 2019, IEEE Intelligent Systems.

[4]  Marco Beccuti,et al.  Adaptive Artificial Co-pilot as Enabler for Autonomous Vehicles and Intelligent Transportation Systems , 2018, ATT@IJCAI.

[5]  Michael J. Richardson,et al.  Herd Those Sheep: Emergent Multiagent Coordination and Behavioral-Mode Switching , 2017, Psychological science.

[6]  Elliot Saltzman,et al.  A Graph-Dynamic Perspective on Coordinative Structures, the Role of Affordance-Effectivity Relations in Action Selection, and the Self-Organization of Complex Activities , 2015 .

[7]  Ali A. Minai,et al.  PAPAc: A Pick and Place Agent Based on Human Behavioral Dynamics , 2017, HAI.

[8]  Ali A. Minai,et al.  A Hierarchical Behavioral Dynamic Approach for Naturally Adaptive Human-Agent Pick-and-Place Interactions , 2019, Complex..

[9]  Kagan Tumer,et al.  Using Awareness to Promote Richer, More Human-Like Behaviors in Artificial Agents , 2016, AAMAS Workshops.

[10]  J A Kelso,et al.  Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. , 1987, Journal of experimental psychology. Human perception and performance.

[11]  Fillia Makedon,et al.  An intelligent Interactive Learning and Adaptation framework for robot-based vocational training , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[12]  Stefan Kopp,et al.  Communicative Listener Feedback in Human-Agent Interaction: Artificial Speakers Need to Be Attentive and Adaptive , 2018, AAMAS.

[13]  Michael J. Richardson,et al.  Dynamics of Interpersonal Coordination , 2008 .

[14]  N. Hogan,et al.  On rhythmic and discrete movements: reflections, definitions and implications for motor control , 2007, Experimental Brain Research.

[15]  Michael D. Matthews,et al.  The Oxford Handbook of Military Psychology , 2012 .

[16]  G. Goodwin,et al.  The Science of Teams in the Military: Contributions From Over 60 Years of Research , 2018, The American psychologist.

[17]  Shinya Kotosaka,et al.  Submitted to: IEEE International Conference on Humanoid Robotics Nonlinear Dynamical Systems as Movement Primitives , 2022 .

[18]  Jessie Y. C. Chen,et al.  Situation awareness-based agent transparency and human-autonomy teaming effectiveness , 2018 .

[19]  Maurice Lamb,et al.  Feedback delays can enhance anticipatory synchronization in human-machine interaction , 2019, PloS one.

[20]  S. Maity,et al.  Identifying opportunities for artificial intelligence in the evolution of training and development practices , 2019, Journal of Management Development.

[21]  Brett R Fajen,et al.  Behavioral dynamics of steering, obstacle avoidance, and route selection. , 2003, Journal of experimental psychology. Human perception and performance.

[22]  Davide Liuzza,et al.  Deep learning control of artificial avatars in group coordination tasks , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[23]  S. Schaal,et al.  Bouncing a ball: tuning into dynamic stability. , 2001, Journal of experimental psychology. Human perception and performance.

[24]  Eduardo Salas,et al.  Does Team Training Improve Team Performance? A Meta-Analysis , 2008, Hum. Factors.

[25]  Nancy J. Cooke,et al.  Training Adaptive Teams , 2010, Hum. Factors.

[26]  Michael J. Richardson,et al.  Self-organized complementary joint action: Behavioral dynamics of an interpersonal collision-avoidance task. , 2015, Journal of experimental psychology. Human perception and performance.

[27]  Chao Zhai,et al.  Dynamic similarity promotes interpersonal coordination in joint action , 2015, Journal of The Royal Society Interface.

[28]  Dirk Wollherr,et al.  Human-Like Motion Planning Based on Game Theoretic Decision Making , 2018, Int. J. Soc. Robotics.

[29]  W. H. Warren The dynamics of perception and action. , 2006, Psychological review.

[30]  Gavan Lintern,et al.  Dynamic patterns: The self-organization of brain and behavior , 1997, Complex.

[31]  Patrick Nalepka,et al.  Human social motor solutions for human–machine interaction in dynamical task contexts , 2019, Proceedings of the National Academy of Sciences.

[32]  Hoda Eldardiry,et al.  Building Jarvis - A Learner-Aware Conversational Trainer , 2019, IUI Workshops.

[33]  Patrick Nalepka,et al.  Modeling Embedded Interpersonal and Multiagent Coordination , 2016, COMPLEXIS.

[34]  S. Hirche,et al.  Rhythm Patterns Interaction - Synchronization Behavior for Human-Robot Joint Action , 2014, PloS one.

[35]  Michael J. Richardson,et al.  Symmetry-Breaking and the Contextual Emergence of Human Multiagent Coordination and Social Activity , 2016 .

[36]  J. A. Scott Kelso,et al.  Virtual Partner Interaction (VPI): Exploring Novel Behaviors via Coordination Dynamics , 2009, PloS one.

[37]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[38]  J. Kelso,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[39]  J. Kelso,et al.  The human dynamic clamp as a paradigm for social interaction , 2014, Proceedings of the National Academy of Sciences.