Practical Applications of Multiagent Shepherding for Human-Machine Interaction

The shepherding problem is interesting for multiagent systems research as it requires multiple actors (e.g., dogs, humans) to exert indirect control over autonomous agents (e.g., sheep, cattle) for containment or transportation. Accordingly, plenty of research has focused on designing algorithms for robotic agents to solve such tasks. Almost no research, however, has utilized this task to investigate human-human or human-machine interactions, even though the shepherding problem encapsulates desirable qualities for an experimental paradigm to investigate the dynamics of human group and mixed-group coordination in complex tasks. This paper summarizes our recent research that has employed the shepherding problem to study complex multiagent human-human and human-machine interaction. The paper concludes with a discussion of practical applications for using the shepherding problem for the design of assistive agents that can be incorporated into human groups or enhance training and human learning.

[1]  Zachary I. Bell,et al.  Single Agent Indirect Herding of Multiple Targets: A Switched Adaptive Control Approach , 2018, IEEE Control Systems Letters.

[2]  Elliot Saltzman,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[3]  N. A. Bernshteĭn The co-ordination and regulation of movements , 1967 .

[4]  Aude Billard,et al.  Unravelling socio-motor biomarkers in schizophrenia , 2017, npj Schizophrenia.

[5]  DaeEun Kim,et al.  Autonomous Shepherding Behaviors of Multiple Target Steering Robots , 2017, Sensors.

[6]  Jessica C. Selinger,et al.  Humans Can Continuously Optimize Energetic Cost during Walking , 2015, Current Biology.

[7]  Dagmar Sternad,et al.  The primacy of rhythm: how discrete actions merge into a stable rhythmic pattern. , 2019, Journal of neurophysiology.

[8]  Patrick Nalepka,et al.  Modeling Embedded Interpersonal and Multiagent Coordination , 2016, COMPLEXIS.

[9]  Tom Wilsgaard,et al.  Genetic Variations in the Vitamin D Receptor Predict Type 2 Diabetes and Myocardial Infarction in a Community-Based Population: The Tromsø Study , 2015, PloS one.

[10]  Panayiota Poirazi,et al.  Computational modeling of the effects of amyloid-beta on release probability at hippocampal synapses , 2013, Front. Comput. Neurosci..

[11]  Chao Zhai,et al.  Dynamic similarity promotes interpersonal coordination in joint action , 2015, Journal of The Royal Society Interface.

[12]  Andrew J. King,et al.  Robot Collection and Transport of Objects: A Biomimetic Process , 2018, Front. Robot. AI.

[13]  Andrew J. King,et al.  Solving the shepherding problem: heuristics for herding autonomous, interacting agents , 2014, Journal of The Royal Society Interface.

[14]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[15]  Michel M Maharbiz,et al.  Galvanotactic control of collective cell migration in epithelial monolayers. , 2014, Nature materials.

[16]  Michael J. Richardson,et al.  Herd Those Sheep: Emergent Multiagent Coordination and Behavioral-Mode Switching , 2017, Psychological science.

[17]  S. Hirche,et al.  Rhythm Patterns Interaction - Synchronization Behavior for Human-Robot Joint Action , 2014, PloS one.

[18]  Patrick Nalepka,et al.  Emergence of efficient, coordinated solutions despite differences in agent ability during human-machine interaction: Demonstration using a multiagent "shepherding" task , 2018, IVA.

[19]  J. Kelso,et al.  Social coordination dynamics: Measuring human bonding , 2008, Social neuroscience.

[20]  Joan Johnston Building Intelligent Tutoring Systems for Teams , 2018 .

[21]  W. H. Warren The dynamics of perception and action. , 2006, Psychological review.

[22]  Sandra Hirche,et al.  Synchrony and Reciprocity: Key Mechanisms for Social Companion Robots in Therapy and Care , 2016, Int. J. Soc. Robotics.

[23]  Nancy J. Cooke,et al.  Training Adaptive Teams , 2010, Hum. Factors.

[24]  Dagmar Sternad,et al.  Transitions between discrete and rhythmic primitives in a unimanual task , 2013, Front. Comput. Neurosci..

[25]  Brett R. Fajen,et al.  Behavioral Dynamics of Visually Guided Locomotion , 2008 .

[26]  Maja J. Mataric,et al.  How Robot Verbal Feedback Can Improve Team Performance in Human-Robot Task Collaborations , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Michael J. Richardson,et al.  Dynamics of Interpersonal Coordination , 2008 .

[28]  J. Kelso,et al.  The human dynamic clamp as a paradigm for social interaction , 2014, Proceedings of the National Academy of Sciences.

[29]  Mac Schwager,et al.  Controlling Noncooperative Herds with Robotic Herders , 2018, IEEE Transactions on Robotics.

[30]  E. Saltzman,et al.  Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. , 1987 .

[31]  Roderich Groß,et al.  Shepherding with robots that do not compute , 2017, ECAL.

[32]  W. Warren Collective Motion in Human Crowds , 2018, Current directions in psychological science.

[33]  J. A. Scott Kelso,et al.  Virtual Partner Interaction (VPI): Exploring Novel Behaviors via Coordination Dynamics , 2009, PloS one.

[34]  Soon-Jo Chung,et al.  Robotic Herding of a Flock of Birds Using an Unmanned Aerial Vehicle , 2018, IEEE Transactions on Robotics.

[35]  Dagmar Sternad,et al.  Predictability, force, and (anti)resonance in complex object control. , 2018, Journal of neurophysiology.

[36]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[37]  Michael J. Richardson,et al.  Symmetry-Breaking and the Contextual Emergence of Human Multiagent Coordination and Social Activity , 2016 .

[38]  Stephen Cameron,et al.  Experiments in automatic flock control , 2000, Robotics Auton. Syst..

[39]  Maurice Lamb,et al.  To Pass or Not to Pass: Modeling the Movement and Affordance Dynamics of a Pick and Place Task , 2017, Front. Psychol..

[40]  Patrick Nalepka,et al.  Human social motor solutions for human–machine interaction in dynamical task contexts , 2019, Proceedings of the National Academy of Sciences.

[41]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[42]  Jun Nakanishi,et al.  Movement imitation with nonlinear dynamical systems in humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[43]  J. A. Scott Kelso,et al.  The Virtual Teacher (VT) Paradigm: Learning New Patterns of Interpersonal Coordination Using the Human Dynamic Clamp , 2015, PloS one.

[44]  Nancy M. Amato,et al.  Shepherding Behaviors with Multiple Shepherds , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[45]  R. Coppinger,et al.  Wolf-pack (Canis lupus) hunting strategies emerge from simple rules in computational simulations , 2011, Behavioural Processes.