Hopf Bifurcations in Complex Multiagent Activity: The Signature of Discrete to Rhythmic Behavioral Transitions

Most human actions are composed of two fundamental movement types, discrete and rhythmic movements. These movement types, or primitives, are analogous to the two elemental behaviors of nonlinear dynamical systems, namely, fixed-point and limit cycle behavior, respectively. Furthermore, there is now a growing body of research demonstrating how various human actions and behaviors can be effectively modeled and understood using a small set of low-dimensional, fixed-point and limit cycle dynamical systems (differential equations). Here, we provide an overview of these dynamical motor primitives and detail recent research demonstrating how these dynamical primitives can be used to model the task dynamics of complex multiagent behavior. More specifically, we review how a task-dynamic model of multiagent shepherding behavior, composed of rudimentary fixed-point and limit cycle dynamical primitives, can not only effectively model the behavior of cooperating human co-actors, but also reveals how the discovery and intentional use of optimal behavioral coordination during task learning is marked by a spontaneous, self-organized transition between fixed-point and limit cycle dynamics (i.e., via a Hopf bifurcation).

[1]  Aude Billard,et al.  Unravelling socio-motor biomarkers in schizophrenia , 2017, npj Schizophrenia.

[2]  Brett R. Fajen,et al.  Behavioral Dynamics of Human Locomotion , 2004 .

[3]  L. W.,et al.  The Theory of Sound , 1898, Nature.

[4]  Dagmar Sternad,et al.  Towards a Unified Theory of Rhythmic and Discrete Movements — Behavioral, Modeling and Imaging Results , 2008 .

[5]  R. Coppinger,et al.  Wolf-pack (Canis lupus) hunting strategies emerge from simple rules in computational simulations , 2011, Behavioural Processes.

[6]  F. Huddle Coordination , 1966, Open Knowledge Institutions.

[7]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.

[8]  Patrick Nalepka,et al.  Human social motor solutions for human–machine interaction in dynamical task contexts , 2019, Proceedings of the National Academy of Sciences.

[9]  P. N. Kugler,et al.  On the concept of coordinative structures as dissipative structures: i , 1980 .

[10]  Patrick Nalepka,et al.  Employing Models of Human Social Motor Behavior for Artificial Agent Trainers , 2020, AAMAS.

[11]  Brett R. Fajen,et al.  Affordance-Based Control of Visually Guided Action , 2007 .

[12]  Michael J. Richardson,et al.  Dynamics of Interpersonal Coordination , 2008 .

[13]  C. Shea,et al.  Target width scaling in a repetitive aiming task: switching between cyclical and discrete units of action , 2006, Experimental Brain Research.

[14]  Dagmar Sternad,et al.  The primacy of rhythm: how discrete actions merge into a stable rhythmic pattern. , 2019, Journal of neurophysiology.

[15]  Peter J. Beek,et al.  Dynamical Models of Movement Coordination , 1995 .

[16]  Shinya Kotosaka,et al.  Submitted to: IEEE International Conference on Humanoid Robotics Nonlinear Dynamical Systems as Movement Primitives , 2022 .

[17]  Dagmar Sternad,et al.  Dynamic primitives of motor behavior , 2012, Biological Cybernetics.

[18]  Balth van der Pol Jun. Doct.Sc. LXXXV. On oscillation hysteresis in a triode generator with two degrees of freedom , 1922 .

[19]  Yoram Singer,et al.  Dynamical encoding of cursive handwriting , 2004, Biological Cybernetics.

[20]  Andrew J. King,et al.  Solving the shepherding problem: heuristics for herding autonomous, interacting agents , 2014, Journal of The Royal Society Interface.

[21]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[22]  Michael J. Richardson,et al.  Comparing the attractor strength of intra- and interpersonal interlimb coordination using cross-recurrence analysis , 2008, Neuroscience Letters.

[23]  Robert E. Shaw,et al.  Inquiry into intentional systems I: Issues in ecological physics , 1990 .

[24]  P. Beek,et al.  Discrete and cyclical movements: unified dynamics or separate control? , 2004, Acta psychologica.

[25]  Laure Fernandez,et al.  Fitts' law is not continuous in reciprocal aiming , 2009, Proceedings of the Royal Society B: Biological Sciences.

[26]  P. N. Kugler,et al.  1 On the Concept of Coordinative Structures as Dissipative Structures: I. Theoretical Lines of Convergence* , 1980 .

[27]  Dagmar Sternad,et al.  Optimal control of a hybrid rhythmic-discrete task: the bouncing ball revisited. , 2010, Journal of neurophysiology.

[28]  Michael Breakspear,et al.  A Canonical Model of Multistability and Scale-Invariance in Biological Systems , 2012, PLoS Comput. Biol..

[29]  R. Schmidt,et al.  Evaluating the Dynamics of Unintended Interpersonal Coordination , 1997 .

[30]  Roderich Groß,et al.  Shepherding with robots that do not compute , 2017, ECAL.

[31]  M. Turvey,et al.  Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. , 1990, Journal of experimental psychology. Human perception and performance.

[32]  D W Repperger,et al.  The intentional spring: a strategy for modeling systems that learn to perform intentional acts. , 1992, Journal of motor behavior.

[33]  CYNTHIA G. D'VINCENT,et al.  VOCALIZATION AND COORDINATED FEEDING BEHAVIOR OF THE HUMPBACK WHALE IN SOUTHEASTERN ALASKA , 2017 .

[34]  N. Hogan,et al.  On rhythmic and discrete movements: reflections, definitions and implications for motor control , 2007, Experimental Brain Research.

[35]  Philippe Lefèvre,et al.  A Computational Model for Rhythmic and Discrete Movements in Uni- and Bimanual Coordination , 2009, Neural Computation.

[36]  Kevin Shockley,et al.  Interpersonal Synergies , 2010, Front. Psychology.

[37]  J. Kelso,et al.  Skilled actions: a task-dynamic approach. , 1987, Psychological review.

[38]  W. Warren Collective Motion in Human Crowds , 2018, Current directions in psychological science.

[39]  Stefan Schaal,et al.  Interaction of rhythmic and discrete pattern generators in single-joint movements , 2000 .

[40]  J. F. Soechting,et al.  Hand kinematics of piano playing. , 2011, Journal of neurophysiology.

[41]  Dagmar Sternad,et al.  Moving the Arm at Different Rates: Slow Movements are Avoided , 2009, Journal of motor behavior.

[42]  B. Kay The dimensionality of movement trajectories and the degrees of freedom problem: A tutorial , 1988 .

[43]  K G Munhall,et al.  Skill acquisition and development: the roles of state-, parameter, and graph dynamics. , 1992, Journal of motor behavior.

[44]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[45]  Frank T. J. M. Zaal,et al.  Dynamics of reaching for stationary and moving objects: Data and Model , 1999 .

[46]  Michael J. Richardson,et al.  Herd Those Sheep: Emergent Multiagent Coordination and Behavioral-Mode Switching , 2017, Psychological science.

[47]  J. Kelso,et al.  The human dynamic clamp as a paradigm for social interaction , 2014, Proceedings of the National Academy of Sciences.

[48]  Patrick Nalepka,et al.  Practical Applications of Multiagent Shepherding for Human-Machine Interaction , 2019, PAAMS.

[49]  Maurice Lamb,et al.  To Pass or Not to Pass: Modeling the Movement and Affordance Dynamics of a Pick and Place Task , 2017, Front. Psychol..

[50]  J A Kelso,et al.  Space-time behavior of single and bimanual rhythmical movements: data and limit cycle model. , 1987, Journal of experimental psychology. Human perception and performance.

[51]  A. Haith,et al.  Model-based and model-free mechanisms of human motor learning. , 2013, Advances in experimental medicine and biology.

[52]  V K Jirsa,et al.  Recruitment of degrees of freedom stabilizes coordination. , 2000, Journal of experimental psychology. Human perception and performance.

[53]  Brett R. Fajen,et al.  An Affordance-Based Approach to Visually Guided Overtaking , 2015 .

[54]  W. H. Warren The dynamics of perception and action. , 2006, Psychological review.

[55]  Brett R. Fajen,et al.  Behavioral Dynamics of Visually Guided Locomotion , 2008 .

[56]  Michael J. Richardson,et al.  Symmetry-Breaking and the Contextual Emergence of Human Multiagent Coordination and Social Activity , 2016 .

[57]  M. Turvey,et al.  Temporal patterning in cascade juggling. , 1992, Journal of experimental psychology. Human perception and performance.

[58]  Michael J. Richardson,et al.  Distinguishing the noise and attractor strength of coordinated limb movements using recurrence analysis , 2007, Biological Cybernetics.

[59]  Michael J. Richardson,et al.  Movement interference during action observation as emergent coordination , 2009, Neuroscience Letters.

[60]  Polemnia G. Amazeen,et al.  From physics to social interactions: Scientific unification via dynamics , 2018, Cognitive Systems Research.

[61]  Damian G. Stephen,et al.  Dynamics of representational change: entropy, action, and cognition. , 2009, Journal of experimental psychology. Human perception and performance.

[62]  Michael J. Richardson,et al.  Self-organized complementary joint action: Behavioral dynamics of an interpersonal collision-avoidance task. , 2015, Journal of experimental psychology. Human perception and performance.

[63]  Dagmar Sternad,et al.  Transitions between discrete and rhythmic primitives in a unimanual task , 2013, Front. Comput. Neurosci..

[64]  Elliot Saltzman,et al.  A Graph-Dynamic Perspective on Coordinative Structures, the Role of Affordance-Effectivity Relations in Action Selection, and the Self-Organization of Complex Activities , 2015 .

[65]  I. Stewart,et al.  Coupled nonlinear oscillators and the symmetries of animal gaits , 1993 .

[66]  Olivier Stasse,et al.  Modeling of Coordinated Human Body Motion by Learning of Structured Dynamic Representations , 2017, Geometric and Numerical Foundations of Movements.

[67]  P. N. Kugler,et al.  Information, Natural Law, and the Self-Assembly of Rhythmic Movement , 2015 .

[68]  Michael T Turvey,et al.  Affordance-based perception-action dynamics: A model of visually guided braking. , 2016, Psychological review.

[69]  Auke Ijspeert,et al.  Modeling discrete and rhythmic movements through motor primitives: a review , 2010, Biological Cybernetics.

[70]  Denis Mottet,et al.  The dynamics of goal-directed rhythmical aiming , 1999, Biological Cybernetics.

[71]  Patrick Nalepka,et al.  Modeling Embedded Interpersonal and Multiagent Coordination , 2016, COMPLEXIS.