Rhythm Patterns Interaction - Synchronization Behavior for Human-Robot Joint Action

Interactive behavior among humans is governed by the dynamics of movement synchronization in a variety of repetitive tasks. This requires the interaction partners to perform for example rhythmic limb swinging or even goal-directed arm movements. Inspired by that essential feature of human interaction, we present a novel concept and design methodology to synthesize goal-directed synchronization behavior for robotic agents in repetitive joint action tasks. The agents’ tasks are described by closed movement trajectories and interpreted as limit cycles, for which instantaneous phase variables are derived based on oscillator theory. Events segmenting the trajectories into multiple primitives are introduced as anchoring points for enhanced synchronization modes. Utilizing both continuous phases and discrete events in a unifying view, we design a continuous dynamical process synchronizing the derived modes. Inverse to the derivation of phases, we also address the generation of goal-directed movements from the behavioral dynamics. The developed concept is implemented to an anthropomorphic robot. For evaluation of the concept an experiment is designed and conducted in which the robot performs a prototypical pick-and-place task jointly with human partners. The effectiveness of the designed behavior is successfully evidenced by objective measures of phase and event synchronization. Feedback gathered from the participants of our exploratory study suggests a subjectively pleasant sense of interaction created by the interactive behavior. The results highlight potential applications of the synchronization concept both in motor coordination among robotic agents and in enhanced social interaction between humanoid agents and humans.

[1]  A. Kristofferson,et al.  Response delays and the timing of discrete motor responses , 1973 .

[2]  Yoshiki Kuramoto,et al.  Chemical Oscillations, Waves, and Turbulence , 1984, Springer Series in Synergetics.

[3]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  J A Kelso,et al.  Dynamic pattern generation in behavioral and neural systems. , 1988, Science.

[5]  M. Turvey,et al.  Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. , 1990, Journal of experimental psychology. Human perception and performance.

[6]  M. Turvey,et al.  Coupling dynamics in interlimb coordination. , 1993, Journal of experimental psychology. Human perception and performance.

[7]  Guan-Chyun Hsieh,et al.  Phase-locked loop techniques. A survey , 1996, IEEE Trans. Ind. Electron..

[8]  F. Paas,et al.  Dwell time in reciprocal aiming tasks , 1996 .

[9]  R. Schmidt,et al.  Evaluating the Dynamics of Unintended Interpersonal Coordination , 1997 .

[10]  M. Rosenblum,et al.  Chapter 9 Phase synchronization: From theory to data analysis , 2001 .

[11]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[12]  Jürgen Kurths,et al.  Synchronization: Phase locking and frequency entrainment , 2001 .

[13]  R Quian Quiroga,et al.  Event synchronization: a simple and fast method to measure synchronicity and time delay patterns. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Yoshihiko Nakamura,et al.  Polynomial design of the nonlinear dynamics for the brain-like information processing of whole body motion , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[15]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[16]  Tamio Arai,et al.  Human-robot cooperative rope turning—an example of mechanical coordination through rhythm entrainment , 2003, Adv. Robotics.

[17]  Jürgen Kurths,et al.  SYNCHRONIZATION APPROACH TO ANALYSIS OF BIOLOGICAL SYSTEMS , 2004, The Random and Fluctuating World.

[18]  Viktor K. Jirsa,et al.  Extending the HKB model of coordinated movement to oscillators with different eigenfrequencies , 2004, Biological Cybernetics.

[19]  Kiyotoshi Matsuoka,et al.  Sustained oscillations generated by mutually inhibiting neurons with adaptation , 1985, Biological Cybernetics.

[20]  Bartlomiej Stanczyk,et al.  Development of a telerobotic system for exploration of hazardous environments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[21]  H. Haken,et al.  A theoretical model of phase transitions in human hand movements , 2004, Biological Cybernetics.

[22]  Stefan Schaal,et al.  Rapid synchronization and accurate phase-locking of rhythmic motor primitives , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  J. Kelso,et al.  The Excitator as a Minimal Model for the Coordination Dynamics of Discrete and Rhythmic Movement Generation , 2005, Journal of motor behavior.

[24]  Minoru Hashimoto,et al.  Human-Robot Handshaking using Neural Oscillators , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[25]  B. Repp.  Sensorimotor synchronization: A review of the tapping literature , 2005, Psychonomic bulletin & review.

[26]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[27]  W. H. Warren.  The dynamics of perception and action. , 2006, Psychological review.

[28]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[29]  Ludovic Righetti,et al.  Movement generation using dynamical systems : a humanoid robot performing a drumming task , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[30]  Ludovic Righetti,et al.  Engineering entrainment and adaptation in limit cycle systems , 2006, Biological Cybernetics.

[31]  Minoru Hashimoto,et al.  Synchronization based control using online design of dynamics and its application to human-robot interaction , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[32]  Michael J. Richardson,et al.  Rocking together: dynamics of intentional and unintentional interpersonal coordination. , 2007, Human movement science.

[33]  N. Hogan,et al.  On rhythmic and discrete movements: reflections, definitions and implications for motor control , 2007, Experimental Brain Research.

[34]  Klaus Lehnertz,et al.  Measuring synchronization in coupled model systems: A comparison of different approaches , 2007 .

[35]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[36]  A. Daffertshofer,et al.  Characteristics of instructed and uninstructed interpersonal coordination while walking side-by-side , 2008, Neuroscience Letters.

[37]  Michael J Richardson,et al.  Period Basin of Entrainment for Unintentional Visual Coordination , 2008, Journal of motor behavior.

[38]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[39]  Ramesh Balasubramaniam,et al.  Two different processes for sensorimotor synchronization in continuous and discontinuous rhythmic movements , 2009, Experimental Brain Research.

[40]  C. Macrae,et al.  The rhythm of rapport: Interpersonal synchrony and social perception , 2009 .

[41]  Xia Zhang,et al.  SBC for motion assist using neural oscillator , 2009, 2009 IEEE International Conference on Robotics and Automation.

[42]  T. Chaminade,et al.  Interpersonal motor coordination: From human–human to human–robot interactions , 2009 .

[43]  Shinya Kotosaka,et al.  Trajectory Generation for Adaptive Motion by Phase Feedback - Synchronization of Multicycle Human Movement - , 2009, J. Robotics Mechatronics.

[44]  Sandra Hirche,et al.  An Architecture for Real-Time Control in Multi-robot Systems , 2009, Human Centered Robot Systems, Cognition, Interaction, Technology.

[45]  Alois Knoll,et al.  Evaluation of a novel biologically inspired trajectory generator in human-robot interaction , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[46]  Shigeki Sugano,et al.  Physical control of the rotation center of an unsupported object rope turning by a humanoid robot , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[47]  J. A. Scott Kelso,et al.  Virtual Partner Interaction (VPI): Exploring Novel Behaviors via Coordination Dynamics , 2009, PloS one.

[48]  Andrej Gams,et al.  On-line learning and modulation of periodic movements with nonlinear dynamical systems , 2009, Auton. Robots.

[49]  Bruno H Repp,et al.  Simultaneous Event-Based and Emergent Timing: Synchronization, Continuation, and Phase Correction , 2010, Journal of motor behavior.

[50]  C. Frith,et al.  Follow you, Follow me: Continuous Mutual Prediction and Adaptation in Joint Tapping , 2010, Quarterly journal of experimental psychology.

[51]  D. DeSteno,et al.  The rhythm of joint action: Synchrony promotes cooperative ability , 2010 .

[52]  Breanna E. Studenka,et al.  Synchronization in repetitive smooth movement requires perceptible events. , 2011, Acta psychologica.

[53]  Sandra Hirche,et al.  Synchronization in a goal-directed task: Human movement coordination with each other and robotic partners , 2011, 2011 RO-MAN.

[54]  Thierry Chaminade,et al.  A Social Cognitive Neuroscience Stance on Human-Robot Interactions , 2011 .

[55]  Andrej Gams,et al.  On-line frequency adaptation and movement imitation for rhythmic robotic tasks , 2011, Int. J. Robotics Res..

[56]  Michael J Richardson,et al.  Computation of continuous relative phase and modulation of frequency of human movement. , 2011, Journal of biomechanics.

[57]  Paula Fitzpatrick,et al.  Understanding social motor coordination. , 2011, Human movement science.

[58]  Event-Based and Emergent Timing: Dichotomy or Continuum? A Reply to Repp and Steinman (2010) , 2011, Journal of motor behavior.

[59]  Azwirman Gusrialdi,et al.  Modeling inter-human movement coordination: synchronization governs joint task dynamics , 2012, Biological Cybernetics.

[60]  B. Repp,et al.  Sensorimotor synchronization: A review of recent research (2006–2012) , 2013, Psychonomic Bulletin & Review.