Hebbian Plasticity in CPG Controllers Facilitates Self-Synchronization for Human-Robot Handshaking

It is well-known that human social interactions generate synchrony phenomena which are often unconscious. If the interaction between individuals is based on rhythmic movements, synchronized and coordinated movements will emerge from the social synchrony. This paper proposes a plausible model of plastic neural controllers that allows the emergence of synchronized movements in physical and rhythmical interactions. The controller is designed with central pattern generators (CPG) based on rhythmic Rowat-Selverston neurons endowed with neuronal and synaptic Hebbian plasticity. To demonstrate the interest of the proposed model, the case of handshaking is considered because it is a very common, both physically and socially, but also, a very complex act in the point of view of robotics, neuroscience and psychology. Plastic CPGs controllers are implemented in the joints of a simulated robotic arm that has to learn the frequency and amplitude of an external force applied to its effector, thus reproducing the act of handshaking with a human. Results show that the neural and synaptic Hebbian plasticity are working together leading to a natural and autonomous synchronization between the arm and the external force even if the frequency is changing during the movement. Moreover, a power consumption analysis shows that, by offering emergence of synchronized and coordinated movements, the plasticity mechanisms lead to a significant decrease in the energy spend by the robot actuators thus generating a more adaptive and natural human/robot handshake.

[1]  Ludovic Righetti,et al.  Programmable central pattern generators: an application to biped locomotion control , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[2]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[3]  J. Kelso,et al.  From the Cover : The phi complex as a neuromarker of human social coordination , 2007 .

[4]  Per G. Reinhall,et al.  Coupled van der Pol oscillators as a simplified model for generation of neural patterns for jellyfish locomotion , 2006 .

[5]  R. Harris-Warrick Neuromodulation and flexibility in Central Pattern Generator networks , 2011, Current Opinion in Neurobiology.

[6]  J. Kelso,et al.  The human dynamic clamp as a paradigm for social interaction , 2014, Proceedings of the National Academy of Sciences.

[7]  Ralf Der,et al.  Self-Organized Behavior Generation for Musculoskeletal Robots , 2017, Front. Neurorobot..

[8]  K. Nakayama,et al.  Adaptation aftereffects in the perception of gender from biological motion. , 2006, Journal of vision.

[9]  Pedro Rodriguez-Ayerbe,et al.  Model of rhythmic ball bouncing using a visually controlled neural oscillator. , 2017, Journal of neurophysiology.

[10]  Keir G Pearson,et al.  Generating the walking gait: role of sensory feedback. , 2004, Progress in brain research.

[11]  Kiyotoshi Matsuoka,et al.  Mechanisms of frequency and pattern control in the neural rhythm generators , 1987, Biological Cybernetics.

[12]  P. Hall,et al.  The handshake as interaction , 1983 .

[13]  Gordon Cheng,et al.  Multi-layered multi-pattern CPG for adaptive locomotion of humanoid robots , 2014, Biological Cybernetics.

[14]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[15]  H. Salarieh,et al.  Decentralized control of rhythmic activities in fully-actuated/under-actuated robots , 2018, Robotics Auton. Syst..

[16]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[17]  Thomas Kindermann,et al.  Walknet--a biologically inspired network to control six-legged walking , 1998, Neural Networks.

[18]  Lucy E. Spardy,et al.  A dynamical systems analysis of afferent control in a neuromechanical model of locomotion: II. Phase asymmetry. , 2011, Journal of neural engineering.

[19]  Hiroshi Shimizu,et al.  Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment , 1991, Biological Cybernetics.

[20]  Shigeki Sugano,et al.  A role of multi-modal rhythms in physical interaction and cooperation , 2012, EURASIP J. Audio Speech Music. Process..

[21]  J. Kelso,et al.  Social coordination dynamics: Measuring human bonding , 2008, Social neuroscience.

[22]  Gentaro Taga,et al.  A model of the neuro-musculo-skeletal system for anticipatory adjustment of human locomotion during obstacle avoidance , 1998, Biological Cybernetics.

[23]  Auke Ijspeert,et al.  Modeling discrete and rhythmic movements through motor primitives: a review , 2010, Biological Cybernetics.

[24]  Denis Mottet,et al.  The dynamics of goal-directed rhythmical aiming , 1999, Biological Cybernetics.

[25]  Taegyo Kim,et al.  From the motor cortex to the movement and back again , 2017, PloS one.

[26]  Patrick Henaff,et al.  Measurement and analysis of physical parameters of the handshake between two persons according to simple social contexts , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  E. Marder,et al.  Central pattern generators and the control of rhythmic movements , 2001, Current Biology.

[28]  Minoru Hashimoto,et al.  Human-Robot Handshaking using Neural Oscillators , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[29]  Ludovic Righetti,et al.  Toward simple control for complex, autonomous robotic applications: combining discrete and rhythmic motor primitives , 2011, Auton. Robots.

[30]  Simon M. Danner,et al.  Central control of interlimb coordination and speed‐dependent gait expression in quadrupeds , 2016, The Journal of physiology.

[31]  J. Bastin,et al.  Prospective strategies underlie the control of interceptive actions. , 2006, Human movement science.

[32]  Frank J. Bernieri,et al.  The influence of handshakes on first impression accuracy , 2011 .

[33]  Mohamed Chetouani,et al.  Interpersonal Synchrony: A Survey of Evaluation Methods across Disciplines , 2012, IEEE Transactions on Affective Computing.

[34]  Jianwei Zhang,et al.  A Survey on CPG-Inspired Control Models and System Implementation , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[35]  E. Zehr,et al.  Possible contributions of CPG activity to the control of rhythmic human arm movement. , 2004, Canadian journal of physiology and pharmacology.

[36]  Patrick Henaff,et al.  On the Role of Sensory Feedbacks in Rowat–Selverston CPG to Improve Robot Legged Locomotion , 2010, Front. Neurorobot..

[37]  Poramate Manoonpong,et al.  Fast Dynamical Coupling Enhances Frequency Adaptation of Oscillators for Robotic Locomotion Control , 2017, Front. Neurorobot..

[38]  A. Ijspeert,et al.  Dynamic hebbian learning in adaptive frequency oscillators , 2006 .

[39]  S. Rossignol,et al.  Dynamic sensorimotor interactions in locomotion. , 2006, Physiological reviews.

[40]  Gordon Cheng,et al.  Learning diverse motor patterns with a single multi-layered multi-pattern CPG for a humanoid robot , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[41]  Pedro Rodríguez-Ayerbe,et al.  Dynamic Stability of Repeated Agent-Environment Interactions During the Hybrid Ball-bouncing Task , 2017, ICINCO.

[42]  Martin Buss,et al.  Comparison of people's responses to real and virtual handshakes within a virtual environment , 2011, Brain Research Bulletin.

[43]  Bülent İrfanoğlu,et al.  A Test Bench to Study Bioinspired Control for Robot Walking , 2011 .

[44]  S Grillner,et al.  Central pattern generators for locomotion, with special reference to vertebrates. , 1985, Annual review of neuroscience.

[45]  D. McCrea,et al.  Modelling spinal circuitry involved in locomotor pattern generation: insights from deletions during fictive locomotion , 2006, The Journal of physiology.

[46]  E. Marder,et al.  Principles of rhythmic motor pattern generation. , 1996, Physiological reviews.

[47]  Andrej Gams,et al.  On-line frequency adaptation and movement imitation for rhythmic robotic tasks , 2011, Int. J. Robotics Res..

[48]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[49]  W. Chaplin,et al.  Handshaking, gender, personality, and first impressions. , 2000, Journal of personality and social psychology.

[50]  Allen I. Selverston,et al.  Oscillatory Mechanisms in Pairs of Neurons Connected with Fast Inhibitory Synapses , 1997, Journal of Computational Neuroscience.

[51]  A. Pikovsky,et al.  Synchronization: Theory and Application , 2003 .

[52]  Sten Grillner,et al.  Biological Pattern Generation: The Cellular and Computational Logic of Networks in Motion , 2006, Neuron.

[53]  A. Selverston,et al.  Modeling the gastric mill central pattern generator of the lobster with a relaxation-oscillator network. , 1993, Journal of neurophysiology.

[54]  Daniel Cattaert,et al.  Adaptive motor control in crayfish , 2001, Progress in Neurobiology.

[55]  D. Schiffrin Handwork as Ceremony: The Case of the Handshake , 1974 .

[56]  M. Turvey,et al.  Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. , 1990, Journal of experimental psychology. Human perception and performance.