Proprioception and Imitation: On the Road to Agent Individuation

In this paper, we will show that different kinds of interactive behaviors can emerge according to the kind of proprioceptive function available in a given sensori-motor system. We will study three different examples. In the first one, an internal proprioceptive signal is available for the learning of the visuo-motor coordination between an arm and a camera. An imitation behavior can emerge when the robot’s eye focuses on the hand of the experimenter instead of its own hand. The imitative behavior results from the error minimization between the visual signal and the proprioceptive signal. In the second example, we will show that similar modifications of the robot’s initial dynamics allows to learn some of the space-time properties of more complex behaviors under the form of a sequence of sensori-motor associations. In the third example, a robot head has to recognize the facial expression of the human caregiver. Yet, the robot has no visual feedback of its own facial expression. The human expressive resonance will allow the robot to select the visual features relevant for a particular facial expression. As a result, after few minutes of interactions, the robot can imitates the facial expression of the human partner. We will show that the different proprioceptive signals used in the examples can be seen as bootstrap mechanisms for more complex interactions. Applied as a crude model of the human, we will propose that these mechanisms play an important role in the process of individuation.

[1]  Mathias Quoy,et al.  Resonant spatiotemporal learning in large random recurrent networks , 2002, Biological Cybernetics.

[2]  M. Jeannerod TO ACT OR NOT TO ACT : PERSPECTIVES ON THE REPRESENTATION OF ACTIONS , 1999 .

[3]  Sorin Moga,et al.  From Perception-Action loops to imitation processes , 1998 .

[4]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[5]  Jacqueline Nadel,et al.  Chapitre IV. Imiter et être imité dans le développement de l’intentionnalité , 2002 .

[6]  Rajesh P. N. Rao,et al.  Learning to Imitate Human Actions through Eigenposes , 2010, From Motor Learning to Interaction Learning in Robots.

[7]  Philippe Gaussier,et al.  SPACE-TIME , ORDER , and HIERARCHYin FRONTO-HIPPOCAMPAL SYSTEM : A NEURAL BASIS OF PERSONALITY , 1997 .

[8]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[9]  A. Billard,et al.  A Biologically-Inspired Model of Reaching Movements , 2006 .

[10]  Hideki Kozima,et al.  Attention coupling as a prerequisite for social interaction , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[11]  Philippe Gaussier,et al.  Learning Invariant Sensorimotor Behaviors: A Developmental Approach to Imitation Mechanisms , 2004, Adapt. Behav..

[12]  Gregor Schöner,et al.  Dynamics of behavior: Theory and applications for autonomous robot architectures , 1995, Robotics Auton. Syst..

[13]  A. Berthoz,et al.  Multisensory processing in the elaboration of place and head direction responses by limbic system neurons. , 2002, Brain research. Cognitive brain research.

[14]  Fabien Michel,et al.  Multi-Agent Systems and Simulation: a Survey From the Agents Community's Perspective , 2009 .

[15]  Gordon Cheng,et al.  Complex continuous meaningful humanoid interaction: a multi sensory-cue based approach , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Aude Billard,et al.  Learning of Gestures by Imitation in a Humanoid Robot , 2007 .

[17]  Philippe Gaussier,et al.  Learning new behaviors : Toward a Control Architecture merging Spatial and Temporal modalities , 2009 .

[18]  Sorin Moga,et al.  Learning and communication via imitation: an autonomous robot perspective , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[19]  Hugues Bersini,et al.  Learning Cycles brings Chaos in Continuous Hopfield Networks , 2005 .

[20]  A. Meltzoff,et al.  What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  José Santos-Victor,et al.  Abstraction Levels for Robotic Imitation: Overview and Computational Approaches , 2010, From Motor Learning to Interaction Learning in Robots.

[22]  S. Drell,et al.  TO ACT OR NOT TO ACT , 2007 .

[23]  Arnaud Revel,et al.  Emergence of structured interactions: From a theoretical model to pragmatic robotics , 2009, Neural Networks.

[24]  Philippe Gaussier,et al.  Toward a Cognitive System Algebra: Application to Facial Expression Learning and Imitation , 2003, Embodied Artificial Intelligence.

[25]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[26]  Torsten Ingemann Nielsen,et al.  VOLITION: A NEW EXPERIMENTAL APPROACH , 1963 .

[27]  S. Grossberg,et al.  A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. , 1992, Brain research. Cognitive brain research.

[28]  David Silver,et al.  Learning to search: Functional gradient techniques for imitation learning , 2009, Auton. Robots.

[29]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[30]  Daniel Bullock,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation , 1988 .

[31]  Yves Coiton,et al.  A neural network model for temporal sequence learning and motor programming , 1994, Neural Networks.

[32]  Philippe Gaussier,et al.  The Role of Internal Oscillators for the One-Shot Learning of Complex Temporal Sequences , 2007, ICANN.

[33]  John O'Keefe,et al.  The hippocampal cognitive map and navigational strategies. , 1991 .

[34]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[35]  Sorin Moga,et al.  A Neural Structure for Learning by Imitation , 1999, ECAL.

[36]  J. Banquet,et al.  Chapter 4 Space-time, order, and hierarchy in fronto-hippocampal system: A neural basis of personality , 1997 .

[37]  Sorin Moga,et al.  From Perception-Action Loops to Imitation Processes: A Bottom-Up Approach of Learning by Imitation , 1998, Appl. Artif. Intell..

[38]  Jacqueline Nadel,et al.  Do Children with Autism have Expectancies about the Social Behaviour of Unfamiliar People? , 2000 .

[39]  D. Zipser A computational model of hippocampal place fields. , 1985, Behavioral neuroscience.

[40]  A. Meltzoff,et al.  Imitation of Facial and Manual Gestures by Human Neonates , 1977, Science.

[41]  M. Jeannerod,et al.  Limited conscious monitoring of motor performance in normal subjects , 1998, Neuropsychologia.

[42]  Cynthia Breazeal,et al.  Regulation and Entrainment in Human—Robot Interaction , 2000, Int. J. Robotics Res..

[43]  J. Nadel,et al.  Human responses to an expressive robot , 2006 .

[44]  Hideki Kozima,et al.  Can a robot empathize with people? , 2004, Artificial Life and Robotics.

[45]  M. Jeannerod The 25th Bartlett Lecture , 1999 .

[46]  Jun Nakanishi,et al.  Nonlinear dynamical systems for imitation with humanoid robots , 2001 .