An Adaptive Agent Model for Emotion Reading by Mirroring Body States and Hebbian Learning

In recent years, the topic of emotion reading has increasingly received attention from researchers in Cognitive Science and Artificial Intelligence. To study this phenomenon, in this paper an adaptive agent model is presented with capabilities to interpret another agent's emotions. The presented agent model is based on recent advances in neurological context. First a non-adaptive agent model for emotion reading is described involving (preparatory) mirroring body states of the other agent. Here emotion reading is modelled taking into account the Simulation Theory perspective as known from the literature, involving the own body states and emotions in reading somebody else's emotions. This models an agent that first develops the same feeling, and after feeling the emotion imputes it to the other agent. Next the agent model is extended to an adaptive model based on a Hebbian learning principle to develop a direct connection between a sensed stimulus concerning another agent's body state (e.g., face expression) and the emotion recognition state. In this adaptive agent model the emotion is imputed to the other agent before it is actually felt. The agent model has been designed based on principles of neural modelling, and as such has a close relation to a neurological realisation.

[1]  Maja Pantic,et al.  Automatic Recognition of Facial Expressions and Human Emotions , 2007 .

[2]  M. Iacoboni Understanding Others: Imitation, Language, Empathy , 2002 .

[3]  H. Bekkering,et al.  Is human imitation based on a mirror-neurone system? Some behavioural evidence , 2002, Experimental Brain Research.

[4]  Tibor Bosse,et al.  A Language and Environment for Analysis of Dynamics by Simulation , 2005, Int. J. Artif. Intell. Tools.

[5]  Thomas S. Huang,et al.  Emotion Recognition from Facial Expressions using Multilevel HMM , 2000 .

[6]  Amy Coplan Simulating Minds: The Philosophy, Psychology, and Neuroscience of Mindreading by goldman, alvin , 2008 .

[7]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[8]  A. Goldman,et al.  Simulationist models of face-based emotion recognition , 2005, Cognition.

[9]  Michael A. Arbib,et al.  Mirror neurons and imitation: A computationally guided review , 2006, Neural Networks.

[10]  G. Rizzolatti,et al.  Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons , 2002, Science.

[11]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[12]  D. Wolpert,et al.  Mental state inference using visual control parameters. , 2005, Brain research. Cognitive brain research.

[13]  G. Rizzolatti,et al.  Neurophysiological mechanisms underlying the understanding and imitation of action , 2001, Nature Reviews Neuroscience.

[14]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[15]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[16]  Tibor Bosse,et al.  Formalisation of Damasio’s theory of emotion, feeling and core consciousness , 2008, Consciousness and Cognition.

[17]  Maja Pantic,et al.  Expert system for automatic analysis of facial expressions , 2000, Image Vis. Comput..

[18]  Eytan Ruppin,et al.  The evolution of imitation and mirror neurons in adaptive agents , 2005, Cognitive Systems Research.

[19]  Jan Treur,et al.  Cognitive and Biological Agent Models for Emotion Reading , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[20]  Marco Iacoboni,et al.  The Mirror Neuron System and Imitation , 2011 .

[21]  A. Damasio The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 1999 .

[22]  G. Rizzolatti,et al.  Mirror neurons responding to the observation of ingestive and communicative mouth actions in the monkey ventral premotor cortex , 2003, The European journal of neuroscience.

[23]  Dare A. Baldwin,et al.  Intentions and Intentionality: Foundations of Social Cognition , 2001 .

[24]  Tibor Bosse,et al.  An Adaptive Emotion Reading Model , 2009 .

[25]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[26]  Tibor Bosse,et al.  Adaptive Estimation of Emotion Generation for an Ambient Agent Model , 2008, AmI.