Deep Emotion: A Computational Model of Emotion Using Deep Neural Networks

Emotions are very important for human intelligence. For example, emotions are closely related to the appraisal of the internal bodily state and external stimuli. This helps us to respond quickly to the environment. Another important perspective in human intelligence is the role of emotions in decision-making. Moreover, the social aspect of emotions is also very important. Therefore, if the mechanism of emotions were elucidated, we could advance toward the essential understanding of our natural intelligence. In this study, a model of emotions is proposed to elucidate the mechanism of emotions through the computational model. Furthermore, from the viewpoint of partner robots, the model of emotions may help us to build robots that can have empathy for humans. To understand and sympathize with people's feelings, the robots need to have their own emotions. This may allow robots to be accepted in human society. The proposed model is implemented using deep neural networks consisting of three modules, which interact with each other. Simulation results reveal that the proposed model exhibits reasonable behavior as the basic mechanism of emotion.

[1]  M. Lewis,et al.  Developmental change in infants' responses to stress. , 1995, Child development.

[2]  P. Yakovlev.  MOTILITY, BEHAVIOR AND THE BRAIN*: STEREODYNAMIC ORGANIZATION AND NEURAL CO‐ORDINATES OF BEHAVIOR , 1948, The Journal of nervous and mental disease.

[3]  Takayuki Nagai,et al.  Emotion Differentiation based on Decision-Making in Emotion Model , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[4]  Robert Plutchik,et al.  A psychoevolutionary theory of emotions , 1982 .

[5]  A. Damasio.  The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962, Psychological review.

[7]  M. Kage.  A Critical Review of Studies On Intrinsic Motivation , 1994 .

[8]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[9]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[10]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[11]  Neurobiology of emotion , 1986 .

[12]  Takayuki Nagai,et al.  A Model of Emotion for Empathic Communication , 2017, HRI.

[13]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[14]  A. Grabowska,et al.  The Nencki Affective Picture System (NAPS): Introduction to a novel, standardized, wide-range, high-quality, realistic picture database , 2013, Behavior research methods.

[15]  W. K. Simmons,et al.  Interoceptive predictions in the brain , 2015, Nature Reviews Neuroscience.

[16]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[17]  Sigal G. Barsade.  The Ripple Effect: Emotional Contagion and its Influence on Group Behavior , 2002 .

[18]  Hiroshi G. Okuno,et al.  A Recipe for Empathy , 2015, Int. J. Soc. Robotics.

[19]  Joseph E LeDoux.  Cognitive-Emotional Interactions in the Brain , 1989 .

[20]  Takayuki Nagai,et al.  Decision-Making in Emotion Model , 2018, HRI.

[21]  P. Ferrari,et al.  The functional architecture of mother-infant communication, and the development of infant social expressiveness in the first two months , 2016, Scientific Reports.

[22]  S. Umeda,et al.  How does interoceptive awareness interact with the subjective experience of emotion? An fMRI Study , 2011, Human brain mapping.

[23]  Tomoaki Nakamura,et al.  Online Algorithm for Robots to Learn Object Concepts and Language Model , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[24]  Allan Collins,et al.  The Structure of Emotions , 1988 .

[25]  M. Lewis.  Self-Conscious Emotions , 2020, Encyclopedia of Personality and Individual Differences.

[26]  Chu Kiong Loo,et al.  Robotic emotional model with personality factors based on Pleasant-Arousal scaling model , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[27]  A. Fogel,et al.  The temporal structure of face-to-face communication between mothers and infants. , 1980 .

[28]  D. Dutton,et al.  Some evidence for heightened sexual attraction under conditions of high anxiety. , 1974, Journal of personality and social psychology.

[29]  M. Cabanac.  What is emotion? , 2002, Behavioural Processes.

[30]  S. Kuester.  Looking For Spinoza Joy Sorrow And The Feeling Brain , 2016 .

[31]  P. Young,et al.  Emotion and personality , 1963 .

[32]  D. Winnicott.  The theory of the parent-infant relationship. , 1960, The International journal of psycho-analysis.

[33]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[34]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[35]  M. Iacoboni.  Imitation, empathy, and mirror neurons. , 2009, Annual review of psychology.

[36]  J. Movellan,et al.  Infants Time Their Smiles to Make Their Moms Smile , 2015, PloS one.

[37]  Benedek Kurdi,et al.  Introducing the Open Affective Standardized Image Set (OASIS) , 2017, Behavior research methods.

[38]  S. Paradiso.  The Emotional Brain: The Mysterious Underpinnings of Emotional Life , 1998 .

[39]  H. Schlosberg.  Three dimensions of emotion. , 1954, Psychological review.

[40]  Catholijn M. Jonker,et al.  Emotion in reinforcement learning agents and robots: a survey , 2017, Machine Learning.

[41]  Naoyuki Kubota,et al.  Verbal conversation system for a socially embedded robot partner using emotional model , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[42]  A. Jacobs,et al.  The quartet theory of human emotions: An integrative and neurofunctional model. , 2015, Physics of life reviews.

[43]  Matthew D. Lieberman,et al.  Putting Feelings Into Words , 2007, Psychological science.

[44]  Anne L. Foundas,et al.  Clinical Neuroanatomy: A Neurobehavioral Approach , 2007 .

[45]  R. Lazarus.  Emotion and Adaptation , 1991 .

[46]  Alex Graves,et al.  Recurrent Models of Visual Attention , 2014, NIPS.

[47]  Atsuo Takanishi,et al.  Robot personality based on the equations of emotion defined in the 3D mental space , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[48]  J. W. Papez.  A PROPOSED MECHANISM OF EMOTION , 1937 .

[49]  Karl J. Friston,et al.  Active interoceptive inference and the emotional brain , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.