Application of emotion affected associative memory based on mood congruency effects for a humanoid

Emotional factor plays an important role in communication. In the field of psychology, it is known that memory and emotions are closely related to each other. In this paper, we present the significance of emotional factors to associative memory in communication and apply it on human–robot interaction problems. Emotional models for the robot partner are developed, and an interactive robot system with a complex-valued multi-directional associative memory model is proposed. We utilize multi-modal information such as object, gesture, voice, and facial expressions to associate the relationships in associative memory, and generate the emotional information for the robot partner. As a result, the robot partner is able to perform various actions depending on the emotional factors. Results from the interactive experiments indicate possibility of suitable information for communication space being provided from the robot partner.

[1]  Masaki Kobayashi,et al.  Projection Rule for Rotor Hopfield Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[3]  Tzyh Jong Tarn,et al.  Fidelity-Based Probabilistic Q-Learning for Control of Quantum Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Dimitris N. Metaxas,et al.  Tracking Facial Features Using Mixture of Point Distribution Models , 2006, ICVGIP.

[5]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[6]  M. Minsky.  The Society of Mind , 1986 .

[7]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[8]  Masaki Kobayashi,et al.  Complex-valued Multidirectional Associative Memory , 2005 .

[9]  Chu Kiong Loo,et al.  Incremental on-line learning of human motion using Gaussian adaptive resonance hidden Markov model , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[10]  Joseph E LeDoux.  Emotion, memory and the brain. , 1994, Scientific American.

[11]  R. Petty,et al.  Personality moderators of mood congruency effects on cognition: the role of self-esteem and negative mood regulation. , 1995, Journal of personality and social psychology.

[12]  Noest.  Discrete-state phasor neural networks. , 1988, Physical review. A, General physics.

[13]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[14]  Jürgen Adamy,et al.  Towards modelling affect and emotions in autonomous agents with recurrent fuzzy systems , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Naoyuki Kubota,et al.  Multimodal Communication for Human-Friendly Robot Partners in Informationally Structured Space , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[17]  Masafumi Hagiwara.  Multidirectional associative memory , 1990 .

[18]  D. Sperber,et al.  Relevance: Communication and Cognition , 1989 .

[19]  Daniel Reisberg,et al.  Memory and emotion. , 2004 .

[20]  Kuanhao Zheng,et al.  Designing and Implementing a Human–Robot Team for Social Interactions , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  T. Martin McGinnity,et al.  Quantum Neural Network-Based EEG Filtering for a Brain–Computer Interface , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Heekuck Oh,et al.  Adaptation of the relaxation method for learning in bidirectional associative memory , 1994, IEEE Trans. Neural Networks.

[23]  Federico Tombari,et al.  ZNCC-based template matching using bounded partial correlation , 2004 .

[24]  David Cristinacce,et al.  Automatic feature localisation with constrained local models , 2008, Pattern Recognit..

[25]  Y. Osana,et al.  Chaotic Complex-Valued Multidirectional Associative Memory , 2010 .

[26]  Sonia Chernova,et al.  The robot management system: a framework for conducting human-robot interaction studies through crowdsourcing , 2014, HRI 2014.

[27]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999, Journal of personality and social psychology.

[28]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[29]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[30]  Bart Kosko.  Constructing an associative memory , 1987 .

[31]  J. Rychlak.  Introduction to personality and psychotherapy : a theory-construction approach , 1973 .

[32]  Jarrett Webb,et al.  Beginning Kinect Programming with the Microsoft Kinect SDK , 2012, Apress.

[33]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[34]  Pedro Jiménez,et al.  RSMAT: Robust simultaneous modeling and tracking , 2010, Pattern Recognit. Lett..

[35]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[36]  P. Ekman.  An argument for basic emotions , 1992 .

[37]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[38]  J. Russell.  A circumplex model of affect. , 1980 .

[39]  R. Riggio,et al.  Effect of individual differences in nonverbal expressiveness on transmission of emotion , 1981 .

[40]  Tatsuya Kawahara,et al.  Recent Development of Open-Source Speech Recognition Engine Julius , 2009 .

[41]  Wen-June Wang,et al.  A multivalued bidirectional associative memory operating on a complex domain , 1998, Neural Networks.

[42]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[43]  J. Russell,et al.  The Measurement of Affect, Mood, and Emotion: A Guide for Health-Behavioral Research , 2013 .

[44]  Yuko Osana,et al.  Chaotic Complex-Valued Multidirectional Associative Memory with Variable Scaling Factor , 2011, ICANN.

[45]  Naoyuki Kubota,et al.  Cognitive Development in Partner Robots for Information Support to Elderly People , 2011, IEEE Transactions on Autonomous Mental Development.

[46]  Kai-Tai Song,et al.  Robotic Emotional Expression Generation Based on Mood Transition and Personality Model , 2013, IEEE Transactions on Cybernetics.

[47]  Spyros G. Tzafestas,et al.  Quantum learning for neural associative memories , 2006, Fuzzy Sets Syst..

[48]  D. Sperber,et al.  Relevance: Communication and Cognition , 1997 .