SELF-LEARNING AGENTS: A CONNECTIONIST THEORY OF EMOTION BASED ON CROSSBAR VALUE JUDGMENT

This article presents a computational theory of emotions, based on the theory of emotion as value judgment and appraisal. It assumes that what we feel about other people, events, and things, generally indicates how we evaluate them. The basic assumption is that emotion is an internal self-evaluation of something relevant for the existence of the agent, like self-evaluation of the global state the agent is in, and the behavior the agent is about to perform. This work presents an agent architecture which contains the three components of the control system in biological systems?the genetic, neural, and hormonal component. As distillate of the theory, a working architecture that implements value judgment is presented. The architecture is based on a crossbar connectionist adaptive array, which is designed in a way that it computes from the same crossbar memory elements, both emotions toward encountered situations and emotions toward action tendencies. In such a way it actually builds in hardware, inseparable connections between emotions and behavior. This article gives an instantiation of the architecture and describes a learning experiment to illustrate the emotion learning. A discussion that relates this work to other work reinforcement learning and current research in emotion learning agents is also provided.

[1]  C. Elliott The affective reasoner: a process model of emotions in a multi-agent system , 1992 .

[2]  J. Hernández,et al.  TESTING THE ROLE OF ATTRIBUTION AND APPRAISAL IN PREDICTING OWN AND OTHER'S EMOTIONS , 1998 .

[3]  G. Reeke Marvin Minsky, The Society of Mind , 1991, Artif. Intell..

[4]  K. Scherer Criteria for emotion-antecedent appraisal: A review. , 1988 .

[5]  Jaak Panksepp,et al.  Neurochemical control of moods and emotions: Amino acids to neuropeptides. , 1993 .

[6]  J. Hallam,et al.  Exploring the Role of Emotions in Autonomous Robot Learning , 1998 .

[7]  M. Dyer Emotions and their computations: Three computer models , 1987 .

[8]  M. Cabanac What is emotion? , 2002, Behavioural Processes.

[9]  N. Frijda,et al.  Relations among emotion, appraisal, and emotional action readiness , 1989 .

[10]  L. Rauch The Origin of Our Knowledge of Right and Wrong , 1969 .

[11]  J. Velásquez Modeling Emotion-Based Decision-Making , 1998 .

[12]  E. Rolls A Theory of Emotion, and its Application to Understanding the Neural Basis of Emotion , 1990 .

[13]  Aaron Sloman,et al.  Why Robots Will Have Emotions , 1981, IJCAI.

[14]  Ian Wright,et al.  Reinforcement Learning and Animat Emotions , 1996 .

[15]  Keith Oatley,et al.  Appraisal, computational models, and scherer's expert system , 1994 .

[16]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[17]  J. S. Albus,et al.  The role of world modeling and value judgement in perception , 1990, Proceedings. 5th IEEE International Symposium on Intelligent Control 1990.

[18]  O. Michel,et al.  Emotion-based Hierarchical Reinforcement Learning , 2003, HIS.

[19]  H. Simon,et al.  Motivational and emotional controls of cognition. , 1967, Psychological review.

[20]  S. Ferdinand Formalism in Ethics and Non-Formal Ethics of Values , 1973 .

[21]  F. Busetti Genetic algorithms overview , 2000 .

[22]  Juan David Velásquez,et al.  Modeling Emotions and Other Motivations in Synthetic Agents , 1997, AAAI/IAAI.

[23]  S. Kaiser,et al.  Situated emotional problem solving in interactive computer games 1 , 1996 .

[24]  Thomas Wehrle,et al.  Motivations behind modeling emotional agents: Whose emotion does your robot have? , 1998 .

[25]  Maja J. Matarić,et al.  What Are Emotions For? Commitments Management and Regulation Within Animals/Animats Encounters , 1996 .

[26]  P. Young,et al.  Emotion and personality , 1963 .

[27]  Sean A. Spence,et al.  Descartes' Error: Emotion, Reason and the Human Brain , 1995 .

[28]  D. Cicchetti Emotion and Adaptation , 1993 .

[29]  N. Frijda,et al.  Can computers feel? Theory and design of an emotional system , 1987 .

[30]  J. Eccles The emotional brain. , 1980, Bulletin et memoires de l'Academie royale de medecine de Belgique.

[31]  Marvin Minsky,et al.  K-Lines: A theory of Memory , 1980, Cogn. Sci..

[32]  Helder Coelho,et al.  Emotion-Based Attention Shift in Autonomous Agents , 1997, ATAL.

[33]  Rolf Pfeifer,et al.  Artificial Intelligence Models of Emotion , 1988 .

[34]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[35]  Stevo Bozinovski,et al.  Emotion, Embodiment, and Consequence Driven Systems , 1996 .

[36]  Bruce Blumberg,et al.  No Bad Dogs: Ethological Lessons for Learning in Hamsterdam* , 1999 .

[37]  K. Scherer Studying the emotion-antecedent appraisal process: An expert system approach , 1993 .

[38]  A. Clark An embodied cognitive science? , 1999, Trends in Cognitive Sciences.

[39]  Dolores Cañamero,et al.  Modeling motivations and emotions as a basis for intelligent behavior , 1997, AGENTS '97.

[40]  P. Petta,et al.  Towards a Tractable Appraisal-Based Architecture for Situated Cognizers , 1998 .

[41]  Ira J. Roseman Appraisal Determinants of Emotions: Constructing a More Accurate and Comprehensive Theory , 1996 .