Interacting with an artificial partner: modeling the role of emotional aspects

In this paper we introduce a simple model based on probabilistic finite state automata to describe an emotional interaction between a robot and a human user, or between simulated agents. Based on the agent’s personality, attitude, and nature, and on the emotional inputs it receives, the model will determine the next emotional state displayed by the agent itself. The probabilistic and time-varying nature of the model yields rich and dynamic interactions, and an autonomous adaptation to the interlocutor. In addition, a reinforcement learning technique is applied to have one agent drive its partner’s behavior toward desired states. The model may also be used as a tool for behavior analysis, by extracting high probability patterns of interaction and by resorting to the ergodic properties of Markov chains.

[1]  Alex M. Andrew,et al.  ROBOT LEARNING, edited by Jonathan H. Connell and Sridhar Mahadevan, Kluwer, Boston, 1993/1997, xii+240 pp., ISBN 0-7923-9365-1 (Hardback, 218.00 Guilders, $120.00, £89.95). , 1999, Robotica (Cambridge. Print).

[2]  Luca Chittaro,et al.  Behavioral programming of autonomous characters based on probabilistic automata and personality , 2004, Comput. Animat. Virtual Worlds.

[3]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[4]  J. Rempel,et al.  Attitudes: A new look at an old concept. , 1988 .

[5]  W. James,et al.  What Is an Emotion , 1977 .

[6]  W. James.  II.—WHAT IS AN EMOTION ? , 1884 .

[7]  Paola Campadelli.  LOCALIZATION OF FACIAL FEATURES AND FIDUCIAL POINTS , 2002 .

[8]  R. Ryckman,et al.  Theories of personality , 1989 .

[9]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[10]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Thomas H. Cormen,et al.  Introduction to algorithms [2nd ed.] , 2001 .

[12]  Sonia Chernova,et al.  From Deliberative to Routine Behaviors: A Cognitively Inspired Action-Selection Mechanism for Routine Behavior Capture , 2007, Adapt. Behav..

[13]  M. Cabanac.  What is emotion? , 2002, Behavioural Processes.

[14]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Masayuki Inaba,et al.  PEXIS: Probabilistic experience representation based adaptive interaction system for personal robots , 2004, Systems and Computers in Japan.

[16]  T. Nomura.  Generation of Relations between Individuals based on a Stochastic Automaton and an Analogy from Social Psychology , 2000 .

[17]  Olle Häggström.  Finite Markov Chains and Algorithmic Applications , 2002 .

[18]  Daniel Thalmann,et al.  Abstract muscle action procedures for human face animation , 1988, The Visual Computer.

[19]  I. Kopecek.  Constructing Personality Model from Observed Communication , 2003 .

[20]  Z. Ciota.  Emotion Recognition on the Basis of Human Speech , 2005, 2005 18th International Conference on Applied Electromagnetics and Communications.

[21]  James C. Lester,et al.  Deictic and emotive communication in animated pedagogical agents , 2001 .

[22]  Nadia Bianchi-Berthouze,et al.  Measuring posture features saliency in expressing affective states , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[23]  R. Ryckman,et al.  Theories of personality, 8th ed. , 2004 .

[24]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[25]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[26]  Rosalind W. Picard.  Affective computing: (526112012-054) , 1997 .

[27]  G. Fricchione.  Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[28]  Luca Chittaro,et al.  Behavioral programming of autonomous characters based on probabilistic automata and personality: Research Articles , 2004 .

[29]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[30]  A. Kruglanski,et al.  The Social Psychology of Knowledge , 2010 .

[31]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[32]  Marc Fabri,et al.  The Emotional Avatar: Non-verbal Communication Between Inhabitants of Collaborative Virtual Environments , 1999, Gesture Workshop.

[33]  H. Schlosberg.  Three dimensions of emotion. , 1954, Psychological review.

[34]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[35]  D. Cooke,et al.  Finite Markov Processes and Their Applications , 1981 .

[36]  Prashant Doshi,et al.  Towards Affect-based Approximations to Rational Planning: A Decision-Theoretic Perspective to Emotions , 2004, AAAI 2004.

[37]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[38]  P. Ekman.  An argument for basic emotions , 1992 .

[39]  Minetada Osano,et al.  Towards recognizing emotion with affective dimensions through body gestures , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[40]  M. Buss,et al.  Towards an emotion core based on a hidden Markov model , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[41]  Azaria Paz,et al.  Probabilistic automata , 2003 .

[42]  Azaria Paz,et al.  Introduction to Probabilistic Automata , 1971 .