How to Evaluate Models of User Affect?

Modeling user affect is becoming increasingly important for intelligent interfaces and agents that aim to establish believable interactions with their users. However, evaluating the accuracy and effectiveness of affective user models is extremely challenging because of the many unknowns in affect comprehension. In this paper, we overview existing approaches related to the validation of affective user models, and we describe our own experience with an approach for direct model evaluation that we have used in a recent study.

[1]  J. E. Ball,et al.  Modeling the Emotional State of Computer Users , 1999 .

[2]  P. Costa,et al.  Four ways five factors are basic , 1992 .

[3]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[4]  Cristina Conati,et al.  A Study on Using Biometric Sensors for Monitoring User Emotions in Educational Games , 2003 .

[5]  Elisabeth André,et al.  Exploiting emotions to disambiguate dialogue acts , 2004, IUI '04.

[6]  Robert Hubal,et al.  Extracting Emotional Information from the Text of Spoken Dialog , 2003 .

[7]  Christine L. Lisetti,et al.  Emotion recognition from physiological signals using wireless sensors for presence technologies , 2004, Cognition, Technology & Work.

[8]  Christine L. Lisetti,et al.  Emotion Recognition from Physiological Signals for User Modeling of Affect , 2003 .

[9]  Mitsuru Ishizuka,et al.  Using Bio-signals to Track the Efiects of a Character-based Interface , 2003 .

[10]  Cristina Conati,et al.  Building and evaluating an intelligent pedagogical agent to improve the effectiveness of an educational game , 2004, IUI '04.

[11]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Michael D. McNeese,et al.  Assessment of User Affective and Belief States for Interface Adaptation: Application to an Air Force Pilot Task , 2002, User Modeling and User-Adapted Interaction.

[13]  Stacy Marsella,et al.  Evaluating a General Model of Emotional Appraisal and Coping , 2004, AAAI 2004.

[14]  Cristina Conati,et al.  Inferring user goals from personality and behavior in a causal model of user affect , 2003, IUI '03.

[15]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[16]  Jennifer Healey,et al.  SmartCar: detecting driver stress , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.