Character-based Interfaces Adapting to Users' Autonomic Nervous System Activity

This paper explores some possibilities of using real-time processing of users’ physiological signals in order to improve the interaction with character-based interfaces. Specifically, interfaces that adapt to or reflect a user’s affective state as derived from the user’s autonomic nervous system activity will be discussed. The ‘Emotion Mirror’ is an example of a system where the user’s emotions are reflected back to the user, and hence allows to train emotion management and regulation. The ‘Emphatic Companion’ is an extension of the previous system employing a decision-theoretic embodied agent that adapts its behavior depending the recognized emotional state of the user, e.g. by giving support and encouragement. A simple virtual job interview scenario has been implemented to illustrate the potential of considering physiological data of users in real-time. key words: Affective Computing, adaptive user interfaces, realtime emotion recognition, autonomic nervous system (ANS), bio-signals, life-like characters, decision networks, web-based environments.

[1]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[2]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[3]  Cynthia LeRouge,et al.  Developing multimodal intelligent affective interfaces for tele-home health care , 2003, Int. J. Hum. Comput. Stud..

[4]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[5]  R. Levenson Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. , 1988 .

[6]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[8]  T. Bickmore Relational agents : effecting change through human-computer relationships , 2003 .

[9]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[10]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[11]  Mitsuru Ishizuka,et al.  Persona Effect Revisited --- Using Bio-signals to Measure and Reflect the Impact of Character-bas , 2003 .

[12]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[13]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[14]  P. Ekman,et al.  Autonomic nervous system activity distinguishes among emotions. , 1983, Science.