Evaluation of affective state estimations using an on-line reporting device during human-robot interactions

In order to develop a friendly and safe interaction between humans and robots, it is essential for the robot to evaluate user's affective states and respond accordingly. However, affective states are typically assessed using offline questionnaires and user reports. In this paper we investigate the use of an online-device for collecting real-time user reports of affective state during interaction with a robot. These reports are compared to both previous survey reports taken after the interaction, and the affective states estimated by an inference system. The aim is to evaluate and characterize the physiological signal-based inference system and determine which factors significantly influence its performance. This analysis will be used in future work, to fine tune the affective estimations by identifying what kind of variations in physiological signals precede or accompany the variations in reported affective states.

[1]  Dana Kulic,et al.  Safe planning for human-robot interaction , 2005 .

[2]  Dana Kulic,et al.  Real-time safety for human - robot interaction , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[3]  J. Russell.  A circumplex model of affect. , 1980 .

[4]  D. Kirsch.  The Sentic Mouse: Developing a tool for Measuring Emotional Valence , 1997 .

[5]  Changchun Liu,et al.  An empirical study of machine learning techniques for affect recognition in human–robot interaction , 2006, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Jonathan Klein,et al.  Frustrating the user on purpose: a step toward building an affective computer , 2002, Interact. Comput..

[7]  M. Bradley,et al.  Measuring emotion: Behavior, feeling, and physiology , 2000 .

[8]  Dana Kulic,et al.  Affective State Estimation for Human–Robot Interaction , 2007, IEEE Transactions on Robotics.

[9]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[10]  M. Bradley,et al.  Emotion and motivation. , 2007 .

[11]  Carson Reynolds.  Designing for Affective Interactions , 2001 .

[12]  Alin Albu-Schaffer,et al.  Safety in Human-Robot Interaction , 2008 .

[13]  Dana Kulic,et al.  Physiological and subjective responses to articulated robot motion , 2006, Robotica.

[14]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[15]  Kerstin Dautenhahn,et al.  Methodological issues using a comfort level device in human-robot interactions , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[16]  B. Parkinson,et al.  Emotion and motivation , 1995 .

[17]  Dana Kulic,et al.  Anxiety detection during human-robot interaction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Dana Kulic,et al.  Real-time safety for human - robot interaction , 2005 .

[19]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Nilanjan Sarkar,et al.  Online stress detection using psychophysiological signals for implicit human-robot cooperation , 2002, Robotica.

[21]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[22]  Dana Kulic,et al.  Pre-collision safety strategies for human-robot interaction , 2007, Auton. Robots.

[23]  Nilanjan Sarkar,et al.  Anxiety detecting robotic system – towards implicit human-robot collaboration , 2004, Robotica.

[24]  P. Lang.  The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[25]  Kerstin Dautenhahn,et al.  Empirical results from using a comfort level device in human-robot interaction studies , 2006, HRI '06.

[26]  Elizabeth A. Croft,et al.  On line - Affective state monitoring device design , 2007 .

[27]  Veikko Surakka,et al.  Pupillary responses to emotionally provocative stimuli , 2000, ETRA.