Effect of emotional synchronization using facial expression recognition in human-robot communication

In this paper, we developed a KANSEI communication system between human and robot based on emotional synchronization to human emotional state using facial expression recognition. And we conducted experiments to evaluate the effectiveness of the proposed system. The robot recognizes human emotion through their facial expressions, and synchronizes its own emotion with the recognized emotion dynamically by using a vector field of dynamics. Then the robot expresses its own emotions by facial expressions. In the communication experiment, we found that the subjects' feeling became much comfortable after communicating with the robot in the case of emotional synchronization, while that the subjects felt a little uncomfortable after communicating with the robot in the case of non-synchronization. Meanwhile, subjects in the case of emotional synchronization communicated much more with the robot, and the communication time was as double times as the time when communicated in the case of non-synchronization. Furthermore, subjects communicated in the case of emotional synchronization had good impressions on the robot, and also were much better than the impressions in the case of non-synchronization. So it was confirmed in this study that the emotional synchronization in human-robot communication could be effective to make human keeping a comfortable state and would make the robot much more favorable and acceptable to human.

[1]  J. Russell.  A circumplex model of affect. , 1980 .

[2]  Minoru Hashimoto,et al.  Effects of emotional synchronization in human-robot KANSEI communications , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  L. Lundqvist,et al.  FACIAL EXPRESSIONS ARE CONTAGIOUS , 1995 .

[4]  H. Yamada,et al.  Dimensions of visual information for categorizing facial expressions of emotion , 1993 .

[5]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Minoru Hashimoto,et al.  Robot facial expression using a curved surface display , 2004 .

[7]  Minoru Hashimoto,et al.  Robot facial expression using a curved surface display , 2004, IEEE Conference on Robotics and Automation, 2004. TExCRA Technical Exhibition Based..

[8]  Verlin B. Hinsz,et al.  Smile and (Half) the World Smiles with You, Frown and You Frown Alone , 1991 .

[9]  Pierre Philippot,et al.  Facial Reactions to Emotional Facial Expressions: Affect or Cognition? , 1998 .

[10]  Minoru Hashimoto,et al.  A robotic KANSEI communication system based on emotional synchronization , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Minoru Hashimoto,et al.  Facial expression of a robot using a curved surface display , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.