Behavior Coordination of Socially Interactive Robot using Sentiment Relation Model

Social capability of a robot becomes one of important issues in human-robot interaction (HRI). Especially, for a robot to form a social relationship with people is significant for improving believability of a robot through more natural communication with people. In this paper, we propose a formal approach to make a robot establish and learn a social relationship based on affective relation in sociological perspectives. The main idea is based on representing sentiment relation (liking/disliking) within social individuals, which is regarded as a basis for forming interpersonal relation in sociology. Our Sentiment Relation model can be applied to loyalty implementation of service robots in underlying assumptions that a service robot must have high positive relationship to her host and tends to behave to minimize tension(stress) by unbalanced states, which are generated by different affective states between individuals in social group. To confirm the possibility of our model, the reinforcement learning-based behavior coordination using loyalty level is simulated in the simple grid world.

[1]  K. Dautenhahn,et al.  A Survey of Socially Interactive Robots : Concepts , Design , and Applications , 1992 .

[2]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[3]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[4]  Cynthia Breazeal,et al.  Function meets style: insights from emotion theory applied to HRI , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Z. Zenn Bien,et al.  Steward Robot: Emotional Agent for Subtle Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Paolo Dario,et al.  Effective emotional expressions with expression humanoid robot WE-4RII: integration of humanoid robot hand RCH-1 , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Hokky Situngkir,et al.  Social Balance Theory , 2004, nlin/0405041.

[8]  D. D. Tsankova Emotionally influenced coordination of behaviors for autonomous mobile robots , 2002, Proceedings First International IEEE Symposium Intelligent Systems.

[9]  Christine L. Lisetti,et al.  Can a rational agent afford to be affectless? a formal approach , 2002, Appl. Artif. Intell..

[10]  Christine L. Lisetti,et al.  A social informatics approach to human-robot interaction with a service social robot , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Sandra Clara Gadanho,et al.  Emotion-triggered Learning in Autonomous Robot Control , 2001, Cybern. Syst..

[12]  Eva Hudlicka,et al.  To feel or not to feel: The role of affect in human-computer interaction , 2003, Int. J. Hum. Comput. Stud..

[13]  Weidong Zhou,et al.  A BIOLOGICALLY INSPIRED HIERARCHICAL REINFORCEMENT LEARNING SYSTEM , 2004, Cybern. Syst..

[14]  F. Harary,et al.  STRUCTURAL BALANCE: A GENERALIZATION OF HEIDER'S THEORY1 , 1977 .

[15]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[16]  Zeung nam Bien Steward Robot for Human-friendly Assistive Home Environment , 2006 .

[17]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..