Behavior model of humanoid robots based on operant conditioning

Personal robots, which are expected to become popular in the near future, are required to be active in work and community life alongside humans. Therefore, we have been developing new mechanisms and functions in order to realize natural bilateral interaction by expressing emotions, behaviors and personality in a human-like manner. We have proposed a mental model with emotion, mood, personality and needs. However, the robot behavior was very simple since the robot shows just a single kind of behavior in response to a robot mental state. In this paper, we present a new behavior model for humanoid robots based on operant conditioning, which is a well-known psychological behavior model. We implemented this new behavior model into the emotion expression humanoid robot WE-4RII (Waseda Eye No.4 Refined II), developed in 2004. Through the experimental evaluations, we confirmed that the robot with the new behavior model could autonomously select suitable behavior for the situation within a predefined behavior list

[1]  Paolo Dario,et al.  Effective emotional expressions with expression humanoid robot WE-4RII: integration of humanoid robot hand RCH-1 , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  Atsuo Takanishi,et al.  Introduction of the need model for humanoid robots to generate active behavior , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[3]  C. L. Hull.  Essentials of behavior , 1974 .

[4]  Paolo Dario,et al.  Design, fabrication and preliminary results of a novel anthropomorphic hand for humanoid robotics: RCH-1 , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[5]  Atsuo Takanishi,et al.  Design and control of 9-DOFs emotion expression humanoid arm , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[6]  Brian Scassellati,et al.  How to build robots that make friends and influence people , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[7]  Masahiro Fujita,et al.  Autonomous behavior control architecture of entertainment humanoid robot SDR-4X , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[8]  Tatsuzo Ishida,et al.  Mechanical system of a small biped entertainment robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[9]  Masahiro Fujita,et al.  Behavior selection and motion modulation in emotionally grounded architecture for QRIO SDR-4XII , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).