Co-creation of human-robot interaction rules through response prediction and habituation/dishabituation

A joint learning approach is described that meets a major challenge with social robots — developing a methodology for learning communicative behaviors. We focus on interaction rule that is relationship between a robot's action and a partner's response. In this approach a robot is simultaneously a learner and proposer of interaction rules. The human partner and robot continuously search for and co-create new rules as inspired by the social games played between an infant and a caregiver. A simple and universal scheme with response prediction and habituation/dishabituation was developed, and a robot model was built using the scheme. The robot generates actions, observes the partner's response, and get to predict them. It identifies relationships between its actions and the responses, and generates actions designed to elicit particular responses from the partner. After it is habituated to the responses, it generates other actions to search for other rules. In experiments of human-robot interaction based on this model and using a ball, different patterns of interaction emerged, such as passing the ball back and forth, rolling and catching, and feint passing. Response prediction and appropriate habituation supported the emergence of interactions, indicating that the scheme and the model are effective. This joint learning should lead to natural communication between human partners and social robots beyond teach/taught relationship.

[1]  Yasuo Kuniyoshi,et al.  Acquisition of Human-Robot Interaction Rules via Imitation and Response Observation , 2008, SAB.

[2]  J. Bruner,et al.  Games, social exchange and the acquisition of language , 1978, Journal of Child Language.

[3]  Masahiro Fujita,et al.  On activating human communications with pet-type robot AIBO , 2004, Proceedings of the IEEE.

[4]  Cynthia Breazeal,et al.  Learning From and About Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots , 2005, Artificial Life.

[5]  M. West,et al.  The infant's changing role in mother-infant games: The growth of social skills , 1979 .

[6]  M. Asada,et al.  Caregiver’s sensorimotor magnets lead infant’s vowel acquisition through auto mirroring , 2008, 2008 7th IEEE International Conference on Development and Learning.

[7]  Takanori Shibata,et al.  Effects of robot-assisted activity for elderly people and nurses at a day service center , 2004, Proceedings of the IEEE.

[8]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[9]  Daniel N. Stern,et al.  The First Relationship: Infant and Mother , 1977 .

[10]  Naoto Iwahashi,et al.  Computational model of role reversal imitation through continuous human-robot interaction , 2007, WMISI '07.

[11]  M. Ricard,et al.  Comprehension of Rules and Structures in MotherInfant Games: A Longitudinal Study of the First Two Years of Life , 1995 .

[12]  Cristian S. Calude The mathematical theory of information , 2007 .

[13]  Takayuki Kanda,et al.  Robot behavior adaptation for human-robot interaction based on policy gradient reinforcement learning , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  P. Rochat The infant's world , 2001 .