A barebones communicative robot based on social contingency and Infomax Control

In this paper, we present a barebones robot which is capable of interacting with humans based on social contingency. It expands the previous work of a contingency detector into having both human-model updating (developmental capability) and policy improvement (learning capability) based on the framework of Infomax control. The proposed new controller interacts with humans in both active and responsive ways handling the turn-taking between them.

[1]  J. Watson.  Smiling, cooing, and "the game." , 1972 .

[2]  J.R. Movellan,et al.  An Infomax Controller for Real Time Detection of Social Contingency , 2005, Proceedings. The 4nd International Conference on Development and Learning, 2005..

[3]  Ian D. Watson,et al.  Using reinforcement learning for city site selection in the turn-based strategy game Civilization IV , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[4]  Fumihide Tanaka,et al.  Daily HRI evaluation at a classroom environment: reports from dance interaction experiments , 2006, HRI '06.