Predictive State Representations for grounding human-robot communication

Allowing robots to communicate naturally with humans is an important goal for social robotics. Most approaches have focused on building high-level probabilistic cognitive models. However, research in cognitive science shows that people often build common ground for communication with each other by seeking and providing evidence of understanding through behaviors like mimicry. Predictive State Representations (PSRs) allow one to build explicit, low-level models of the expected outcomes of actions, and are therefore well-suited for tasks that require providing such evidence of understanding. Using human-robot shadow puppetry as a prototype interaction study, we show that PSRs can be used successfully to both model human interactions, and to allow a robot to learn on-line how to engage a human in an interesting interaction.

[1]  Leslie Pack Kaelbling,et al.  Grasping POMDPs , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[2]  J. Reznick,et al.  Synchrony, pseudosynchrony, and dissynchrony: Measuring the entrainment process in mothernfant interactions. , 1988 .

[3]  Frank J. Bernieri,et al.  Synchrony, pseudosynchrony, and dissynchrony: Measuring the entrainment process in mother-infant interactions. , 1988 .

[4]  Jesse Hoey,et al.  A planning system based on Markov decision processes to guide people with dementia through activities of daily living , 2006, IEEE Transactions on Information Technology in Biomedicine.

[5]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[6]  Michael H. Bowling,et al.  Online Discovery and Learning of Predictive State Representations , 2005, NIPS.

[7]  Brian Scassellati,et al.  The Grand Challenges in Socially Assistive Robotics , 2007 .

[8]  Jeffrey C. Trinkle,et al.  ShadowPlay: A generative model for nonverbal human-robot interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Illah R. Nourbakhsh,et al.  Planning for Human-Robot Interaction Using Time-State Aggregated POMDPs , 2008, AAAI.

[10]  Richard S. Sutton,et al.  Predictive Representations of State , 2001, NIPS.

[11]  Michael R. James,et al.  Predictive State Representations: A New Theory for Modeling Dynamical Systems , 2004, UAI.

[12]  S. Thrun,et al.  Probablistic Control of Human Robot Interaction : Experiments with A Robotic Assistant for Nursing Homes , 2003 .

[13]  Peter Stone,et al.  Learning Predictive State Representations , 2003, ICML.

[14]  Ben Tse,et al.  Autonomous Inverted Helicopter Flight via Reinforcement Learning , 2004, ISER.

[15]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge: Research Articles , 2006 .

[16]  Brian Scassellati,et al.  Socially assistive robotics [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[17]  G. Semin Grounding communication: Synchrony. , 2007 .