Testing an assistive fetch robot with spatial language from older and younger adults

Methods and experimental results are presented for interpreting 3D spatial language descriptions used for human to robot communication in a fetch task. The work is based on human subject experiments in which spatial language descriptions were logged from younger and older adult participants. A spatial language model is proposed, and methods are presented for translating natural spatial language descriptions into robot commands that allow the robot to find the requested object. Robot command representation and robot behavior are also discussed. Experimental results compare path metrics of the robot system and human subjects in a common simulation environment. The overall success rate of the robot trials is 85%.

[1]  Daniel Jurafsky,et al.  Learning to Follow Navigational Directions , 2010, ACL.

[2]  Gabriel A Radvansky,et al.  Walking through doorways causes forgetting: Situation models and experienced space , 2006, Memory & cognition.

[3]  Laura A. Carlson,et al.  Formulating Spatial Descriptions across Various Dialogue Contexts , 2009, Spatial Language and Dialogue.

[4]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[5]  Gabriel A Radvansky,et al.  Walking through Doorways Causes Forgetting: Further Explorations , 2011, Quarterly journal of experimental psychology.

[6]  Matthew R. Walter,et al.  Approaching the Symbol Grounding Problem with Probabilistic Graphical Models , 2011, AI Mag..

[7]  Benjamin Kuipers,et al.  A Hierarchy of Qualitative Representations for Space , 1998, Spatial Cognition.

[8]  Matthew R. Walter,et al.  Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation , 2011, AAAI.

[9]  Marjorie Skubic,et al.  Strategies for Human-Driven Robot Comprehension of Spatial Descriptions by Older Adults in a Robot Fetch Task , 2014, Top. Cogn. Sci..

[10]  L. Carlson,et al.  Investigating Spatial Language for Robot Fetch Commands , 2012 .

[11]  Takayuki Kanda,et al.  Pointing to space: modeling of deictic interaction referring to regions , 2010, HRI 2010.

[12]  J. Juang,et al.  PID Control Using Presearched Genetic Algorithms for a MIMO System , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Jenay M. Beer,et al.  The domesticated robot: Design guidelines for assisting older adults to age in place , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Ferdinando Fornara,et al.  Robots in a domestic setting: a psychological approach , 2005, Universal Access in the Information Society.

[15]  Marjorie Skubic,et al.  Spatial language for human-robot dialogs , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Benjamin Kuipers,et al.  Integrating Vision and Spatial Reasoning for Assistive Navigation , 1998, Assistive Technology and Artificial Intelligence.

[17]  Luke S. Zettlemoyer,et al.  Learning to Parse Natural Language Commands to a Robot Control System , 2012, ISER.

[18]  Laurent Wendling,et al.  A New Way to Represent the Relative Position between Areal Objects , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Stefanie Tellex,et al.  Toward understanding natural language directions , 2010, HRI 2010.

[20]  Marjorie Skubic,et al.  Human-Driven Spatial Language for Human-Robot Interaction , 2011, Human-Robot Interaction in Elder Care.

[21]  Marjorie Skubic,et al.  Spatial language experiments for a robot fetch task , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).