Learning to understand questions on the task history of a service robot

We present a novel approach to enable a mobile service robot to understand questions about the history of tasks it has executed. We frame the problem of understanding such questions as grounding an input sentence to a query that can be executed on the logs recorded by the robot during its runs. We define a query as an operation followed by a set of filters. In order to ground sentence to a query we introduce a joint probabilistic model. The model is composed by a shallow semantic parser and a knowledge base to store and re-use the groundings of a sentence. The Knowledge Base and its predicates are designed to match the structure of a query. Our results show that, by using such Knowledge Base, the approach proposed requires fewer and fewer corrections as users interact with the system.

[1]  Kai Chen,et al.  The Intelligent Techniques in Robot KeJia - The Champion of RoboCup@Home 2014 , 2014, RoboCup.

[2]  Luke S. Zettlemoyer,et al.  Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions , 2013, TACL.

[3]  Anind K. Dey,et al.  Why and why not explanations improve the intelligibility of context-aware intelligent systems , 2009, CHI.

[4]  Matthew R. Walter,et al.  Understanding Natural Language Commands for Robotic Navigation and Mobile Manipulation , 2011, AAAI.

[5]  Terry Winograd,et al.  Procedures As A Representation For Data In A Computer Program For Understanding Natural Language , 1971 .

[6]  Feng Wu,et al.  KeJia Robot-An Attractive Shopping Mall Guider , 2015, ICSR.

[7]  Stephanie Rosenthal,et al.  CoBots: Robust Symbiotic Autonomous Mobile Service Robots , 2015, IJCAI.

[8]  Anind K. Dey Explanations in Context-Aware Systems , 2009, ExaCt.

[9]  Dympna O'Sullivan,et al.  The Role of Explanations on Trust and Reliance in Clinical Decision Support Systems , 2015, 2015 International Conference on Healthcare Informatics.

[10]  Weng-Keen Wong,et al.  Too much, too little, or just right? Ways explanations impact end users' mental models , 2013, 2013 IEEE Symposium on Visual Languages and Human Centric Computing.

[11]  Albert S. Huang,et al.  Natural language command of an autonomous micro-air vehicle , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Jake K. Aggarwal,et al.  BWIBots: A platform for bridging the gap between AI and human–robot interaction research , 2017, Int. J. Robotics Res..

[13]  Lucas Beyer,et al.  The STRANDS Project: Long-Term Autonomy in Everyday Environments , 2016, IEEE Robotics & Automation Magazine.

[14]  Manuela M. Veloso,et al.  The 1,000-km Challenge: Insights and Quantitative and Qualitative Results , 2016, IEEE Intelligent Systems.

[15]  Angel X. Chang,et al.  SUTime: A library for recognizing and normalizing time expressions , 2012, LREC.

[16]  John B. Lowe,et al.  The Berkeley FrameNet Project , 1998, ACL.

[17]  Charles J. Fillmore,et al.  Frames and the semantics of understanding , 1985 .

[18]  Maya Cakmak,et al.  Robot Programming by Demonstration with situated spatial language understanding , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Luke S. Zettlemoyer,et al.  Learning to Parse Natural Language Commands to a Robot Control System , 2012, ISER.

[20]  Stephanie Rosenthal,et al.  Verbalization: Narration of Autonomous Robot Experience , 2016, IJCAI.

[21]  Odest Chadwicke Jenkins,et al.  RoboFrameNet: Verb-centric semantics for actions in robot middleware , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  Stefanie Tellex,et al.  Toward understanding natural language directions , 2010, HRI 2010.

[23]  Manuela M. Veloso,et al.  Learning Task Knowledge from Dialog and Web Access , 2015, Robotics.

[24]  Kristiina Jokinen,et al.  Dialogues with Social Robots - Enablements, Analyses, and Evaluation, Seventh International Workshop on Spoken Dialogue Systems, IWSDS 2016, Saariselkä, Finland, January 13-16, 2016 , 2017, International Workshop on Spoken Dialogue Systems Technology.