Flexible Command Interpretation on an Interactive Domestic Service Robot

In this paper, we propose a system for robust and flexible command interpretation on a mobile robot in domestic service robotics applications. Existing language processing for instructing a mobile robot often make use of a simple, restricted grammar where precisely pre-defined utterances are directly mapped to system calls. This does not take into account fallibility of human users and only allows for binary processing; either a command is part of the grammar and hence understood correctly, or it is not part of the grammar and gets rejected. We model the language processing as an interpretation process where the utterance needs to be mapped to a robot’s capabilities. We do so by casting the processing as a (decision-theoretic) planning problem on interpretatory actions. This allows for a flexible system that can resolve ambiguities and which is also capable of initiating steps to achieve clarification.

[1]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[2]  Wolfram Burgard,et al.  Integrated, plan-based control of autonomous robot in human environments , 2001, IEEE Intelligent Systems.

[3]  Bernd Ludwig,et al.  Speech Dialogue Systems -- A "Pragmatics-First'' Approach to Rational Interaction , 2002 .

[4]  Mikhail Soutchanski,et al.  Reasoning about Large Taxonomies of Actions , 2008, AAAI.

[5]  J. McCarthy.  Situations, Actions, and Causal Laws , 1963 .

[6]  D. Fox,et al.  Integrated Plan-based Control of Autonomous Service Robots in Human Environments , 2001 .

[7]  R. S. Scowen.  Generic base standards , 1993, Proceedings 1993 Software Engineering Standards Symposium.

[8]  J. Austin.  How to do things with words , 1962 .

[9]  Alex M. Andrew,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2002 .

[10]  S. Ervin-Tripp.  Is Sybil there? the structure of some American English directives , 1976, Language in Society.

[11]  Hector J. Levesque,et al.  GOLOG: A Logic Programming Language for Dynamic Domains , 1997, J. Log. Program..

[12]  Craig Boutilier,et al.  Decision-Theoretic, High-Level Agent Programming in the Situation Calculus , 2000, AAAI/IAAI.

[13]  Bernd Ludwig,et al.  Speech Dialogue Systems — A Pragmatics-Guided Approach to Rational Interaction , 2003 .

[14]  Raymond Reiter,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2001 .

[15]  Gerhard Lakemeyer,et al.  A Robust Speech Recognition System for Service-Robotics Applications , 2008, RoboCup.

[16]  John R. Searle,et al.  Speech Acts: An Essay in the Philosophy of Language , 1970 .

[17]  Rachid Alami,et al.  A study of interaction between dialog and decision for human-robot collaborative task achievement , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[18]  Alexander Ferrein,et al.  Logic-based robot control in highly dynamic domains , 2008, Robotics Auton. Syst..

[19]  Terrence Fong,et al.  Collaboration, Dialogue, Human-Robot Interaction , 2001, ISRR.

[20]  John G. Gibbons.  Knowledge in Action , 2001 .

[21]  Hector J. Levesque,et al.  Speech Acts and Rationality , 1985, ACL.

[22]  F. Inglis.  How To Do Things With Words. , 1971 .

[23]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[24]  Luca Iocchi,et al.  RoboCup@Home: Scientific Competition and Benchmarking for Domestic Service Robots , 2009 .

[25]  Stuart M. Shieber,et al.  Evidence against the context-freeness of natural language , 1985 .