A generic natural language interface for task planning — application to a mobile robot

Abstract This paper presents a generic natural language interface that can be applied to the teleoperation of different kinds of complex interactive systems. Through this interface the operators can ask for simple actions or more complex tasks to be executed by the system. Complex tasks will be decomposed into simpler actions generating a network of actions whose execution will result in the accomplishment of the required task. As a practical application, the system has been applied to the teleoperation of a real mobile robot, allowing the operator to move the robot in a partially structured environment through natural language sentences.

[1]  Mallory Selfridge,et al.  A natural language interface to a robot assembly system , 1986, IEEE J. Robotics Autom..

[2]  Terry Winograd,et al.  Understanding natural language , 1974 .

[3]  Jianwei Zhang,et al.  Instructing cooperating assembly robots through situated dialogues in natural language , 1997, Proceedings of International Conference on Robotics and Automation.

[4]  Wu-chun Feng,et al.  Map data processing in geographic information systems , 1989, Computer.

[5]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[6]  Oliviero Stock.  Natural language in multimodal human-computer interface , 1994, IEEE Expert.

[7]  Jay G. Wilpon,et al.  SAM: a perceptive spoken language-understanding robot , 1992, IEEE Trans. Syst. Man Cybern..

[8]  Mark C. Torrance,et al.  Natural communication with robots , 1994 .

[9]  Rachid Alami,et al.  PRS: a high level supervision and control language for autonomous mobile robots , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[10]  Eduardo F. Camacho,et al.  Natural Language Interface in Control Application to a Pilot Plant , 1992 .

[11]  Eduardo F. Camacho,et al.  Application of a Natural Language Interface to the Teleoperation of a Mobile Robot , 1998 .

[12]  Patrick Henry Winston,et al.  The psychology of computer vision , 1976, Pattern Recognit..

[13]  Yong K. Hwang,et al.  Interactive task planning through natural language , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[14]  Larry R. Harris.  ROBOT: a high performance natural language processor for data base query , 1977, SGAR.