Interruptable Autonomy: Towards Dialog-Based Robot Task Management

We have been successfully deploying mobile service robots in an office building to execute user-requested tasks, such as delivering messages, transporting items, escorting people, and enabling telepresence. Users submit task requests to a dedicated website which forms a schedule of tasks for the robots to execute. The robots autonomously navigate in the building to complete their tasks. However, upon observing the many successful task executions, we realized that the robots are too autonomous in their determination to execute a planned task, with no mechanism to interrupt or redirect the robot through local interaction. In this work, we analyze the challenges of this goal of interruption, and contribute an approach to interrupt the robot anywhere during its execution through spoken dialog. Tasks can then be modified or new tasks can be added through speech, allowing users to manage the robot’s schedule. We discuss the response of the robot to human interruptions. We also introduce a finite state machine based on spoken dialog to handle the conversations that might occur during task execution. The goal is for the robot to fulfill humans’ requests as much as possible while minimizing the impact to the ongoing and pending tasks. We present examples of our task interruption scheme executing on robots to demonstrate its effectiveness.

[1]  Stephanie Rosenthal,et al.  CoBots: Collaborative robots servicing multi-floor buildings , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Joachim Denzler,et al.  MOBSY: Integration of Vision and Dialogue in Service Robots , 2001, ICVS.

[3]  Joochan Sohn,et al.  Deployment of a service robot to help older people , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Manuela M. Veloso,et al.  Dynamic User Task Scheduling for Mobile Robots , 2011, Automated Action Planning for Autonomous Mobile Robots.

[5]  Pierre Lison,et al.  Situated Dialogue Processing for Human-Robot Interaction , 2010, Cognitive Systems.

[6]  Brian Coltin,et al.  Towards Replanning for Mobile Service Robots with Shared Information , 2013 .

[7]  Matthias Scheutz,et al.  Tell me when and why to do it! Run-time planner model updates via natural language instruction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Manuela M. Veloso,et al.  Learning environmental knowledge from task-based human-robot dialog , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Manuela M. Veloso,et al.  Effective Semi-autonomous Telepresence , 2012, RoboCup.

[10]  Thomas Wisspeintner,et al.  RoboCup@Home: Creating and Benchmarking Tomorrows Service Robot Applications , 2007 .

[11]  Manuela M. Veloso,et al.  Using dialog and human observations to dictate tasks to a learning robot assistant , 2008, Intell. Serv. Robotics.

[12]  Alexander Ferrein,et al.  Caesar: an intelligent domestic service robot , 2012, Intell. Serv. Robotics.