Balancing Robotic Teleoperation and Autonomy in a Complex and Dynamic Environment

While Artificial Intelligence has been working to produce truly autonomous problem solving agents for many years, the current abilities of such agents are extremely limited. In highly complex, dynamic situations such as disaster rescue, today’s agents simply do not have the ability to perform successfully on their own: the environment is difficult to traverse and even to sense accurately, time is a significant factor, and the dynamic and unpredictable nature of the environment tends to preclude the ability to produce extensive plans for future activity. Because of these and other limitations, robotic agents for environments such as disaster rescue rely strongly on human teleoperation. This too has its limitations: humans become fatigued rapidly, suffer from cognitive overload when they obtain too much sensory information in a short time, and have difficulties in constructing a mental image of the space around a robot given information from its senses (situational awareness). This thesis focuses on combining the limited abilities of an autonomous agent together with human control, in order to produce a teleautonomous system that supports blending the desires of a robot with the wishes of its human controller. The approach I present is intended to allow a human to control a number of robots, being interrupted only when the robots are truly in need, and with the ability to alter the autonomous abilities of the robots for particular contexts. In order to examine the effectiveness of this approach, I develop a simulated domain for disaster rescue using a widely-employed robot simulation tool, and implement this control mode for a set of simulated Pioneer mobile robots. An evaluation of this control mode in comparison to autonomous and teleoperated agents is then presented.

[1]  A. Saffiotti,et al.  Building Globally Consistent Gridmaps from Topologies , 2000 .

[2]  Robin R. Murphy,et al.  Assessment of the NIST Standard Test Bed for Urban Search and Rescue , 2003 .

[3]  B. Tamm International Federation of Automatic Control , 1992, Concise Encyclopedia of Modelling & Simulation.

[4]  Maja J. Mataric,et al.  Integration of representation into goal-driven behavior-based robots , 1992, IEEE Trans. Robotics Autom..

[5]  Ronald C. Arkin,et al.  Multiagent telerobotics: matching systems to tasks , 1999 .

[6]  Rodney A. Brooks,et al.  Elephants don't play chess , 1990, Robotics Auton. Syst..

[7]  R. Arkin,et al.  Behavioral diversity in learning robot teams , 1998 .

[8]  Aaron Khoo,et al.  FlexBot, Groo, Patton and Hamlet: research using computer games as a platform , 2002, AAAI/IAAI.

[9]  Tucker R. Balch,et al.  Motor Schema-Based Formation Control for Multiagent Robot Teams , 1995, ICMAS.

[10]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[11]  Ben J Hicks,et al.  SPIE - The International Society for Optical Engineering , 2001 .

[12]  Robin R. Murphy,et al.  Workflow study on human-robot interaction in USAR , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  R A Brooks,et al.  New Approaches to Robotics , 1991, Science.

[14]  Yu Cao,et al.  A Remote Robotics Laboratory on the Internet , 1998 .

[15]  T. Balch Integrating RL and Behavior-Based Control for Soccer , 1997 .

[16]  Pattie Maes,et al.  Designing autonomous agents: Theory and practice from biology to engineering and back , 1990, Robotics Auton. Syst..

[17]  Pradeep K. Khosla,et al.  Real-time obstacle avoidance using harmonic potential functions , 1991, IEEE Trans. Robotics Autom..

[18]  David Kortenkamp,et al.  Topological Mapping for Mobile Robots Using a Combination of Sonar and Vision Sensing , 1994, AAAI.

[19]  Robin R. Murphy,et al.  A Case Study of How Mobile Robot Competitions Promote Future Research , 2001, RoboCup.

[20]  Lance Self INTRODUCTION TO SOFTWARE AGENTS , 1999 .

[21]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[22]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[23]  Christoph G. Thomas,et al.  A user interface integrating adaptability and adaptivity , 1994 .

[24]  Damian M. Lyons,et al.  Planning as incremental adaptation of a reactive system , 1995, Robotics Auton. Syst..

[25]  Alessandro Saffiotti,et al.  Anchoring Symbols to Sensor Data: Preliminary Report , 2000, AAAI/IAAI.

[26]  Rodney A. Brooks,et al.  A robot that walks; emergent behaviors from a carefully evolved network , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[27]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[28]  Adam Jacoff,et al.  Experiences in Deploying Test Arenas for Autonomous Mobile Robots , 2001 .

[29]  Joelle Pineau,et al.  Experiences with a mobile robotic guide for the elderly , 2002, AAAI/IAAI.

[30]  Ronald C. Arkin,et al.  Reactive control for mobile manipulation , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[31]  Robin R. Murphy,et al.  Mobility and sensing demands in USAR , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[32]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[33]  John Anderson,et al.  A Pragmatic Approach to Robot Rescue: The Keystone Fire Brigade , 2002, AAAI Mobile Robot Competition.

[34]  François Michaud,et al.  Roball, the Rolling Robot , 2002, Auton. Robots.

[35]  Martial Hebert,et al.  Autonomous Driving with Concurrent Goals and Multiple Vehicles: Experiments and Mobility Components , 2002, Auton. Robots.

[36]  David Chapman,et al.  What are plans for? , 1990, Robotics Auton. Syst..

[37]  R. Brooks,et al.  The cog project: building a humanoid robot , 1999 .

[38]  Erann Gat,et al.  Integrating Planning and Reacting in a Heterogeneous Asynchronous Architecture for Controlling Real-World Mobile Robots , 1992, AAAI.

[39]  Robin R. Murphy,et al.  Classifying and Recovering from Sensing Failures in Autonomous Mobile Robots , 1996, AAAI/IAAI, Vol. 2.

[40]  David Chapman,et al.  Penguins Can Make Cake , 1989, AI Mag..

[41]  Pericles A. Mitkas,et al.  MINING PATTERNS AND RULES FOR IMPROVING AGENT INTELLIGENCE THROUGH AN INTEGRATED MULTI-AGENT PLATFORM , 2002 .

[42]  Robin R. Murphy,et al.  Mixed-initiative control of multiple hetrogeneous robots for urban search and rescue , 2000 .

[43]  Ronald C. Arkin,et al.  Cooperative multiagent robotic systems , 1998 .

[44]  Michael A. Goodrich,et al.  Experiments in adjustable autonomy , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[45]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[46]  Mohan M. Trivedi,et al.  Web-based teleautonomy and telepresence , 2000, SPIE Optics + Photonics.

[47]  Gaurav S. Sukhatme,et al.  Most valuable player: a robot device server for distributed control , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[48]  Als-Nscort Eclipse Platform Technical Overview , 2003 .

[49]  Edmund H. Durfee,et al.  UM-PRS: An implementation of the procedural reasoning system for multirobot applications , 1994 .

[50]  Jeffrey M. Bradshaw,et al.  An introduction to software agents , 1997 .

[51]  J. Anderson,et al.  Dimensions of Teleautonomy in Mobile Agents , 2003 .

[52]  Reinhard Oppermann,et al.  Adaptive user support: ergonomic design of manually and automatically adaptable software , 1994 .

[53]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[54]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[55]  Sean Graves,et al.  Action selection in teleautonomous systems , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[56]  Ian Horswill,et al.  Polly: A Vision-Based Artificial Agent , 1993, AAAI.

[57]  Ronald C. Arkin,et al.  Integration of reactive and telerobotic control in multi-agent robotic systems , 1994 .

[58]  Eric Krotkov,et al.  Optimal stereo mast configuration for mobile robots , 1997, Proceedings of International Conference on Robotics and Automation.

[59]  John Anderson,et al.  Minimalist User Modelling in a Complex Commercial Software System , 2000, User Modeling and User-Adapted Interaction.

[60]  Ronald C. Arkin,et al.  Tactical mobile robot mission specification and execution , 1999, Optics East.

[61]  Ronald C. Arkin,et al.  Behavior-Based Robot Navigation for Extended Domains , 1992, Adapt. Behav..

[62]  Tucker R. Balch,et al.  AuRA: principles and practice in review , 1997, J. Exp. Theor. Artif. Intell..

[63]  Ronald C. Arkin,et al.  Design and implementation of a teleautonomous hummer , 1998, Other Conferences.

[64]  Ronald C. Arkin,et al.  Motor Schema — Based Mobile Robot Navigation , 1989, Int. J. Robotics Res..

[65]  Robin R. Murphy,et al.  Strategies for Searching an Area with Semi-Autonomous Mobile Robots , 1996 .

[66]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .