Human-robot collaborative high-level control with application to rescue robotics

Motivated by the DARPA Robotics Challenge (DRC), the application of operator assisted (semi-)autonomous robots with highly complex locomotion and manipulation abilities is considered for solving complex tasks in potentially unknown and unstructured environments. Because of the limited a priori knowledge about the state of the environment and tasks needed to achieve a complex mission, a sufficiently complete a priori design of high level robot behaviors is not possible. Most of the situational knowledge required for such behavior design is gathered only during runtime and needs to be interpreted by a human operator. However, current behavior control approaches only allow for very limited adaptation at runtime and no flexible operator interaction. In this paper an approach for definition and execution of complex robot behaviors based on hierarchical state machines is presented, allowing to flexibly change the structure of behaviors on the fly during runtime through assistance of a remote operator. The efficiency of the proposed approach is demonstrated and evaluated not only in an example scenario, but also by application in two robot competitions.

[1]  François Michaud,et al.  Behavior-Based Systems , 2008, Springer Handbook of Robotics.

[2]  George K. I. Mann,et al.  Behavior-modulation technique in mobile robotics using fuzzy discrete event system , 2006, IEEE Transactions on Robotics.

[3]  H. Ekanayake,et al.  Behavior-based Robotics And The Reactive Paradigm A Survey , 2008, 2008 11th International Conference on Computer and Information Technology.

[4]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[5]  Michael A. Goodrich,et al.  Experiments in adjustable autonomy , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[6]  Tucker R. Balch,et al.  Behavior-based code generation for robots and autonomous agents , 2014, SimuTools.

[7]  Jenay M. Beer,et al.  Toward a framework for levels of robot autonomy in human-robot interaction , 2014, Journal of human-robot interaction.

[8]  Sven Behnke,et al.  Hierarchical and State-based Architectures for Robot Behavior Planning and Control , 2018, ArXiv.

[9]  Maarten Sierhuis,et al.  The Fundamental Principle of Coactive Design: Interdependence Must Shape Autonomy , 2010, COIN@AAMAS&MALLOW.

[10]  Jonathan Bohren,et al.  The SMACH High-Level Executive [ROS News] , 2010 .

[11]  Szilveszter Kovács A Flexible Fuzzy Behaviour-based Control Structure , 2003 .

[12]  M. J. Johnson Coactive Design: Designing Support for Interdependence in Human-Robot Teamwork , 2014 .

[13]  Doug A. Bowman,et al.  Human‐robot Teaming for Rescue Missions: Team ViGIR's Approach to the 2013 DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[14]  R. Du,et al.  What Happened at the DARPA Robotics Challenge , and Why ? , 2015 .

[15]  Max Risler,et al.  Behavior control for single and multiple autonomous agents based on hierarchical finite state machines , 2010 .

[16]  Minoru Asada,et al.  Behavior coordination for a mobile robot using modular reinforcement learning , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[17]  Twan Koolen,et al.  Summary of Team IHMC's virtual robotics challenge entry , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).