Reactive high-level behavior synthesis for an Atlas humanoid robot

In this work, we take a step towards bridging the gap between the theory of formal synthesis and its application to real-world, complex, robotic systems. In particular, we present an end-to-end approach for the automatic generation of code that implements high-level robot behaviors in a verifiably correct manner, including reaction to the possible failures of low-level actions. We start with a description of the system defined a priori. Thus, a non-expert user need only specify a high-level task. We automatically construct a formal specification, in a fragment of Linear Temporal Logic (LTL), that encodes the system's capabilities and constraints, the task, and the desired reaction to low-level failures. We then synthesize a reactive mission plan that is guaranteed to satisfy the formal specification, i.e., achieve the task's goals or correctly react to failures. Lastly, we automatically generate a state machine that instantiates the synthesized symbolic plan in software. We showcase our approach using Team ViGIR's software and Atlas humanoid robot and present lab experiments, thus demonstrating the application of formal synthesis techniques to complex robotic systems. The proposed approach has been implemented and open-sourced as a collection of Robot Operating System (ROS) packages, which are adaptable to other systems.

[1]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[2]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[3]  J.J. Biesiadecki,et al.  The Mars Exploration Rover surface mobility flight software driving ambition , 2006, 2006 IEEE Aerospace Conference.

[4]  Hadas Kress-Gazit,et al.  LTLMoP: Experimenting with language, Temporal Logic and robot control , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jonathan Bohren,et al.  The SMACH High-Level Executive [ROS News] , 2010 .

[6]  Ufuk Topcu,et al.  Correct, Reactive, High-Level Robot Control , 2011, IEEE Robotics & Automation Magazine.

[7]  Amir Pnueli,et al.  Synthesis of Reactive(1) designs , 2006, J. Comput. Syst. Sci..

[8]  Hadas Kress-Gazit,et al.  Correct high-level robot control from structured English , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Silvia Coradeschi,et al.  A Short Review of Symbol Grounding in Robotic and Intelligent Systems , 2013, KI - Künstliche Intelligenz.

[10]  Hadas Kress-Gazit,et al.  Provably correct continuous control for high-level robot behaviors with actions of arbitrary execution durations , 2013, 2013 IEEE International Conference on Robotics and Automation.

[11]  Georgios E. Fainekos,et al.  Revision of specification automata under quantitative preferences , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Oskar von Stryk,et al.  Template-based manipulation in unstructured environments for supervised semi-autonomous humanoid robots , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[13]  Ufuk Topcu,et al.  Optimization-based trajectory generation with linear temporal logic specifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Calin Belta,et al.  Language-Guided Controller Synthesis for Linear Systems , 2014, IEEE Transactions on Automatic Control.

[15]  Dimos V. Dimarogonas,et al.  Distributed plan reconfiguration via knowledge transfer in multi-agent systems under local LTL specifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Hadas Kress-Gazit,et al.  Timing Semantics for Abstraction and Execution of Synthesized High-Level Robot Control , 2015, IEEE Transactions on Robotics.

[17]  Hadas Kress-Gazit,et al.  Robot Creation from Functional Specifications , 2015, ISRR.

[18]  Doug A. Bowman,et al.  Human‐robot Teaming for Rescue Missions: Team ViGIR's Approach to the 2013 DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[19]  Lydia E. Kavraki,et al.  Towards manipulation planning with temporal logic specifications , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Richard M. Murray,et al.  A multi-paradigm language for reactive synthesis , 2016, SYNT.

[21]  Hadas Kress-Gazit,et al.  Analyzing and revising synthesized controllers for robots with sensing and actuation errors , 2015, Int. J. Robotics Res..

[22]  R. Du,et al.  What Happened at the DARPA Robotics Challenge , and Why ? , 2015 .

[23]  Hadas Kress-Gazit,et al.  Dynamics-driven adaptive abstraction for reactive high-level mission and motion planning , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Lydia E. Kavraki,et al.  This Time the Robot Settles for a Cost: A Quantitative Approach to Temporal Logic Planning with Partial Satisfaction , 2015, AAAI.

[25]  Hadas Kress-Gazit,et al.  Provably correct reactive control from natural language , 2015, Auton. Robots.