Generative multi-robot task and motion planning over long horizons

The state of the art practice in robotics planning is to script behaviors manually, where each behavior is typically precomputed in advance. However, in order for robots to be able to act robustly and adapt to novel situations, they need to be able to plan sequences of behaviors and activities autonomously. Since the conditions and effects of these behaviors are tightly coupled through time, state and control variables, many problems require that the tasks of activity planning and trajectory optimization are considered together. There are two key issues underlying effective hybrid activity and trajectory planning: the sufficiently accurate modeling of robot dynamics and the capability of planning over long horizons. Hybrid activity and trajectory planners that employ mixed integer programming within a discrete time formulation are able to accurately model complex dynamics for robot vehicles, but are often restricted to relatively short horizons. On the other hand, current hybrid activity planners that employ continuous time formulations can handle longer horizons but they only allow actions to have continuous effects with constant rate of change, and restrict the allowed state constraints to linear inequalities. This greatly limits the expressivity of the problems that these approaches can solve. In this work we present Scotty, a planning system for hybrid activity and trajectory planning problems. Unlike other continuous time planners, Scotty can solve a broad class of expressive robotic planning problems by supporting convex quadratic constraints on state variables and control variables that are jointly constrained and that affect multiple state variables simultaneously. In order to efficiently generate practical plans for coordinated mobile robots over long horizons, our approach employs recent methods in convex optimization combined with methods for planning with relaxed planning graphs and heuristic forward search. The contributions of this thesis are threefold. First, we introduce a convex, goaldirected scheduling and trajectory planning problem. To solve this problem, we present the ScottyConvexPath planner, which reformulates the problem as a Second Order Cone Program (SOCP). Our formulation allows us to efficiently compute robot

[1]  Maria Fox,et al.  Modelling Mixed Discrete-Continuous Domains for Planning , 2006, J. Artif. Intell. Res..

[2]  Maria Fox,et al.  Temporal Planning with Semantic Attachment of Non-Linear Monotonic Continuous Behaviours , 2015, IJCAI.

[3]  Bernhard Nebel,et al.  Interval Based Relaxation Heuristics for Numeric Planning with Action Costs , 2017, SOCS.

[4]  Leslie Pack Kaelbling,et al.  A constraint-based method for solving sequential manipulation planning problems , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Brian C. Williams,et al.  Coordinating Agile Systems through the Model-based Execution of Temporal Plans , 2005, AAAI.

[6]  Robin Deits,et al.  Aggressive quadrotor flight through cluttered environments using mixed integer programming , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Hanumant Singh,et al.  Robotic tools for deep water archaeology: Surveying an ancient shipwreck with an autonomous underwater vehicle , 2010, J. Field Robotics.

[8]  Maria Fox,et al.  Heuristic Planning for PDDL+ Domains , 2016, AAAI Workshop: Planning for Hybrid Systems.

[9]  P. Pandurang Nayak,et al.  Remote Agent: To Boldly Go Where No AI System Has Gone Before , 1998, Artif. Intell..

[10]  Sergiy Bogomolov,et al.  Planning as Model Checking in Hybrid Domains , 2014, AAAI.

[11]  R. Castro,et al.  Tracking Hydrocarbon Plume Transport and Biodegradation at Deepwater Horizon , 2010 .

[12]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[13]  Robin Deits,et al.  Computing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming , 2014, WAFR.

[14]  Robert P. Goldman,et al.  SMT-Based Nonlinear PDDL+ Planning , 2015, AAAI.

[15]  Andrew Coles,et al.  Temporal Planning in Domains with Linear Processes , 2009, IJCAI.

[16]  P. Pandurang Nayak,et al.  A Reactive Planner for a Model-based Executive , 1997, IJCAI.

[17]  Chris Murphy,et al.  Deep sea underwater robotic exploration in the ice-covered Arctic ocean with AUVs , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Pieter Abbeel,et al.  Combined task and motion planning through an extensible planner-independent interface layer , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  S. Edelkamp,et al.  The Deterministic Part of IPC-4: An Overview , 2005, J. Artif. Intell. Res..

[20]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Silvia Richter,et al.  The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarks , 2010, J. Artif. Intell. Res..

[23]  Sergiy Bogomolov,et al.  PDDL+ Planning with Hybrid Automata: Foundations of Translating Must Behavior , 2015, ICAPS.

[24]  David Wang,et al.  tBurton: A Divide and Conquer Temporal Planner , 2015, AAAI.

[25]  Maria Fox,et al.  AUV mission control via temporal planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Maria Fox,et al.  Boosting Search Guidance in Problems with Semantic Attachments , 2017, ICAPS.

[27]  Larry Jackel,et al.  The DARPA Robotics Challenge Finals: Results and Perspectives , 2017, J. Field Robotics.

[28]  Brian C. Williams,et al.  Kongming: a generative planner for hybrid systems with temporally extended goals , 2010 .

[29]  S. LaValle,et al.  Randomized Kinodynamic Planning , 2001 .

[30]  Subbarao Kambhampati,et al.  When is Temporal Planning Really Temporal? , 2007, IJCAI.

[31]  Maria Fox,et al.  Exploiting a Graphplan Framework in Temporal Planning , 2003, ICAPS.

[32]  Benedetto Intrigila,et al.  UPMurphi: A Tool for Universal Planning on PDDL+ Problems , 2009, ICAPS.

[33]  Emilio Frazzoli,et al.  Incremental Sampling-based Algorithms for Optimal Motion Planning , 2010, Robotics: Science and Systems.

[34]  Bernhard Nebel,et al.  A Planning Based Framework for Controlling Hybrid Systems , 2012, ICAPS.

[35]  Rina Dechter,et al.  Temporal Constraint Networks , 1989, Artif. Intell..

[36]  David E. Smith,et al.  Temporal Planning with Mutual Exclusion Reasoning , 1999, IJCAI.

[37]  Dmitry Berenson,et al.  No falls, no resets: Reliable humanoid behavior in the DARPA robotics challenge , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[38]  Hector Geffner,et al.  A Polynomial Planning Algorithm that Beats LAMA and FF , 2017, ICAPS.

[39]  Nancy M. Amato,et al.  Approximate convex decomposition of polygons , 2004, SCG '04.

[40]  Daniel S. Weld,et al.  The LPSAT Engine & Its Application to Resource Planning , 1999, IJCAI.

[41]  Masahiro Ono,et al.  Robust, Goal-directed Plan Execution with Bounded Risk , 2012 .

[42]  Robert Mattmüller,et al.  Using the Context-enhanced Additive Heuristic for Temporal and Numeric Planning , 2009, ICAPS.

[43]  Otthein Herzog,et al.  Symbolic discrete-time planning with continuous numeric action parameters for agent-controlled processes , 2016 .

[44]  Hector Geffner,et al.  Best-First Width Search: Exploration and Exploitation in Classical Planning , 2017, AAAI.

[45]  Avrim Blum,et al.  Fast Planning Through Planning Graph Analysis , 1995, IJCAI.

[46]  Tania Bedrax-Weiss,et al.  EUROPA2: Plan Database Services for Planning and Scheduling Applications , 2004 .

[47]  Bernhard Nebel,et al.  Semantic Attachments for Domain-Independent Planning Systems , 2009, ICAPS.

[48]  Robin Deits,et al.  Efficient mixed-integer planning for UAVs in cluttered environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[49]  Brian Charles Williams,et al.  Exploiting Spatial and Temporal Flexibility for Exploiting Spatial and Temporal Flexibility for Plan Execution of Hybrid, Under-actuated Systems , 2010, Cognitive Robotics.

[50]  Bart Selman,et al.  Unifying SAT-based and Graph-based Planning , 1999, IJCAI.

[51]  Brian Charles Williams,et al.  Dynamic Execution of Temporal Plans with Sensing Actions and Bounded Risk , 2015, IJCAI.

[52]  Natàlia Hurtós,et al.  The Kallisti Limnes, carbon dioxide-accumulating subsea pools , 2015, Scientific Reports.

[53]  Subbarao Kambhampati,et al.  Sapa: A Multi-objective Metric Temporal Planner , 2003, J. Artif. Intell. Res..

[54]  Patrik Haslum,et al.  Interval-Based Relaxation for General Numeric Planning , 2016, ECAI.

[55]  Brian C. Williams,et al.  Generative Planning for Hybrid Systems Based on Flow Tubes , 2008, ICAPS.

[56]  Masahiro Ono,et al.  Iterative Risk Allocation: A new approach to robust Model Predictive Control with a joint chance constraint , 2008, 2008 47th IEEE Conference on Decision and Control.

[57]  Maria Fox,et al.  Planning the Behaviour of Low-Cost Quadcopters for Surveillance Missions , 2014, ICAPS.

[58]  Marc Toussaint,et al.  Logic-Geometric Programming: An Optimization-Based Approach to Combined Task and Motion Planning , 2015, IJCAI.

[59]  Maria Fox,et al.  Planning Using Actions with Control Parameters , 2016, ECAI.

[60]  Andrew Coles,et al.  Forward-Chaining Partial-Order Planning , 2010, ICAPS.

[61]  Dylan Hadfield-Menell,et al.  Sequential quadratic programming for task plan optimization , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[62]  Scott Kuindersma,et al.  Optimization-based locomotion planning, estimation, and control design for the atlas humanoid robot , 2015, Autonomous Robots.

[63]  Sangbae Kim,et al.  Online Planning for Autonomous Running Jumps Over Obstacles in High-Speed Quadrupeds , 2015, Robotics: Science and Systems.

[64]  J. Jensen Sur les fonctions convexes et les inégalités entre les valeurs moyennes , 1906 .

[65]  Mark Stefik,et al.  Planning with Constraints (MOLGEN: Part 1) , 1981, Artif. Intell..

[66]  Sylvie Thiébaux,et al.  RAO*: An Algorithm for Chance-Constrained POMDP's , 2016, AAAI.

[67]  Leslie Pack Kaelbling,et al.  FFRob: An Efficient Heuristic for Task and Motion Planning , 2015, WAFR.

[68]  Andreas G. Hofmann Robust execution of bipedal walking tasks from biomechanical principles , 2006 .

[69]  Ji-Ae Shin,et al.  Processes and continuous change in a SAT-based planner , 2005, Artif. Intell..

[70]  Rachid Alami,et al.  A Hybrid Approach to Intricate Motion, Manipulation and Task Planning , 2009, Int. J. Robotics Res..

[71]  Masahiro Ono,et al.  Paper Summary: Probabilistic Planning for Continuous Dynamic Systems under Bounded Risk , 2013, ICAPS.

[72]  Masahiro Ono,et al.  Chance-Constrained Optimal Path Planning With Obstacles , 2011, IEEE Transactions on Robotics.

[73]  Hui Li,et al.  Hybrid Planning with Temporally Extended Goals for Sustainable Ocean Observing , 2011, AAAI.

[74]  J. Ho,et al.  The Metric FF Planning System Translating Ignoring Delete Lists to Numeric State Variables , 2003 .

[75]  Maria Fox,et al.  Combining a Temporal Planner with an External Solver for the Power Balancing Problem in an Electricity Network , 2013, ICAPS.

[76]  Andrew Coles,et al.  COLIN: Planning with Continuous Linear Numeric Change , 2012, J. Artif. Intell. Res..

[77]  Maria Fox,et al.  A Compilation of the Full PDDL+ Language into SMT , 2016, ICAPS.

[78]  Bart Selman,et al.  Planning as Satisfiability , 1992, ECAI.

[79]  Patrik Haslum,et al.  Deterministic planning in the fifth international planning competition: PDDL3 and experimental evaluation of the planners , 2009, Artif. Intell..

[80]  Erez Karpas,et al.  Mixed Discrete-Continuous Planning with Convex Optimization , 2017, AAAI.

[81]  Erez Karpas,et al.  Mixed Discrete-Continuous Heuristic Generative Planning Based on Flow Tubes , 2015, IJCAI.

[82]  Brian C. Williams,et al.  Temporally and spatially flexible plan execution for dynamic hybrid systems , 2017, Artif. Intell..

[83]  Richard M. Murray,et al.  Risk-aware Planning in Hybrid Domains: An Application to Autonomous Planetary Rovers , 2016 .

[84]  Siddhartha S. Srinivasa,et al.  CHOMP: Gradient optimization techniques for efficient motion planning , 2009, 2009 IEEE International Conference on Robotics and Automation.

[85]  Russ Tedrake,et al.  Whole-body motion planning with centroidal dynamics and full kinematics , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[86]  Andrew Coles,et al.  Planning with Problems Requiring Temporal Coordination , 2008, AAAI.

[87]  David Cheng-Ping Wang,et al.  A factored planner for the temporal coordination of autonomous systems , 2015 .

[88]  Robin Deits,et al.  Footstep planning on uneven terrain with mixed-integer convex optimization , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.