Applications of hybrid reachability analysis to robotic aerial vehicles

The control of complex non-linear systems can be aided by modeling each system as a collection of simplified hybrid modes, with each mode representing a particular operating regime defined by the system dynamics or by a region of the state space in which the system operates. Guarantees on the safety and performance of such hybrid systems can still be challenging to generate, however. Reachability analysis using a dynamic game formulation with Hamilton—Jacobi methods provides a useful way to generate these types of guarantees, and the technique is flexible enough to analyze a wide variety of systems. This paper presents two applications of reachable sets, both focused on guaranteeing the safety and performance of robotic aerial vehicles. In the first example, reachable sets are used to design and implement a backflip maneuver for a quadrotor helicopter. In the second, reachability analysis is used to design a decentralized collision avoidance algorithm for multiple quadrotors. The theory for both examples is explained, and successful experimental results are presented from flight tests on the STARMAC quadrotor helicopter platform.

[1]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[2]  Joel W. Burdick,et al.  Stabilization of Systems with Changing Dynamics , 1998, HSCC.

[3]  Stephen P. Boyd,et al.  Distributed optimization for cooperative agents: application to formation flight , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[4]  Bengt Lennartson,et al.  Controller Design of Hybrid Systems , 1997, HART.

[5]  S. Shankar Sastry,et al.  Decentralized nonlinear model predictive control of multiple flying robots , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[6]  Pieter Abbeel,et al.  An Application of Reinforcement Learning to Aerobatic Helicopter Flight , 2006, NIPS.

[7]  Eric Feron,et al.  Decentralized Cooperative Trajectory Planning of Multiple Aircraft with Hard Safety Guarantees , 2004 .

[8]  Claire J. Tomlin,et al.  Mobile Sensor Network Control Using Mutual Information Methods and Particle Filters , 2010, IEEE Transactions on Automatic Control.

[9]  J. Lygeros,et al.  A game theoretic approach to controller design for hybrid systems , 2000, Proceedings of the IEEE.

[10]  Claire J. Tomlin,et al.  Quadrotor Helicopter Trajectory Tracking Control , 2008 .

[11]  M. Falcone,et al.  Numerical Methods for Pursuit-Evasion Games via Viscosity Solutions , 1999 .

[12]  C. Tomlin,et al.  Decentralized optimization, with application to multiple aircraft coordination , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[13]  Magnus Egerstedt,et al.  Path Planning and Flight Controller Scheduling for an Autonomous Helicopter , 1999, HSCC.

[14]  Lorenz T. Biegler,et al.  Dynamic Optimization Strategies for Three-Dimensional Conflict Resolution of Multiple Aircraft , 2004 .

[15]  Pieter Abbeel,et al.  Apprenticeship learning for helicopter control , 2009, CACM.

[16]  Claire J. Tomlin,et al.  Quadrotor Helicopter Flight Dynamics and Control: Theory and Experiment , 2007 .

[17]  Ian M. Mitchell,et al.  A Toolbox of Level Set Methods , 2005 .

[18]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  R. Olfati-Saber,et al.  Collision avoidance for multiple agent systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[20]  Claire J. Tomlin,et al.  Design and Analysis of Hybrid Systems, with Applications to Robotic Aerial Vehicles , 2009, ISRR.

[21]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[22]  Daniel E. Koditschek,et al.  Sequential Composition of Dynamically Dexterous Robot Behaviors , 1999, Int. J. Robotics Res..

[23]  K.J. Kyriakopoulos,et al.  Decentralized stabilization and collision avoidance of multiple air vehicles with limited sensing capabilities , 2005, Proceedings of the 2005, American Control Conference, 2005..

[24]  Claire J. Tomlin,et al.  Decentralized cooperative collision avoidance for acceleration constrained vehicles , 2008, 2008 47th IEEE Conference on Decision and Control.

[25]  Alexei Makarenko,et al.  Scalable Control of Decentralised Sensor Platforms , 2003, IPSN.

[26]  Hadas Kress-Gazit,et al.  Translating Structured English to Robot Controllers , 2008, Adv. Robotics.

[27]  S. Shankar Sastry,et al.  Reachability calculations for automated aerial refueling , 2008, 2008 47th IEEE Conference on Decision and Control.

[28]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[29]  Claire J. Tomlin,et al.  Design of guaranteed safe maneuvers using reachable sets: Autonomous quadrotor aerobatics in theory and practice , 2010, 2010 IEEE International Conference on Robotics and Automation.

[30]  Alexandre M. Bayen,et al.  Invariance-Preserving Abstractions of Hybrid Systems: Application to User Interface Design , 2008, IEEE Transactions on Control Systems Technology.

[31]  Mircea Lazar,et al.  Synthesis of Trajectory-Dependent Control Lyapunov Functions by a Single Linear Program , 2009, HSCC.

[32]  T. Murphey,et al.  Switching Rules for Decentralized Control with Simple Control Laws , 2007, 2007 American Control Conference.

[33]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[34]  S. Shankar Sastry,et al.  Optimal Coordinated Motions of Multiple Agents Moving on a Plane , 2003, SIAM J. Control. Optim..

[35]  P. Saint-Pierre,et al.  Set-Valued Numerical Analysis for Optimal Control and Differential Games , 1999 .

[36]  Bernard Mettler,et al.  Flight test and simulation results for an autonomous aerobatic helicopter , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[37]  Munther A. Dahleh,et al.  Maneuver-based motion planning for nonlinear systems with symmetries , 2005, IEEE Transactions on Robotics.

[38]  Claire J. Tomlin.  Controllers for Safety for Continuous Systems , 2009 .

[39]  S. Shankar Sastry,et al.  Conflict resolution for air traffic management: a study in multiagent hybrid systems , 1998, IEEE Trans. Autom. Control..

[40]  Claire J. Tomlin,et al.  Distributed Cooperative Search using Information-Theoretic Costs for Particle Filters, with Quadrotor Applications ∗ , 2006 .

[41]  Oliver Purwin,et al.  Performing aggressive maneuvers using iterative learning control , 2009, 2009 IEEE International Conference on Robotics and Automation.

[42]  Ling Shi,et al.  Virtual attractive-repulsive potentials for cooperative control of second order dynamic vehicles on the Caltech MVWT , 2005, Proceedings of the 2005, American Control Conference, 2005..

[43]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[44]  Y. Kuwata,et al.  Robust Cooperative Decentralized Trajectory Optimization using Receding Horizon MILP , 2007, 2007 American Control Conference.