Switched and Symmetric Pursuit/Evasion Games Using Online Model Predictive Control With Application to Autonomous Aircraft

This paper describes a supervisory controller for pursuit and evasion of two fixed-wing autonomous aircraft. Novel contributions of the work include the real-time use of model-predictive control, specifically nonlinear model predictive tracking control, for predictions of the vehicle under control, as well as predictions for the adversarial aircraft. In addition to this inclusion, the evasive controller is a hybrid system, providing switching criteria to change modes to become a pursuer based on the current and future state of the vehicle under control, and that of the adversarial aircraft. Results of the controller for equally matched platforms in actual flight tests against a US Air Force trained F-15 test pilot are given. Extensive simulation analysis of the symmetric games is provided, including regressive analysis based on initial conditions of height advantage, and relative velocity vectors, and in particular the effect of allowing the evading aircraft to switch modes between “evader” and “pursuer” during the game.

[1]  Alberto Bemporad,et al.  Dynamic programming for constrained optimal control of discrete-time linear hybrid systems , 2005, Autom..

[2]  S. Shankar Sastry,et al.  Conflict-free navigation in unknown urban environments , 2006, IEEE Robotics & Automation Magazine.

[3]  Max Mulder,et al.  Haptic Feedback in Uninhabited Aerial Vehicle Teleoperation with Time Delay , 2008 .

[4]  Jonathan P. How,et al.  Model predictive control of vehicle maneuvers with guaranteed completion time and robust feasibility , 2003, Proceedings of the 2003 American Control Conference, 2003..

[5]  Rufus Isaacs,et al.  Differential Games , 1965 .

[6]  Ugur Zengin,et al.  Real-Time Target Tracking for Autonomous UAVs in Adversarial Environments: A Gradient Search Algorithm , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[7]  P. Gill,et al.  User's Guide for SOL/NPSOL: A Fortran Package for Nonlinear Programming. , 1983 .

[8]  S. Sastry,et al.  VISION-BASED DETECTION OF AUTONOMOUS VEHICLES FOR PURSUIT-EVASION GAMES , 2002 .

[9]  J. How,et al.  Receding horizon path planning with implicit safety guarantees , 2004, Proceedings of the 2004 American Control Conference.

[10]  Manfred Morari,et al.  Real-time suboptimal model predictive control using a combination of explicit MPC and online optimization , 2008, 2008 47th IEEE Conference on Decision and Control.

[11]  S. Sastry,et al.  Probabilistic pursuit-evasion games: a one-step Nash approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[12]  Alexei Makarenko,et al.  Empirical Evaluation of an Autonomous Vehicle in an Urban Environment , 2007, J. Aerosp. Comput. Inf. Commun..

[13]  S. Le Menec.  Differential games and symbolic programming to calculate a guaranteed aircraft evasion in modern aerial duels , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[14]  Steven M. LaValle,et al.  Game theory as a unifying structure for a variety of robot tasks , 1993, Proceedings of 8th IEEE International Symposium on Intelligent Control.

[15]  J. Sprinkle,et al.  Encoding aerial pursuit/evasion games with fixed wing aircraft into a nonlinear model predictive tracking controller , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[16]  Alexei Makarenko,et al.  Model-based design: a report from the trenches of the DARPA Urban Challenge , 2009, Software & Systems Modeling.

[17]  Marcello R. Napolitano,et al.  Modeling and control issues for autonomous aerial refueling for UAVs using a probe–drogue refueling system , 2004 .

[18]  C.J. Tomlin,et al.  Automatic Parameter Identification via the Adjoint Method, with Application to Understanding Planar Cell Polarity , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[19]  Robert R. Bitmead,et al.  Performance and Computational Implementation of Nonlinear Model Predictive Control on a Submarine , 2000 .

[20]  Guido Herrmann,et al.  Advanced Strategies in Control Systems with Input and Output Constraints , 2006 .

[21]  S. Shankar Sastry,et al.  An External Active-Set Strategy for Solving Optimal Control Problems , 2009, IEEE Transactions on Automatic Control.

[22]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[23]  S. Shankar Sastry,et al.  Decentralized nonlinear model predictive control of multiple flying robots , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[24]  Prasad,et al.  Envelope Protection in Autonomous Unmanned Aerial Vehicles , 2003 .

[25]  S. Shankar Sastry,et al.  Nonlinear model predictive tracking control for rotorcraft-based unmanned aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[26]  M. Morari,et al.  Explicit Model Predictive Control , 2007 .

[27]  J. Sprinkle,et al.  Implementing and testing a nonlinear model predictive tracking controller for aerial pursuit/evasion games on a fixed wing aircraft , 2005, Proceedings of the 2005, American Control Conference, 2005..

[28]  Robert L. Shaw,et al.  Fighter Combat: Tactics and Maneuvering , 1985 .

[29]  Jan M. Maciejowski,et al.  Predictive control : with constraints , 2002 .