Hierarchical model predictive control of UAVs performing multitarget-multisensor tracking

Detection and tracking of enemy emitters such as radar-carrying platforms is a task of considerable military significance. In the work presented here, the problem of adaptively controlling the trajectories of an autonomous team of unmanned aerial vehicles (UAVs) performing this task, in order to minimize emitter localization error, while simultaneously avoiding no-fly zones, is considered and a solution developed. Because of the computational complexity of the problem when long-term goals are considered, an optimal solution cannot be found in practice by any physically implementable method. Hence, in this paper an approach is developed that enables implementation of a computationally feasible, suboptimal solution that takes into account both short-term and long-term goals. To this end, the problem is addressed by developing a new hierarchical model predictive control (MPC) algorithm. To evaluate the effectiveness of the approach, first a controller is developed using an idealized UAV model and simulations are performed. Its performance is compared with a commonly used “myopic” control approach and found to give important improvements. Subsequently an improved planner is incorporated and tested, and then a version of the controller using a fixed-wing aircraft model for the UAVs is implemented. This version is also tested by simulation and found to perform successfully. Finally, a brief discussion on system stability is provided as part of the evaluation.

[1]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[2]  R.J. Evans,et al.  Optimal adaptive waveform selection for target detection , 2003, 2003 Proceedings of the International Conference on Radar (IEEE Cat. No.03EX695).

[3]  Don J. Torrieri,et al.  Statistical Theory of Passive Location Systems , 1984, IEEE Transactions on Aerospace and Electronic Systems.

[4]  Marko Bacic,et al.  Model predictive control , 2003 .

[5]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[6]  Eric W. Frew,et al.  Radio Source Localization by a Cooperating UAV Team , 2005 .

[7]  Robin J. Evans,et al.  Networked sensor management and data rate control for tracking maneuvering targets , 2005, IEEE Transactions on Signal Processing.

[8]  P W Singer War of the machines. , 2010, Scientific American.

[9]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[10]  Robin J. Evans,et al.  Hidden Markov model multiarm bandits: a methodology for beam scheduling in multitarget tracking , 2001, IEEE Trans. Signal Process..

[11]  Mark R. Morelande,et al.  Sensor scheduling for multiple target tracking and detection using passive measurements , 2008, 2008 11th International Conference on Information Fusion.

[12]  Robin J. Evans,et al.  Simulation-Based Optimal Sensor Scheduling with Application to Observer Trajectory Planning , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[13]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[14]  Peter William Sarunic,et al.  Hierarchical model predictive control of an unmanned-aerial-vehicle based multitarget-multisensor data fusion system , 2011 .

[15]  Gamini Dissanayake,et al.  Planning under uncertainty using model predictive control for information gathering , 2006, Robotics Auton. Syst..

[16]  H. Witsenhausen Separation of estimation and control for discrete time systems , 1971 .

[17]  Jason Williams,et al.  Radar sensor management for detection and tracking , 2008, 2008 11th International Conference on Information Fusion.

[18]  K. Doganay Online Optimization of Receiver Trajectories for Scan-Based Emitter Localization , 2007, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Robin J. Evans,et al.  Control of unmanned aerial vehicles for passive detection and tracking of multiple emitters , 2009, 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications.

[20]  D.A. Castanon,et al.  Rollout Algorithms for Stochastic Scheduling Problems , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[21]  Y. Oshman,et al.  Optimization of observer trajectories for bearings-only target localization , 1999 .

[22]  Riccardo Scattolini,et al.  Architectures for distributed and hierarchical Model Predictive Control - A review , 2009 .

[23]  Daniel J. Pack,et al.  Localizing RF Targets with Cooperative Unmanned Aerial Vehicles , 2007, 2007 American Control Conference.

[24]  Robin J. Evans,et al.  Trajectory control of autonomous fixed-wing aircraft performing multiple target passive detection and tracking , 2010, 2010 Sixth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[25]  Ying He,et al.  Sensor scheduling for target tracking in sensor networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[26]  Robin J. Evans,et al.  Control of unmanned aerial vehicles performing multiple target passive detection and tracking , 2009, 2009 International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[27]  Vikram Krishnamurthy,et al.  Algorithms for optimal scheduling and management of hidden Markov model sensors , 2002, IEEE Trans. Signal Process..

[28]  R.J. Evans,et al.  Cooperative sensor networks: a stochastic sensor scheduling approach , 2002, Final Program and Abstracts on Information, Decision and Control.

[29]  S. Khosravi,et al.  Constrained model predictive control of hypnosis , 2015 .

[30]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[31]  Kutluyil Dogançay,et al.  Optimal angular sensor separation for AOA localization , 2008, Signal Process..