Receding horizon controller using particle swarm optimization for closed-loop ground target surveillance and tracking

This paper investigates the problem of non-myopic multiple platform trajectory control in a multiple target search and track setting. It presents a centralized receding discrete time horizon controller (RHC) with variable-step look-ahead for motion planning of a heterogeneous ensemble of airborne sensor platforms. The controller operates in a closed feedback loop with a Multiple Hypothesis Tracker (MHT) that fuses the disparate sensor data to produce target declarations and state estimates. The RHC action space for each air vehicle is represented via maneuver automaton with simple motion primitives. The reward function is based on expected Fisher information gain and priority scaling of target tracks and ground regions. A customized Particle Swarm Optimizer (PSO) is developed to handle the resulting non-Markovian, time-varying, multi-modal, and discontinuous reward function. The algorithms were evaluated by simulating ground surveillance scenarios using representative sensors with varying fields of view and typical target densities and motion profiles. Simulation results show improved aggregate target detection, track accuracy, and track maintenance for closed-loop operation as compared with typical open-loop surveillance plans.

[1]  Ning Xiong,et al.  Multi-sensor management for information fusion: issues and approaches , 2002, Inf. Fusion.

[2]  G.J. Bierman,et al.  Maximum Likelihood Estimation Using Square Root Information Filters , 1989, 1989 American Control Conference.

[3]  David A. Castañón,et al.  Issues in resource management with applications to real-world problems , 2006, SPIE Defense + Commercial Sensing.

[4]  G. Bierman Factorization methods for discrete sequential estimation , 1977 .

[5]  S.S. Blackman,et al.  Multiple hypothesis tracking for multiple target tracking , 2004, IEEE Aerospace and Electronic Systems Magazine.

[6]  Edward Fredkin,et al.  Trie memory , 1960, Commun. ACM.

[7]  Y. Bar-Shalom,et al.  Autonomous search, tracking and classification by multiple cooperative UAVs , 2006, SPIE Defense + Commercial Sensing.

[8]  Sean R. Martin,et al.  The application of particle swarm optimization and maneuver automatons during non-Markovian motion planning for air vehicles performing ground target search , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  A. El-Fallah,et al.  Unified Bayesian situation assessment sensor management , 2005, SPIE Defense + Commercial Sensing.

[10]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[11]  H. Michalska,et al.  Receding horizon control of nonlinear systems , 1988, Proceedings of the 28th IEEE Conference on Decision and Control,.

[12]  Thia Kirubarajan,et al.  Hierarchical markov decision processes based distributed data fusion and collaborative sensor management for multitarget multisensor tracking applications , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[13]  Ronald Mahler,et al.  MULTITARGET SENSOR MANAGEMENT OF DISPERSED MOBILE SENSORS , 2004 .

[14]  Gee Wah Ng,et al.  Sensor management - what, why and how , 2000, Inf. Fusion.

[15]  David Stein,et al.  Mutual Information Based Resource Management Applied to Road Constrained Target Tracking , 2006 .

[16]  M. Kalandros Covariance control for multisensor systems , 2002 .

[17]  Alfred O. Hero,et al.  An Information-Based Approach to Sensor Management in Large Dynamic Networks , 2007, Proceedings of the IEEE.

[18]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[19]  Y. Bar-Shalom,et al.  Autonomous surveillance by multiple cooperative UAVs , 2005, SPIE Optics + Photonics.

[20]  John K. Slaney,et al.  Decision-Theoretic Planning with non-Markovian Rewards , 2011, J. Artif. Intell. Res..

[21]  E. Feron,et al.  Robust hybrid control for autonomous vehicle motion planning , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).