Distributed Cooperative Search using Information-Theoretic Costs for Particle Filters, with Quadrotor Applications ∗

Search and rescue missions can be efficiently and automatically performed by small, highly maneuverable unmanned aerial vehicle (UAV) teams. The search problem is complicated by a lack of prior information, nonlinear mapping between sensor observations and the physical world, and potentially non-Gaussian sensor noise models. To address these problems, a distributed control algorithm is proposed, using information theoretic methods with particle filters, to compute optimal control inputs for a multi-vehicle, coordinated localization of a stationary target. This technique exploits the structure of the probability distributions of the target state and of the sensor measurements to compute the control inputs that maneuver the UAVs to make observations that minimize the expected future uncertainty of the target state. Because the method directly uses the particle filter state and an accurate sensor noise model to compute the mutual information, it is no longer necessary to discard information by using linear and Gaussian approximations. To ensure safety of the vehicles, the algorithm incorporates collision avoidance and control authority constraints. The resulting information theoretic cost calculation is coupled amongst the vehicles and becomes prohibitive as the size of the UAV team becomes large. Therefore, single vehicle and pairwise approximations to the cost function are used that greatly reduce the computational burden and allow for development of a distributed algorithm for real-time optimization of vehicle trajectories. Simulation results are shown for a bearings-only sensor model with multiple vehicles. Initial flight tests of the Stanford Testbed of Autonomous Rotorcraft for Multi-Agent Control (STARMAC) show the feasibility of implementation of this algorithm on the quadrotor testbed and in real world situations.

[1]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[2]  Knox Williams,et al.  The snowy torrents : avalanche accidents in the United States, 1967-71 , 1975 .

[3]  Shih-Ping Han A globally convergent method for nonlinear programming , 1975 .

[4]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .

[5]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[6]  Hugh F. Durrant-Whyte,et al.  Decentralized algorithms and architecture for tracking and identification , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[9]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[10]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[11]  Niclas Bergman,et al.  Recursive Bayesian Estimation : Navigation and Tracking Applications , 1999 .

[12]  P. Fearnhead,et al.  An improved particle filter for non-linear problems , 1999 .

[13]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[14]  P. Moin Fundamentals of Engineering Numerical Analysis , 2001 .

[15]  C. Tomlin,et al.  Decentralized optimization, with application to multiple aircraft coordination , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[16]  Fredrik Gustafsson,et al.  Particle filters for positioning, navigation, and tracking , 2002, IEEE Trans. Signal Process..

[17]  Alexei Makarenko,et al.  Scalable Control of Decentralised Sensor Platforms , 2003, IPSN.

[18]  Petter Ögren,et al.  Cooperative control of mobile sensor networks:Adaptive gradient climbing in a distributed environment , 2004, IEEE Transactions on Automatic Control.

[19]  Stephen P. Boyd,et al.  Distributed optimization for cooperative agents: application to formation flight , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[20]  Steven L. Waslander,et al.  The Stanford testbed of autonomous rotorcraft for multi agent control (STARMAC) , 2004, The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576).

[21]  Clark R. Dohrmann,et al.  Decentralized Control for a Swarm of Vehicles Performing Source Localization , 2004, J. Intell. Robotic Syst..

[22]  D. Ghose,et al.  Multiple UAV search using agent based negotiation scheme , 2005, Proceedings of the 2005, American Control Conference, 2005..

[23]  Yanli Yang,et al.  Evidential map-building approaches for multi-UAV cooperative search , 2005, Proceedings of the 2005, American Control Conference, 2005..

[24]  Steven Lake Waslander,et al.  Multi-agent quadrotor testbed control design: integral sliding mode vs. reinforcement learning , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  S. Maskell,et al.  A comparison of the particle and shifted Rayleigh filters in their application to a multisensor bearings-only problem , 2005, 2005 IEEE Aerospace Conference.

[26]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .