Hierarchical Heuristic Search Using a Gaussian Mixture Model for UAV Coverage Planning

During unmanned aerial vehicle (UAV) search missions, efficient use of UAV flight time requires flight paths that maximize the probability of finding the desired subject. The probability of detecting the desired subject based on UAV sensor information can vary in different search areas due to environment elements like varying vegetation density or lighting conditions, making it likely that the UAV can only partially detect the subject. This adds another dimension of complexity to the already difficult (NP-Hard) problem of finding an optimal search path. We present a new class of algorithms that account for partial detection in the form of a task difficulty map and produce paths that approximate the payoff of optimal solutions. The algorithms use the mode goodness ratio heuristic that uses a Gaussian mixture model to prioritize search subregions. The algorithms search for effective paths through the parameter space at different levels of resolution. We compare the performance of the new algorithms against two published algorithms (Bourgault's algorithm and LHC-GW-CONV algorithm) in simulated searches with three real search and rescue scenarios, and show that the new algorithms outperform existing algorithms significantly and can yield efficient paths that yield payoffs near the optimal.

[1]  Hugh F. Durrant-Whyte,et al.  Optimal Search for a Lost Target in a Bayesian World , 2003, FSR.

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[3]  P Niedfeldt,et al.  Integrated sensor guidance using probability of object Identification , 2010, Proceedings of the 2010 American Control Conference.

[4]  Anthony Stentz,et al.  Optimal and efficient path planning for partially-known environments , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[5]  Michael A. Goodrich,et al.  UAV intelligent path planning for Wilderness Search and Rescue , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[7]  Alice E. Smith,et al.  AN ANT COLONY APPROACH TO THE ORIENTEERING PROBLEM , 2006 .

[8]  Anwer Khurshid,et al.  A note on finding peakedness in bivariate normal distribution using Mathematica , 2007 .

[9]  Scott A. Bortoff,et al.  Path planning for UAVs , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[10]  L. Stone Theory of Optimal Search , 1975 .

[11]  P. Sokkappa The cost-constrained traveling salesman problem , 1990 .

[12]  B. O. Koopman The Theory of Search. II. Target Detection , 1956 .

[13]  Michael A. Goodrich,et al.  Towards real-world searching with fixed-wing mini-UAVs , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Gilbert Laporte,et al.  The vehicle routing problem: An overview of exact and approximate algorithms , 1992 .

[15]  Patrick Doherty,et al.  Probabilistic roadmap based path planning for an autonomous unmanned helicopter , 2006, J. Intell. Fuzzy Syst..

[16]  K E Trummel,et al.  Technical Note - The Complexity of the Optimal Searcher Path Problem , 1986, Oper. Res..

[17]  M. Sniedovich Dynamic programming : foundations and principles , 2011 .

[18]  Paul S. Horn,et al.  A Measure for Peakedness , 1983 .

[19]  Michael A. Goodrich,et al.  A Bayesian approach to modeling lost person behaviors based on terrain features in Wilderness Search and Rescue , 2010, Comput. Math. Organ. Theory.

[20]  Andrew Crampton,et al.  A hierarchical task network planner for pathfinding in real-time strategy games , 2010 .

[21]  Michael A. Goodrich,et al.  Supporting wilderness search and rescue using a camera‐equipped mini UAV , 2008, J. Field Robotics.

[22]  Robert C. Holte,et al.  Hierarchical A*: Searching Abstraction Hierarchies Efficiently , 1996, AAAI/IAAI, Vol. 1.

[23]  K. Balanda,et al.  Kurtosis: A Critical Review , 1988 .

[24]  W. Marsden I and J , 2012 .

[25]  Michael A. Goodrich,et al.  UAV video coverage quality maps and prioritized indexing for wilderness search and rescue , 2010, HRI 2010.

[26]  J. Karl Hedrick,et al.  Particle filter based information-theoretic active sensing , 2010, Robotics Auton. Syst..

[27]  Alice E. Smith,et al.  A genetic algorithm for the orienteering problem , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[28]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[29]  B. O. Koopman The Theory of Search , 1957 .

[30]  Maya R. Gupta,et al.  Theory and Use of the EM Algorithm , 2011, Found. Trends Signal Process..

[31]  Ronen I. Brafman,et al.  Hierarchical Heuristic Forward Search in Stochastic Domains , 2007, IJCAI.

[32]  K. Mardia Measures of multivariate skewness and kurtosis with applications , 1970 .