Road Target Search and Tracking with Gimballed Vision Sensor on an Unmanned Aerial Vehicle

This article considers a sensor management problem where a number of road bounded vehicles are monitored by an unmanned aerial vehicle (UAV) with a gimballed vision sensor. The problem is to keep track of all discovered targets and simultaneously search for new targets by controlling the pointing direction of the vision sensor and the motion of the UAV. A planner based on a state-machine is proposed with three different modes; target tracking, known target search, and new target search. A high-level decision maker chooses among these sub-tasks to obtain an overall situational awareness. A utility measure for evaluating the combined search and target tracking performance is also proposed. By using this measure it is possible to evaluate and compare the rewards of updating known targets versus searching for new targets in the same framework. The targets are assumed to be road bounded and the road network information is used both to improve the tracking and sensor management performance. The tracking and search are based on flexible target density representations provided by particle mixtures and deterministic grids.

[1]  Erik Hagfalk,et al.  Vision Sensor Scheduling for Multiple Target Tracking , 2010 .

[2]  Hugh F. Durrant-Whyte,et al.  Coordinated search for a lost target in a Bayesian world , 2004, Adv. Robotics.

[3]  Edwin K. P. Chong,et al.  Coordinated guidance of autonomous uavs via nominal belief-state optimization , 2009, 2009 American Control Conference.

[4]  Branko Ristic,et al.  A variable structure multiple model particle filter for GMTI tracking , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[5]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[6]  J. Rydell,et al.  Autonomous Functions for UAV Surveillance , 2010 .

[7]  Hugh F. Durrant-Whyte,et al.  Recursive Bayesian search-and-tracking using coordinated uavs for lost targets , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Alan Washburn Technical Note - An Upper Bound Useful in Optimizing Search for a Moving Target , 1981, Oper. Res..

[9]  C G Drury,et al.  Predicting Search Performance for Multiple Targets , 1980, Human factors.

[10]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[11]  J R Frost,et al.  REVIEW OF SEARCH THEORY: ADVANCES AND APPLICATIONS TO SEARCH AND RESCUE DECISION SUPPORT: FINAL REPORT , 2001 .

[12]  P. Whittle Restless Bandits: Activity Allocation in a Changing World , 1988 .

[13]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[14]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[15]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[16]  Krishna R. Pattipati,et al.  Ground target tracking with variable structure IMM estimator , 2000, IEEE Trans. Aerosp. Electron. Syst..

[17]  Vincent G. Ambrosia,et al.  Unmanned Aircraft Systems in Remote Sensing and Scientific Research: Classification and Considerations of Use , 2012, Remote. Sens..

[18]  B. O. Koopman Search and Screening: General Principles and Historical Applications , 1980 .

[19]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[20]  Simon J. Godsill,et al.  Ground target modelling, tracking and prediction with road networks , 2007, 2007 10th International Conference on Information Fusion.

[21]  L. Stone Theory of Optimal Search , 1975 .

[22]  Edwin K. P. Chong,et al.  Sensor scheduling for target tracking: A Monte Carlo sampling approach , 2006, Digit. Signal Process..

[23]  J. Karl Hedrick,et al.  A multiple UAV system for vision-based search and localization , 2008, 2008 American Control Conference.

[24]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[25]  Daniel Streller Road map assisted ground target tracking , 2008, 2008 11th International Conference on Information Fusion.

[26]  Scott Shorey Brown,et al.  Optimal Search for a Moving Target in Discrete Time and Space , 1980, Oper. Res..

[27]  Edward J. Sondik,et al.  The optimal control of par-tially observable Markov processes , 1971 .

[28]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[29]  Niclas Bergman,et al.  Recursive Bayesian Estimation : Navigation and Tracking Applications , 1999 .

[30]  Scott L. Miller,et al.  Probability and Random Processes : With Applications to Signal Processing and Communications , 2012 .

[31]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[32]  T. Zadra,et al.  Precision tracking of ground targets , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[33]  Keith D. Kastella,et al.  Foundations and Applications of Sensor Management , 2010 .

[34]  Gerald C. Holst,et al.  Electro-Optical Imaging System Performance , 1995 .

[35]  Nicholas Roy,et al.  Efficient planning under uncertainty for a target-tracking micro-aerial vehicle , 2010, 2010 IEEE International Conference on Robotics and Automation.

[36]  João Pedro Hespanha,et al.  Cooperative Search by UAV Teams: A Model Predictive Approach using Dynamic Graphs , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[37]  Bruce A. MacDonald,et al.  A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera , 2012, Remote. Sens..

[38]  K. Shadan,et al.  Available online: , 2012 .

[39]  Gee Wah Ng,et al.  Sensor management - what, why and how , 2000, Inf. Fusion.

[40]  Y. Bar-Shalom,et al.  Multiple-model estimation with variable structure , 1996, IEEE Trans. Autom. Control..

[41]  James R. Riehl,et al.  A UAV routing and sensor control optimization algorithm for target search , 2007, SPIE Defense + Commercial Sensing.

[42]  Zhen Ding,et al.  A survey of radar resource management algorithms , 2008, 2008 Canadian Conference on Electrical and Computer Engineering.

[43]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[44]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[45]  Sanjoy Dasgupta,et al.  Adaptive Control Processes , 2010, Encyclopedia of Machine Learning and Data Mining.

[46]  Alan R. Washburn,et al.  Branch and bound methods for a search problem , 1998 .

[47]  Alan Washburn Search for a Moving Target: The FAB Algorithm , 1983, Oper. Res..

[48]  Christopher Geyer Active target search from UAVs in urban environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[49]  M. Ulmke,et al.  Road-map assisted ground moving target tracking , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[50]  David Hsu,et al.  SARSOP: Efficient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces , 2008, Robotics: Science and Systems.

[51]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[52]  Reid G. Simmons,et al.  Point-Based POMDP Algorithms: Improved Analysis and Implementation , 2005, UAI.

[53]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[54]  Fredrik Gustafsson,et al.  Pedestrian tracking with an infrared sensor using road network information , 2012, EURASIP J. Adv. Signal Process..

[55]  Peter J. Shea,et al.  Improved state estimation through use of roads in ground tracking , 2000, SPIE Defense + Commercial Sensing.

[56]  E. Feron,et al.  Multi-UAV dynamic routing with partial observations using restless bandit allocation indices , 2008, 2008 American Control Conference.

[57]  F Gustafsson,et al.  Particle filter theory and practice with positioning applications , 2010, IEEE Aerospace and Electronic Systems Magazine.

[58]  Tomonari Furukawa,et al.  Coordinated Search-and-Capture Using Particle Filters , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.