A hierarchical decision-making algorithm of UAV for collision avoidance in target tracking

Effective target tracking and obstacle avoidance strategies are essential to the success of unmanned aerial vehicle (UAV) missions. In this paper, we consider the UAV action decision-making problem for tracking a ground moving target, while avoiding dynamic ellipsoidal obstacle detected en route. The studied problem was formulated as a Partially Observable Markov Decision Process (POMDP), and then in this framework, we get the optimal or sub-optimal strategy to achieve the target tracking in the barrier environment. We first improved the conditions and methods of collision detection based on collision cone, and use common penalty function method to ensure tracking safety. Further taking into account that the UAV needs to react more quickly to obstacles than target tracking, we propose an alternative hierarchical decision-making approach. For the entire tracking process, the total information gain in the UAV-to-target observation is used as a tracking optimization criterion in case of no obstacle. Simulations are presented to demonstrate the comparison between the proposed approach with the improved penalty function approach. The results show that our proposed algorithm is superior.

[1]  Edwin K. P. Chong,et al.  UAVGuidance Algorithms via Partially Observable Markov Decision Processes , 2014 .

[2]  Stefan Hrabar,et al.  Reactive obstacle avoidance for Rotorcraft UAVs , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Daniel Hodouin,et al.  UAV Optimal Obstacle Avoidance while Respecting Target Arrival Specifications , 2011 .

[4]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[5]  Honglun Wang,et al.  Real-time path planning of unmanned aerial vehicle for target tracking and obstacle avoidance in complex dynamic environment , 2015 .

[6]  Edwin K. P. Chong,et al.  A POMDP Framework for Coordinated Guidance of Autonomous UAVs for Multitarget Tracking , 2009, EURASIP J. Adv. Signal Process..

[7]  Kuo-Chu Chang,et al.  UAV Path Planning with Tangent-plus-Lyapunov Vector Field Guidance and Obstacle Avoidance , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[8]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[9]  Daniel J. Pack,et al.  Optimal path planning of a target-following fixed-wing UAV using sequential decision processes , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[11]  Youdan Kim,et al.  Stereo vision based collision avoidance of quadrotor UAV , 2012, 2012 12th International Conference on Control, Automation and Systems.

[12]  M. Morelande,et al.  Bearings-only sensor trajectory scheduling using accumulative information , 2011, 2011 12th International Radar Symposium (IRS).

[13]  H. Rezaee,et al.  Adaptive artificial potential field approach for obstacle avoidance of unmanned aircrafts , 2012, 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[14]  Inseok Hwang,et al.  Reactive Collision Avoidance of Unmanned Aerial Vehicles Using a Single Vision Sensor , 2013 .

[15]  R. Padhi,et al.  Reactive Collision Avoidance of Using Nonlinear Geometric and Differential Geometric Guidance , 2011 .

[16]  Bill Moran,et al.  Target Motion Analysis Using Single Sensor Bearings-Only Measurements , 2009, 2009 2nd International Congress on Image and Signal Processing.

[17]  Daewon Lee,et al.  Obstacle avoidance using image-based visual servoing integrated with nonlinear model predictive control , 2011, IEEE Conference on Decision and Control and European Control Conference.

[18]  Alfred O. Hero,et al.  Partially Observable Markov Decision Process Approximations for Adaptive Sensing , 2009, Discret. Event Dyn. Syst..