A Stochastic Approach to Dubins Vehicle Tracking Problems

An optimal feedback control is developed for fixed-speed, fixed-altitude Unmanned Aerial Vehicle (UAV) to maintain a nominal distance from a ground target in a way that anticipates its unknown future trajectory. Stochasticity is introduced in the problem by assuming that the target motion can be modeled as Brownian motion, which accounts for possible realizations of the unknown target kinematics. Moreover, the possibility for the interruption of observations is included by assuming that the duration of observation times of the target is exponentially distributed, giving rise to two discrete states of operation. A Bellman equation based on an approximating Markov chain that is consistent with the stochastic kinematics is used to compute an optimal control policy that minimizes the expected value of a cost function based on a nominal UAV-target distance. Results indicate how the uncertainty in the target motion, the tracker capabilities, and the time since the last observation can affect the control law, and simulations illustrate that the control can further be applied to other continuous, smooth trajectories with no need for additional computation.

[1]  L. Dubins.  On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[2]  Dimos V. Dimarogonas,et al.  3D navigation and collision avoidance for nonholonomic aircraft‐like vehicles , 2010 .

[3]  Emilio Frazzoli,et al.  Traveling Salesperson Problems for a Double Integrator , 2006, IEEE Transactions on Automatic Control.

[4]  Ross P. Anderson,et al.  DUBINS VEHICLE TRACKING OF A TARGET WITH UNPREDICTABLE TRAJECTORY , 2011 .

[5]  João Pedro Hespanha,et al.  Flocking with fixed-wing UAVs for distributed sensing: A stochastic optimal control approach , 2013, 2013 American Control Conference.

[6]  Rolf Rysdyk,et al.  UAV Coordination for Autonomous Target Tracking , 2006 .

[7]  J. Doyle,et al.  NONLINEAR OPTIMAL CONTROL: A CONTROL LYAPUNOV FUNCTION AND RECEDING HORIZON PERSPECTIVE , 1999 .

[8]  Randal W. Beard,et al.  Trajectory tracking for unmanned air vehicles with velocity and heading rate constraints , 2004, IEEE Transactions on Control Systems Technology.

[9]  J. Quadrat.  Numerical methods for stochastic control problems in continuous time , 1994 .

[10]  Dejan Milutinovic,et al.  A stochastic approach to Dubins feedback control for target tracking , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Emilio Frazzoli,et al.  On Multiple UAV Routing with Stochastic Targets: Performance Bounds and Algorithms , 2005 .

[12]  Takashi Tsukamaki,et al.  Oscillatory control for constant-speed unicycle-type vehicles , 2007, 2007 46th IEEE Conference on Decision and Control.

[13]  A. Borodin,et al.  Handbook of Brownian Motion - Facts and Formulae , 1996 .

[14]  Emilio Frazzoli,et al.  On the Dubins Traveling Salesperson Problems: novel approximation algorithms , 2006 .

[15]  C. Gardiner.  Stochastic Methods: A Handbook for the Natural and Social Sciences , 2009 .

[16]  Dejan Milutinovic,et al.  Anticipating stochastic observation loss during optimal target tracking by a small Aerial Vehicle , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[17]  John D'Azzo,et al.  Close formation flight control , 1999 .

[18]  D. Sherrington.  Stochastic Processes in Physics and Chemistry , 1983 .

[19]  Mark H. Overmars,et al.  Probabilistic path planning , 1998 .

[20]  H. Sussmann,et al.  The Markov-Dubins problem with angular acceleration control , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[21]  S. Aachen.  Stochastic Differential Equations An Introduction With Applications , 2016 .