Unmanned Aerial Vehicle Tracking Using a Particle Filter Based Approach

The pose (3D position and orientation) of an Unmanned Aerial Vehicle (UAV) during the landing process aboard a ship can be estimated using a 3D model-based vision system approach. The developed vision system is based on a standard Red, Green and Blue (RGB) camera using one workstation for processing data located on the ship's deck. A ground-based vision system allows the use of small size and weight UAV, due to the low computer requirements onboard. The proposed architecture is based on a Particle Filter (PF) scheme and has three stages: importance sampling, importance weighting and resampling. In the importance sampling, we detect bounding box candidates and apply an appearance-based pose sampler to retrieve the most likely poses. After this, we fuse information from the current frame with information from the previous time step using an Unscented Kalman Filter (UKF) for the translational motion filtering and an Unscented Bingham Filter (UBiF) for the rotational motion filtering. In the importance weighting stage, we use a color based likelihood metric to deal with the expected real sky background filled with clouds. In the resampling stage, we eliminate particles with low importance weights and replicate high weight ones. Results show that performance is compatible with the automatic landing system requirements.

[1]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[2]  Alexandre Bernardino,et al.  3D Model-based estimation for UAV tracking , 2018, OCEANS 2018 MTS/IEEE Charleston.

[3]  Petar M. Djuric,et al.  Gaussian particle filtering , 2003, IEEE Trans. Signal Process..

[4]  Mohammad Teshnehlab,et al.  An intelligent UFastSLAM with MCMC move step , 2013, Adv. Robotics.

[5]  Kyle J. DeMars,et al.  Uncertainty Propagation of correlated quaternion and Euclidean states using partially-conditioned Gaussian mixtures , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[6]  Christopher Bingham.  An Antipodally Symmetric Distribution on the Sphere , 1974 .

[7]  Matthew A. Garratt,et al.  Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment , 2017, Auton. Robots.

[8]  Petar M. Djuric,et al.  Gaussian sum particle filtering for dynamic state space models , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[9]  Hongbo Zhou,et al.  Improved Vision-Based Algorithm for Unmanned Aerial Vehicles Autonomous Landing , 2013, J. Multim..

[10]  E. Kraft,et al.  A quaternion-based unscented Kalman filter for orientation tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[11]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[12]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[14]  Anton J. Haug.  Bayesian Estimation and Tracking: A Practical Guide , 2012 .

[15]  Alexandre Bernardino,et al.  Particle filtering based optimization applied to 3D model-based estimation for UAV pose estimation , 2017, OCEANS 2017 - Aberdeen.

[16]  Robert T. Collins,et al.  Vanishing point calculation as a statistical inference on the unit sphere , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[17]  Miguel A. Olivares-Méndez,et al.  Trinocular ground system to control UAVs , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Leslie Pack Kaelbling,et al.  Tracking the spin on a ping pong ball with the quaternion Bingham filter , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Mandyam V. Srinivasan,et al.  A stereo vision system for UAV guidance , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Theodore Kypraios,et al.  Exact Bayesian inference for the Bingham distribution , 2014, Stat. Comput..

[21]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[22]  S. Shankar Sastry,et al.  A vision system for landing an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[23]  Leslie Pack Kaelbling,et al.  Tracking 3-D Rotations with the Quaternion Bingham Filter , 2013 .

[24]  Victor Lobo,et al.  Trajectory and guidance mode for autonomously landing an UAV on a naval platform using a vision approach , 2015, OCEANS 2015 - Genova.

[25]  M. J. Prentice.  A distribution-free method of interval estimation for unsigned directional data , 1984 .

[26]  Alexandre Bernardino,et al.  A Ground-Based Vision System for UAV Pose Estimation , 2015 .

[27]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[28]  Zengfu Wang,et al.  Automatic take-off and landing of a quad-rotor flying robot , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[29]  Srikanth Saripalli,et al.  Vision-based Autonomous Landing of an Helicopter on a Moving Target , 2009 .

[30]  Gerhard Kurz,et al.  Recursive nonlinear filtering for angular data based on circular distributions , 2013, 2013 American Control Conference.

[31]  G. Anitha,et al.  Vision Based Autonomous Landing of an Unmanned Aerial Vehicle , 2012 .

[32]  Gerhard Kurz,et al.  Recursive Bingham filter for directional estimation involving 180 degree symmetry , 2014 .

[33]  Emanuele Frontoni,et al.  A Vision-Based Guidance System for UAV Navigation and Safe Landing using Natural Landmarks , 2010, J. Intell. Robotic Syst..

[34]  F. Markley,et al.  Unscented Filtering for Spacecraft Attitude Estimation , 2003 .

[35]  Frank Dellaert,et al.  Autonomous Flight in GPS-Denied Environments Using Monocular Vision and Inertial Sensors , 2010, J. Aerosp. Inf. Syst..

[36]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Jian Chen,et al.  UAV Tracking with a Monocular Camera , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[38]  Christopher Wilkin,et al.  In-Flight Orientation, Object Identification and Landing Support for an Unmanned Air Vehicle , 2004 .

[39]  K. Mardia.  Characterizations of Directional Distributions , 1975 .

[40]  Andreas Zell,et al.  Automatic Take Off, Tracking and Landing of a Miniature UAV on a Moving Carrier Vehicle , 2011, J. Intell. Robotic Syst..

[41]  Alexandre Bernardino,et al.  A ground-based vision system for UAV tracking , 2015, OCEANS 2015 - Genova.

[42]  Simon J. Julier,et al.  The scaled unscented transformation , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[43]  M. J. D. Powell,et al.  Direct search algorithms for optimization calculations , 1998, Acta Numerica.

[44]  S. Haykin.  Kalman Filtering and Neural Networks , 2001 .

[45]  Yong Zhang,et al.  Research on computer vision-based for UAV autonomous landing on a ship , 2009, Pattern Recognit. Lett..

[46]  Sven Lange,et al.  Autonomous landing for a multirotor UAV using vision , 2008 .

[47]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[48]  Jianwei Zhang,et al.  Autonomous landing of an UAV with a ground-based actuated infrared stereo vision system , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  Gerhard Kurz,et al.  Unscented Orientation Estimation Based on the Bingham Distribution , 2013, IEEE Transactions on Automatic Control.