Autonomous target following with monocular camera on UAS using Recursive-RANSAC tracker

This paper presents a vision-based target tracking and following system using a monocular camera on an Unmanned Aerial System (UAS). The R-RANSAC tracker tracks multiple moving objects in the camera field of view and the proposed controller is capable of following a particular target selected by a user while keeping the target in the center of the image. The main contribution of this paper is that multiple objects can be tracked without imposing restrictions such as color, shape, etc. Also, the hardware test shows that the system is able to follow a target autonomously in a real-world outdoor environment. The proposed algorithm is validated on a 3DR X-8 multirotor platform using a downward facing camera.

[1]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Simon Lacroix,et al.  A strategy for tracking a ground target with a UAV , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  David Hyunchul Shim,et al.  A vision-based target tracking control system of a quadrotor by using a tablet computer , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[4]  R. Rysdyk.  Unmanned Aerial Vehicle Path Following for Target Observation in Wind , 2006 .

[5]  É. Marchand,et al.  Chasing a moving target from a flying UAV , 2019 .

[6]  Kyle Ingersoll,et al.  Vision Based Multiple Target Tracking Using Recursive RANSAC , 2015 .

[7]  Jeremiah Neubert,et al.  On-Board Visual Tracking with Unmanned Aircraft System (UAS) , 2011, ArXiv.

[8]  Isaac Kaminer,et al.  Vision-Based Tracking and Motion Estimation for Moving Targets Using Small UAVs , 2006 .

[9]  Kevin D. Jones,et al.  Vision-based tracking and motion estimation for moving targets using small UAVs , 2006, 2006 American Control Conference.

[10]  Randal W. Beard,et al.  Multiple target tracking using recursive RANSAC , 2014, 2014 American Control Conference.

[11]  Zdenek Hurák,et al.  Image-Based Pointing and Tracking for Inertially Stabilized Airborne Camera Platform , 2012, IEEE Transactions on Control Systems Technology.

[12]  Pascual Campoy Cervera,et al.  Vision based GPS-denied Object Tracking and following for unmanned aerial vehicles , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[13]  Vijay Kumar,et al.  Autonomous Flight for Detection, Localization, and Tracking of Moving Targets With a Small Quadrotor , 2017, IEEE Robotics and Automation Letters.

[14]  Randal W. Beard,et al.  Radar odometry with recursive-RANSAC , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Daewon Lee,et al.  Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  Randal W. Beard,et al.  Visual Tracking in Wind with Field of View Constraints , 2011 .

[17]  Patrick DeFranco,et al.  Detecting and Tracking Moving Objects from a Small Unmanned Air Vehicle , 2015 .