Vision-based system for a real-time detection and following of UAV

In this paper a vision-based system for detection, motion tracking and following of Unmanned Aerial Vehicle (UAV) with other UAV (follower) is presented. For detection of an airborne UAV we apply a convolutional neural network YOLO trained on a collected and processed dataset of 10,000 images. The trained network is capable of detecting various multirotor UAVs in indoor, outdoor and simulation environments. Furthermore, detection results are improved with Kalman filter which ensures steady and reliable information about position and velocity of a target UAV. Preserving the target UAV in the field of view (FOV) and at required distance is accomplished by a simple nonlinear controller based on visual servoing strategy. The proposed system achieves a real-time performance on Neural Compute Stick 2 with a speed of 20 frames per second (FPS) for the detection of an UAV. Justification and efficiency of the developed vision-based system are confirmed in Gazebo simulation experiment where the target UAV is executing a 3D trajectory in a shape of number eight.

[1]  Cristi Iuga,et al.  Fall monitoring and detection for at-risk persons using a UAV , 2018 .

[2]  Jason J. Ford,et al.  Airborne vision‐based collision‐detection system , 2011, J. Field Robotics.

[3]  Bruno Sinopoli,et al.  Vision based navigation for an unmanned aerial vehicle , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[4]  Lin Lei,et al.  Fast vehicle detection in UAV images , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[5]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[6]  D. Simon.  Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[7]  Michael A. Goodrich,et al.  Supporting wilderness search and rescue using a camera-equipped mini UAV: Research Articles , 2008 .

[8]  Stjepan Bogdan,et al.  Decentralized planning and control for UAV–UGV cooperative teams , 2018, Autonomous Robots.

[9]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Toby P. Breckon,et al.  Real-time people and vehicle detection from UAV imagery , 2011, Electronic Imaging.

[11]  Song Han,et al.  Deep Drone : Object Detection and Tracking for Smart Drones on Embedded System , 2016 .

[12]  Rodney A. Walker,et al.  Towards automatic power line detection for a UAV surveillance system using pulse coupled neural filter and an improved Hough transform , 2009, Machine Vision and Applications.