Onboard Marker-Less Detection and Localization of Non-Cooperating Drones for Their Safe Interception by an Autonomous Aerial System

In this letter, a novel approach to fast three-dimensional (3-D) localization of flying objects for their interception by a micro aerial vehicle (MAV) is presented. The proposed method utilizes a depth image from a stereo camera to facilitate onboard detection of drones, flying in its proximity. The method does not rely on using any kind of markers, which enables localization of non-cooperating drones. This approach strongly relaxes the requirements on the drones to be detected, and the detection algorithm is computationally undemanding enough to process images online, onboard an MAV with limited computational resources. This allows using the detection system in the control feedback of an autonomous aerial intercepting system. Output of the detection algorithm is filtered by a 3-D multi-target tracking algorithm to reduce false positives, preserve temporal consistency of the detections, and to predict positions of the drones (e.g., to compensate camera and processing delays). We demonstrate the importance of the advances in flying object localization, presented in this letter, in an experiment with an intruder-interceptor scenario, which would be unfeasible using state-of-the-art detection and localization methods.

[1]  Yuqi Liu,et al.  Experimental Research of Multistatic Passive Radar With a Single Antenna for Drone Detection , 2018, IEEE Access.

[2]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Amelia Wong Azman,et al.  Indoor UAV Positioning Using Stereo Vision Sensor , 2012 .

[4]  Xin Yang,et al.  REDBEE: A visual-inertial drone system for real-time moving object detection , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Michael Blumenstein,et al.  A study on detecting drones using deep convolutional neural networks , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[6]  Vincent Lepetit,et al.  Flying objects detection from a single moving camera , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Martin Saska,et al.  Autonomous landing on a moving vehicle with an unmanned aerial vehicle , 2019, J. Field Robotics.

[8]  Vijay Kumar,et al.  Cooperative autonomous search, grasping, and delivering in a treasure hunt scenario by a team of unmanned aerial vehicles , 2018, J. Field Robotics.

[9]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[10]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[11]  Antonio Franchi,et al.  Mutual Localization of UAVs based on Blinking Ultraviolet Markers and 3D Time-Position Hough Transform , 2018, 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE).

[12]  Arne Schumann,et al.  Deep cross-domain flying object classification for robust UAV detection , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[13]  Vincent Lepetit,et al.  Vision-based Unmanned Aerial Vehicle detection and tracking for sense and avoid systems , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Roberto Opromolla,et al.  A Vision-Based Approach to UAV Detection and Tracking in Cooperative Applications , 2018, Sensors.

[15]  Jing Li,et al.  Multi-target detection and tracking from a single camera in Unmanned Aerial Vehicles (UAVs) , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Piotr Samczynski,et al.  35 GHz FMCW drone detection system , 2016, 2016 17th International Radar Symposium (IRS).

[17]  Zdenek Matousek,et al.  Drone detection by Ku-band battlefield radar , 2017, 2017 International Conference on Military Technologies (ICMT).

[18]  Min Young Kim,et al.  V-RBNN Based Small Drone Detection in Augmented Datasets for 3D LADAR System , 2018, Sensors.

[19]  S. Chatterjee,et al.  Quantization error analysis in stereo vision , 1992, [1992] Conference Record of the Twenty-Sixth Asilomar Conference on Signals, Systems & Computers.

[20]  Vijay Kumar,et al.  System for deployment of groups of unmanned micro aerial vehicles in GPS-denied environments using onboard visual relative localization , 2017, Auton. Robots.

[21]  Pedro U. Lima,et al.  On-board vision-based 3D relative localization system for multiple quadrotors , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).