Active and passive computational imaging for tracking and prediction of three-dimensional MUAV flight paths

Micro unmanned aerial vehicles (MUAV) have become increasingly popular during the last decade due to their access to a wide consumer market. With the increasing number of MUAV, the unintended and intended misuse by flying close to sensitive areas has risen as a potentially increasing risk. To counter this threat, surveillance systems are under development which will monitor the MUAV flight behavior. In this context, the reliable tracking and prediction of the MUAV flight behavior is crucial to increase the performance of countermeasures. In this paper, we discuss electro-optical computational imaging methods with a focus on the ability to perform a tracking of the three dimensional (3D) flight path. We evaluate the analysis of different imaging methods performed with active laser detection as well as with passive imaging using advanced scenario analysis. In first experimental investigation, we recorded and analyzed image sequences of a MUAV quad-copter flying at low altitude in laboratory and in outdoor scenario. Our results show, that we are able to track the three dimensional flight path with high accuracy and we are able to give a reliable prediction of the MUAV flight behavior within the near future.

[1]  Martin Laurenzis,et al.  Prediction of microunmanned aerial vehicle flight behavior from two-dimensional intensity images , 2019, Optical Engineering.

[2]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Stephan Stanko,et al.  Detection of MAVs (Micro Aerial Vehicles) based on millimeter wave radar , 2016, Security + Defence.

[4]  Martin Laurenzis,et al.  Detection of acoustic, electro-optical and RADAR signatures of small unmanned aerial vehicles , 2016, Security + Defence.

[5]  Martin Laurenzis,et al.  Optical and acoustical UAV detection , 2016, Security + Defence.

[6]  Wilmuth Müller,et al.  High-level data fusion component for drone classification and decision support in counter UAV , 2018, Defense + Security.

[7]  Eric Bavu,et al.  A distributed network of compact microphone arrays for drone detection and tracking , 2017 .

[8]  Katrina Herrick.  Development of the unmanned aerial vehicle market: forecasts and trends , 2000 .

[9]  Radu Horaud,et al.  An analytic solution for the perspective 4-point problem , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[11]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[12]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[13]  Robert M. Haralick,et al.  Review and analysis of solutions of the three point perspective pose estimation problem , 1994, International Journal of Computer Vision.

[14]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[15]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[17]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[18]  Roman P. Pflugfelder,et al.  Clustering of static-adaptive correspondences for deformable object tracking , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Arne Schumann,et al.  Deep cross-domain flying object classification for robust UAV detection , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[20]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Martin Laurenzis,et al.  Multi-sensor field trials for detection and tracking of multiple small unmanned aerial vehicles flying at low altitude , 2017, Defense + Security.

[22]  Roman P. Pflugfelder,et al.  Consensus-based matching and tracking of keypoints for object tracking , 2014, IEEE Winter Conference on Applications of Computer Vision.

[23]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[24]  Martin Macko,et al.  Tracking, aiming, and hitting the UAV with ordinary assault rifle , 2017, Security + Defence.

[25]  Martin Laurenzis,et al.  Tracking and prediction of small unmanned aerial vehicles' flight behavior and three-dimensional flight path from laser gated viewing images , 2019, Defense + Commercial Sensing.

[26]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[27]  Eric Bavu,et al.  Source localization and identification with a compact array of digital mems microphones , 2018 .

[28]  Thomas Müller,et al.  Robust drone detection for day/night counter-UAV with static VIS and SWIR cameras , 2017, Defense + Security.

[29]  Nicolas Riviere,et al.  An autonomous drone surveillance and tracking architecture , 2019 .

[30]  Mongi A. Abidi,et al.  A New Efficient and Direct Solution for Pose Estimation Using Quadrangular Targets: Algorithm and Evaluation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Michael J. Magee,et al.  The Perspective View of Three Points , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[33]  D.H. Lyon,et al.  A military perspective on small unmanned aerial vehicles , 2004, IEEE Instrumentation & Measurement Magazine.

[34]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Martin Laurenzis,et al.  Multimodal UAV detection: study of various intrusion scenarios , 2017, Security + Defence.