A few-shot learning framework for air vehicle detection by similarity embedding

Air vehicles such as aircrafts and drones have played an important role in surveillance and transportation for both civil and military applications. In this paper, we proposed a few-shot learning framework for air vehicle detection by similarity embedding, with a single moving camera mounted on another flying object. Firstly, we presented the example embedding with similarity conditioned LSTM-model for air vehicle detection. Secondly, we described the support set embedding with bidirectional LSTM-model of air vehicle training samples. Thirdly, we introduced the label prediction for air vehicle image blocks by attention kernel. Finally, we applied the fully convolutional network to segment air vehicle in the accurate bounding box. Experiment results of air vehicle detection show the effectiveness of our approach.

[1]  Milos Zelezný,et al.  Stationary Device for Drone Detection in Urban Areas , 2017, ICR.

[2]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[3]  Vincent Lepetit,et al.  Flying objects detection from a single moving camera , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[5]  P. Fua,et al.  Detecting Flying Objects Using a Single Moving Camera , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[7]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[8]  Peter Wellig,et al.  Detection and tracking of drones using advanced acoustic cameras , 2015, SPIE Security + Defence.

[9]  Pascal Fua,et al.  Flight Dynamics-Based Recovery of a UAV Trajectory Using Ground Cameras , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jing Li,et al.  Multi-target detection and tracking from a single camera in Unmanned Aerial Vehicles (UAVs) , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[13]  Jianjiang Lu,et al.  A Framework for Moving Target Detection, Recognition and Tracking in UAV Videos , 2012 .

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Vincent Lepetit,et al.  Vision-based Unmanned Aerial Vehicle detection and tracking for sense and avoid systems , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).