A Deep Learning Approach to UAV Image Multilabeling

In this letter, we face the problem of multilabeling unmanned aerial vehicle (UAV) imagery, typically characterized by a high level of information content, by proposing a novel method based on convolutional neural networks. These are exploited as a means to yield a powerful description of the query image, which is analyzed after subdividing it into a grid of tiles. The multilabel classification task of each tile is performed by the combination of a radial basis function neural network and a multilabeling layer (ML) composed of customized thresholding operations. Experiments conducted on two different UAV image data sets demonstrate the promising capability of the proposed method compared to the state of the art, at the expense of a higher but still contained computation time.

[1]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[2]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Naif Alajlan,et al.  Efficient Framework for Palm Tree Detection in UAV Images , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Farid Melgani,et al.  Detecting Cars in UAV Images With a Catalog-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Jing Li,et al.  Unsupervised Detection of Earthquake-Triggered Roof-Holes From UAV Images Using Joint Color and Shape Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[8]  Naif Alajlan,et al.  Multiclass Coarse Analysis for UAV Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Tor Arne Johansen,et al.  Automatic detection, classification and tracking of objects in the ocean surface from UAVs using a thermal camera , 2015, 2015 IEEE Aerospace Conference.

[10]  Nuri Yilmazer,et al.  Application of Object Detection and Tracking Techniques for Unmanned Aerial Vehicles , 2015, Complex Adaptive Systems.

[11]  Gellért Máttyus,et al.  Fast Multiclass Vehicle Detection on Aerial Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[12]  James Nightingale,et al.  A UAV-Cloud System for Disaster Sensing Applications , 2015, 2015 IEEE 81st Vehicular Technology Conference (VTC Spring).

[13]  Loretta Ichim,et al.  Image Recognition in UAV Application Based on Texture Analysis , 2015, ACIVS.

[14]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[15]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Roberto de Alencar Lotufo,et al.  Fingerprint Liveness Detection Using Convolutional Neural Networks , 2016, IEEE Transactions on Information Forensics and Security.

[17]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[18]  J. Senthilnath,et al.  Detection of tomatoes using spectral-spatial methods in remotely sensed RGB images captured by UAV , 2016 .