Building Visual Anomaly Dataset from Satellite Data using ADS-B

In this paper, we present a novel way of obtaining extremely challenging image dataset for the purpose of benchmarking image anomaly detection methods. By definition, anomalies are rare occurrences, and therefore, annotation of anomalies using human workforce is difficult and costly, as large amounts of mostly non-anomalous data need to be checked. To alleviate this problem, we use satellite images from Planet.com as the source of visual data, and combine them with ADS-B data to detect airplanes in a semi-automatic way. This way, our definition of anomaly is an appearance of an airplane on mostly airplane-free images. This not only speeds up annotation, but also provides the exact specification of what constitutes an anomaly, in an objective way. The resulting meta-dataset, containing references to Planet.com imagery and accurate annotations will be published in the near future. It will include locations of nearly 100 positions of airplanes on satellite images and the corresponding references to satellite images, captured in vicinity of large airports in different parts of the world, in different climate zones.

[1]  Wei Li,et al.  Robust airplane detection in satellite images , 2011, 2011 18th IEEE International Conference on Image Processing.

[2]  Ivan Martinovic,et al.  Bringing up OpenSky: A large-scale ADS-B sensor network for research , 2014, IPSN-14 Proceedings of the 13th International Symposium on Information Processing in Sensor Networks.

[3]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[4]  Toby P. Breckon,et al.  Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detection , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[5]  Shukui Bo,et al.  Region-based airplane detection in remotely sensed imagery , 2010, 2010 3rd International Congress on Image and Signal Processing.

[6]  Ying Li,et al.  A hybrid contextual approach to wildland fire detection using multispectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Toby P. Breckon,et al.  GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training , 2018, ACCV.

[8]  Xiaobin Li,et al.  Airplane detection using convolutional neural networks in a coarse-to-fine manner , 2017, 2017 IEEE 2nd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC).

[9]  Dawei Zai,et al.  Rotation-and-scale-invariant airplane detection in high-resolution satellite images based on deep-Hough-forests , 2016 .

[10]  Mohanad Albughdadi,et al.  Missing data reconstruction and anomaly detection in crop development using agronomic indicators derived from multispectral satellite images , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[11]  Zhenwei Shi,et al.  An airplane detection method for panchromatic image , 2013, 2013 IEEE China Summit and International Conference on Signal and Information Processing.

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  Jure Skvarč,et al.  Segmentation-based deep-learning approach for surface-defect detection , 2019, Journal of Intelligent Manufacturing.

[14]  Hao Chen,et al.  Fast Airplane Detection with Hierarchical Structure in Large Scene Remote Sensing Images at High Spatial Resolution , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Kostas Stamatiou,et al.  Combining GeoEye-1 Satellite Remote Sensing, UAV Aerial Imaging, and Geophysical Surveys in Anomaly Detection Applied to Archaeology , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.