Robust landmine detection from thermal image time series using Hough transform and rotationally invariant features

ABSTRACT Automated detection of buried anti-personnel landmines using remote sensing techniques is very important for clearing minefields without putting lives in danger. Although thermal infrared imaging is promising, it is far from applicable to the real world in its current state-of-the-art. The most serious problem is that experiments are generally held using sandboxes or levelled and cleared soil, but real fields are, at least partially, covered with plants. In this study, we present an algorithm for landmine detection that is robust enough to detect beyond the clutter caused by partial plant cover. The first part is a hypothesis generator based on circular Hough Transform applied to images that are filtered to enhance circular structures. The second part tests the candidate landmine coordinates using rotationally invariant features, including modified Histogram of Oriented Gaussians (HOG), over multiple images taken at different times after Wiener filtering to maximize signal-to-clutter ratio. The performances of various features and classifiers are compared. The overall performance of the algorithm is demonstrated on a dataset of real-world landmine images contaminated by simulated plants. Satisfactory results are obtained up to 40% equivalent plant coverage where more than 65% of the pixels are fully or partially covered by plants.

[1]  Lennart Svensson,et al.  Dual-band land mine detection using a Bayesian approach , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Serkan Kaya,et al.  Buried and Surface Mine Detection From Thermal Image Time Series , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Hamdi Tolga Kahraman,et al.  Passive Mine Detection and Classification Method Based on Hybrid Model , 2018, IEEE Access.

[4]  K. R. Rajesh,et al.  Realisation of Ultrasonic Doppler Vibrometer array for landmine detection , 2012, 2012 IEEE International Ultrasonics Symposium.

[5]  B. Macq,et al.  A time frequency domain feature extraction algorithm for landmine identification from GPR data , 2008 .

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Pascal Fua,et al.  Making Action Recognition Robust to Occlusions and Viewpoint Changes , 2010, ECCV.

[8]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Ben H.P. Maathuis,et al.  A review of satellite and airborne sensors for remote sensing based detection of minefields and landmines , 2004 .

[10]  Oscar Déniz-Suárez,et al.  Face recognition using Histograms of Oriented Gradients , 2011, Pattern Recognit. Lett..

[11]  S. Abdelazeem,et al.  Micro-aneurysm detection using vessels removal and circular Hough transform , 2002, Proceedings of the Nineteenth National Radio Science Conference.

[12]  A. J. Nor'aini,et al.  Eyes detection in facial images using Circular Hough Transform , 2009, 2009 5th International Colloquium on Signal Processing & Its Applications.

[13]  Leslie M. Collins,et al.  Multiple-Instance Hidden Markov Model for GPR-Based Landmine Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Vyacheslav Aranchuk,et al.  Laser multi-beam differential interferometric sensor for acoustic detection of buried objects , 2018, Defense + Security.

[15]  H. Kasban,et al.  A Comparative Study of Landmine Detection Techniques , 2010 .

[16]  Alberto Muscio,et al.  Experiments of thermographic landmine detection with reduced size and compressed time , 2004 .

[17]  James M. Keller,et al.  Automatic detection system for buried explosive hazards in FL-LWIR based on soft feature extraction using a bank of Gabor energy filters , 2013, Defense, Security, and Sensing.

[18]  Jordan M. Malof,et al.  Improvements to the Histogram of Oriented Gradient (HOG) prescreener for buried threat detection in ground penetrating radar data , 2017, Defense + Security.

[19]  Irene Y. H. Gu,et al.  Enhanced Landmine Detection from Low Resolution IR Image Sequences , 2009, CAIP.

[20]  Motoyuki Sato,et al.  Landmine detection by 3D GPR system , 2012, Other Conferences.

[21]  Shuicheng Yan,et al.  Towards Robust and Accurate Multi-View and Partially-Occluded Face Alignment , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[23]  James M. Keller,et al.  Detection of buried objects in FLIR imaging using mathematical morphology and SVM , 2012, 2012 IEEE Symposium on Computational Intelligence for Security and Defence Applications.

[24]  Leslie M. Collins,et al.  Histograms of Oriented Gradients for Landmine Detection in Ground-Penetrating Radar Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jordan M. Malof,et al.  Improving the histogram of oriented gradient feature for threat detection in ground penetrating radar by implementing it as a trainable convolutional neural network , 2018, Defense + Security.

[26]  Dimitri Donskoy Nonlinear seismo‐acoustic landmine detection , 2004 .

[27]  Timothy S. de Smet,et al.  Detection and Identification of Remnant PFM-1 'Butterfly Mines' with a UAV-Based Thermal-Imaging Protocol , 2018, Remote. Sens..

[28]  Gozde Bozdagi Akar,et al.  Fusion of forward-looking infrared camera and down-looking ground penetrating radar for buried target detection , 2015, Defense + Security Symposium.

[29]  Domingo Mery,et al.  A survey of land mine detection technology , 2009 .