If training data appears to be mislabeled, should we relabel it? Improving supervised learning algorithms for threat detection in ground penetrating radar data

This work focuses on the development of automatic buried threat detection (BTD) algorithms using ground penetrating radar (GPR) data. Buried threats tend to exhibit unique characteristics in GPR imagery, such as high energy hyperbolic shapes, which can be leveraged for detection. Many recent BTD algorithms are supervised, and therefore they require training with exemplars of GPR data collected over non-threat locations and threat locations, respectively. Frequently, data from non-threat GPR examples will exhibit high energy hyperbolic patterns, similar to those observed from a buried threat. Is it still useful therefore, to include such examples during algorithm training, and encourage an algorithm to label such data as a non-threat? Similarly, some true buried threat examples exhibit very little distinctive threat-like patterns. We investigate whether it is beneficial to treat such GPR data examples as mislabeled, and either (i) relabel them, or (ii) remove them from training. We study this problem using two algorithms to automatically identify mislabeled examples, if they are present, and examine the impact of removing or relabeling them for training. We conduct these experiments on a large collection of GPR data with several state-of-the-art GPR-based BTD algorithms.

[1]  Riadh Ksantini,et al.  Covariance-guided landmine detection and discrimination using ground-penetrating radar data , 2018 .

[2]  Huanhuan Chen,et al.  Probabilistic robust hyperbola mixture model for interpreting ground penetrating radar data , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[3]  Leslie M. Collins,et al.  Texture Features for Antitank Landmine Detection Using Ground Penetrating Radar , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[4]  K. C. Ho,et al.  Detection of deeply buried non-metal objects by ground penetrating radar using non-negative matrix factorization , 2015, Defense + Security Symposium.

[5]  Pascal Aubry,et al.  Signal processing for landmine detection using ground penetrating radar , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[6]  Joseph N. Wilson,et al.  Hierarchical Methods for Landmine Detection with Wideband Electro-Magnetic Induction and Ground Penetrating Radar Multi-Sensor Systems , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Paul D. Gader,et al.  Detection and Discrimination of Land Mines in Ground-Penetrating Radar Based on Edge Histogram Descriptors and a Possibilistic $K$-Nearest Neighbor Classifier , 2009, IEEE Transactions on Fuzzy Systems.

[8]  Leslie M. Collins,et al.  Histograms of Oriented Gradients for Landmine Detection in Ground-Penetrating Radar Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jordan M. Malof,et al.  Target signature localization in GPR data by jointly estimating and matching templates , 2015, Defense + Security Symposium.

[10]  Maria A. Gonzalez-Huici,et al.  Evaluation of landmine detection performance applying two different algorithms to GPR field data , 2013, Defense, Security, and Sensing.

[11]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[12]  Hichem Frigui,et al.  Comparison of different classification algorithms for landmine detection using GPR , 2010, Defense + Commercial Sensing.

[13]  Jordan M. Malof,et al.  A Large-Scale Multi-Institutional Evaluation of Advanced Discrimination Algorithms for Buried Threat Detection in Ground Penetrating Radar , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jordan M. Malof,et al.  Improving convolutional neural networks for buried target detection in ground penetrating radar using transfer learning via pretraining , 2017, Defense + Security.

[15]  Paul D. Gader,et al.  Landmine detection using discrete hidden Markov models with Gabor features , 2007, SPIE Defense + Commercial Sensing.

[16]  Przemyslaw Klesk,et al.  Fast Analysis of C-Scans From Ground Penetrating Radar via 3-D Haar-Like Features With Application to Landmine Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Hichem Frigui,et al.  Ensemble hidden Markov models with application to landmine detection , 2015, EURASIP J. Adv. Signal Process..

[18]  Benoît Frénay,et al.  A comprehensive introduction to label noise , 2014, ESANN.

[19]  Paul D. Gader,et al.  Multiple-Instance Hidden Markov Models With Applications to Landmine Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Joseph N. Wilson,et al.  An Investigation of Using the Spectral Characteristics From Ground Penetrating Radar for Landmine/Clutter Discrimination , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Joseph N. Wilson,et al.  A Large-Scale Systematic Evaluation of Algorithms Using Ground-Penetrating Radar for Landmine Detection and Discrimination , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Hichem Frigui,et al.  A fisher vector representation of GPR data for detecting buried objects , 2016, SPIE Defense + Security.

[23]  Alexander G. Yarovoy,et al.  A Novel Clutter Suppression Algorithm for Landmine Detection With GPR , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Joseph N. Wilson,et al.  An evaluation of several fusion algorithms for anti-tank landmine detection and discrimination , 2012, Inf. Fusion.

[25]  Przemyslaw Klesk,et al.  Boosted Classifiers for Antitank Mine Detection in C-Scans from Ground-Penetrating Radar , 2014, ACS.

[26]  M. M. Mokji,et al.  Automatic target detection in GPR images using Histogram of Oriented Gradients (HOG) , 2014, 2014 2nd International Conference on Electronic Design (ICED).

[27]  Hichem Frigui,et al.  AN SVM classifier with HMM-based kernel for landmine detection using ground penetrating radar , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Paolo Bestagini,et al.  Landmine detection from GPR data using convolutional neural networks , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[29]  K. C. Ho,et al.  Detection of shallow buried objects using an autoregressive model on the ground penetrating radar signal , 2013, Defense, Security, and Sensing.

[30]  Carla E. Brodley,et al.  Identifying Mislabeled Training Data , 1999, J. Artif. Intell. Res..

[31]  Leslie M. Collins,et al.  A hidden Markov context model for GPR-based landmine detection incorporating stick-breaking priors , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[32]  Jordan M. Malof,et al.  On Choosing Training and Testing Data for Supervised Algorithms in Ground-Penetrating Radar Data for Buried Threat Detection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Paul D. Gader,et al.  Embedding the multiple instance problem: applications to landmine detection with ground penetrating radar , 2013, Defense, Security, and Sensing.

[34]  Donghai Guan,et al.  Identifying mislabeled training data with the aid of unlabeled data , 2011, Applied Intelligence.

[35]  Jordan M. Malof,et al.  Algorithm development for deeply buried threat detection in GPR data , 2016, SPIE Defense + Security.