On Choosing Training and Testing Data for Supervised Algorithms in Ground-Penetrating Radar Data for Buried Threat Detection

Ground-penetrating radar (GPR) is one of the most popular and successful sensing modalities that have been investigated for landmine and subsurface threat detection. Many of the detection algorithms applied to this task are supervised and therefore require labeled examples of threat and nonthreat data for training. Training data most often consist of 2-D images (or patches) of GPR data, from which features are extracted and provided to the classifier during training and testing. Identifying desirable training and testing locations to extract patches, which we term “keypoints,” is well established in the literature. In contrast, however, a large variety of strategies have been proposed regarding keypoint utilization (e.g., how many of the identified keypoints should be used at threat, or nonthreat, locations). Given a variety of keypoint utilization strategies that are available, it is very unclear: 1) which strategies are best or 2) whether the choice of strategy has a large impact on classifier performance. We address these questions by presenting a taxonomy of existing utilization strategies and then evaluating their effectiveness on a large data set using many different classifiers and features. We analyze the results and propose a new strategy, called PatchSelect, which outperforms other strategies across all experiments.

[1]  Paul D. Gader,et al.  Multiple instance learning for hidden Markov models: application to landmine detection , 2013, Defense, Security, and Sensing.

[2]  Paul D. Gader,et al.  Embedding the multiple instance problem: applications to landmine detection with ground penetrating radar , 2013, Defense, Security, and Sensing.

[3]  Joseph N. Wilson,et al.  A Large-Scale Systematic Evaluation of Algorithms Using Ground-Penetrating Radar for Landmine Detection and Discrimination , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Paul D. Gader,et al.  Feature and decision level sensor fusion of electromagnetic induction and ground penetrating radar sensors for landmine detection with hand-held units , 2002, Inf. Fusion.

[5]  Akara Prayote,et al.  Fast and efficient detection of buried object for GPR image , 2014, The 20th Asia-Pacific Conference on Communication (APCC2014).

[6]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[7]  Panos Liatsis,et al.  Image processing of ground penetrating radar data for landmine detection , 2006, SPIE Defense + Commercial Sensing.

[8]  Leslie M. Collins,et al.  Recognizing subsurface target responses in ground penetrating radar data using convolutional neural networks , 2015, Defense + Security Symposium.

[9]  X. Derobert,et al.  Assessment of statistical-based clutter reduction techniques on ground-coupled GPR data for the detection of buried objects in soils , 2014, Proceedings of the 15th International Conference on Ground Penetrating Radar.

[10]  Kwang Hee Ko,et al.  MULTI-FEATURE BASED DETECTION OF LANDMINES USING GROUND PENETRATING RADAR , 2013 .

[11]  K. C. Ho,et al.  Detection of deeply buried non-metal objects by ground penetrating radar using non-negative matrix factorization , 2015, Defense + Security Symposium.

[12]  Paul D. Gader,et al.  Model level fusion of edge histogram descriptors and gabor wavelets for landmine detection with ground penetrating radar , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[13]  Paul D. Gader,et al.  Detection and discrimination of landmines in ground-penetrating radar based on edge histogram descriptors , 2006, SPIE Defense + Commercial Sensing.

[14]  Maria A. Gonzalez-Huici,et al.  Evaluation of landmine detection performance applying two different algorithms to GPR field data , 2013, Defense, Security, and Sensing.

[15]  Leslie M. Collins,et al.  Texture Features for Antitank Landmine Detection Using Ground Penetrating Radar , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Leslie M. Collins,et al.  Application of image categorization methods for buried threat detection in GPR data , 2013, Defense, Security, and Sensing.

[17]  Joseph N. Wilson,et al.  Hierarchical Methods for Landmine Detection with Wideband Electro-Magnetic Induction and Ground Penetrating Radar Multi-Sensor Systems , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[18]  Hichem Frigui,et al.  A fisher vector representation of GPR data for detecting buried objects , 2016, SPIE Defense + Security.

[19]  Leslie M. Collins,et al.  Application of Markov random fields to landmine detection in ground penetrating radar data , 2008, SPIE Defense + Commercial Sensing.

[20]  P.A. Torrione,et al.  Performance of an adaptive feature-based processor for a wideband ground penetrating radar system , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[21]  Paul D. Gader,et al.  Multiple-Instance Hidden Markov Models With Applications to Landmine Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Leslie M. Collins,et al.  Discrimination mode processing for EMI and GPR sensors for hand-held land mine detection , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Paul D. Gader,et al.  Landmine detection using discrete hidden Markov models with Gabor features , 2007, SPIE Defense + Commercial Sensing.

[24]  Leslie M. Collins,et al.  Keypoint-based image processing for landmine detection in GPR data , 2012, Other Conferences.

[25]  Paul D. Gader,et al.  Landmine detection with Multiple Instance Hidden Markov Models , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[26]  L.P. Ligthart,et al.  Alternating-sign windowed energy projection of SAR focused GPR data , 2005, European Radar Conference, 2005. EURAD 2005..

[27]  Jordan M. Malof,et al.  Target signature localization in GPR data by jointly estimating and matching templates , 2015, Defense + Security Symposium.

[28]  Joseph N. Wilson,et al.  An Investigation of Using the Spectral Characteristics From Ground Penetrating Radar for Landmine/Clutter Discrimination , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[30]  Herbert A. David,et al.  Order Statistics , 2011, International Encyclopedia of Statistical Science.

[31]  Timothy C. Havens,et al.  GPR anomaly detection with robust principal component analysis , 2015, Defense + Security Symposium.

[32]  Leslie M. Collins,et al.  Multiple instance hidden Markov models for GPR-based landmine detection , 2013, Defense, Security, and Sensing.

[33]  Przemyslaw Klesk,et al.  Fast Analysis of C-Scans From Ground Penetrating Radar via 3-D Haar-Like Features With Application to Landmine Detection , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Paul D. Gader,et al.  Detection and Discrimination of Land Mines in Ground-Penetrating Radar Based on Edge Histogram Descriptors and a Possibilistic $K$-Nearest Neighbor Classifier , 2009, IEEE Transactions on Fuzzy Systems.

[35]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[36]  Paul D. Gader,et al.  Multi-stream continuous hidden Markov models with application to landmine detection , 2013, EURASIP J. Adv. Signal Process..

[37]  G. Nadim,et al.  Wavelet packets for GPR detection of non-metallic anti-personnel land mines based on higher-order-statistic , 2005, Proceedings of the 3rd International Workshop on Advanced Ground Penetrating Radar, 2005. IWAGPR 2005..

[38]  Joseph N. Wilson,et al.  An evaluation of several fusion algorithms for anti-tank landmine detection and discrimination , 2012, Inf. Fusion.

[39]  Alexander G. Yarovoy,et al.  A Novel Clutter Suppression Algorithm for Landmine Detection With GPR , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Leslie M. Collins,et al.  Histograms of Oriented Gradients for Landmine Detection in Ground-Penetrating Radar Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[42]  Hichem Frigui,et al.  Comparison of different classification algorithms for landmine detection using GPR , 2010, Defense + Commercial Sensing.

[43]  Huanhuan Chen,et al.  Probabilistic robust hyperbola mixture model for interpreting ground penetrating radar data , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[44]  Leslie M. Collins,et al.  Performance of a four parameter model for modeling landmine signatures in frequency domain wideband electromagnetic induction detection systems , 2007, SPIE Defense + Commercial Sensing.

[45]  Leslie M. Collins,et al.  Integration of lidar with the NIITEK GPR for improved performance on rough terrain , 2012, Other Conferences.

[46]  Leslie M. Collins,et al.  Multiple instance learning for landmine detection using ground penetrating radar , 2012, Other Conferences.

[47]  Leslie M. Collins,et al.  Application of feature extraction methods for landmine detection using the Wichmann/Niitek ground-penetrating radar , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Leslie M. Collins,et al.  Target localization and signature extraction in GPR data using expectation-maximization and principal component analysis , 2014, Defense + Security Symposium.

[49]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[50]  N. Aswini,et al.  Detection and classification of ground penetrating radar image using textrual features , 2014, 2014 International Conference on Advances in Electronics Computers and Communications.

[51]  Fabio Giovanneschi,et al.  A preliminary analysis of a sparse reconstruction based classification method applied to GPR data , 2015, 2015 8th International Workshop on Advanced Ground Penetrating Radar (IWAGPR).

[52]  Hichem Frigui,et al.  AN SVM classifier with HMM-based kernel for landmine detection using ground penetrating radar , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[53]  M. M. Mokji,et al.  Automatic target detection in GPR images using Histogram of Oriented Gradients (HOG) , 2014, 2014 2nd International Conference on Electronic Design (ICED).

[54]  Paul D. Gader,et al.  Landmine detection with ground penetrating radar using hidden Markov models , 2001, IEEE Trans. Geosci. Remote. Sens..

[55]  Paul D. Gader,et al.  Land-Mine Detection With Ground-Penetrating Radar Using Multistream Discrete Hidden Markov Models , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Hichem Frigui,et al.  Ensemble hidden Markov models with application to landmine detection , 2015, EURASIP J. Adv. Signal Process..

[57]  Leslie M. Collins,et al.  Decision Fusion of Ground-Penetrating Radar and Metal Detector Algorithms—A Robust Approach , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Alauddin Bhuiyan,et al.  Anti-personnel Mine Detection and Classification Using GPR Image , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[59]  Jordan M. Malof,et al.  Algorithm development for deeply buried threat detection in GPR data , 2016, SPIE Defense + Security.

[60]  Leslie M. Collins,et al.  A hidden Markov context model for GPR-based landmine detection incorporating stick-breaking priors , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.