Comparison of supervised and unsupervised machine learning techniques for UXO classification using EMI data

Classification tools including Support Vector Machines (SVM) and Neural Networks (NN) are employed, and their performances compared for Unexploded Ordnance (UXO) classification using live site electromagnetic induction (EMI) data. Both SVM and NN are examples of supervised machine-learning techniques, whose purpose is to label the features (extracted from the incoming data of the unknown subsurface anomalies) based on previously trained examples. In this paper a set of three features are extracted from the EMI decay curves of the physics-based intrinsic, effective dipole moment, called the total Normalized Surface Magnetic Source (NSMS). This data is first used to train both the SVM and NN models and further serves as a basis for UXO classification. These techniques are then compared to an unsupervised learning approach, based on agglomerative hierarchical clustering followed by Gaussian Mixture modeling. We found that such combination provides reduction in the amount of required training data (which is being requested solely based on the clustering results) and allows for convenient probabilistic interpretation of the classification. The classification results themselves depend on the UXO caliber, material composition and actual live UXO site's conditions. Therefore, here we report the classification results for a live UXO data set, collected at former Camp San Luis Obispo, CA. This study includes four targets-of-interest: 60-mm, 81-mm, and 4.2-in mortars and 2.36-in rockets. The classification performance between clutters and UXO is studied and the corresponding ROC curves are illustrated.

[1]  G. N. Lance,et al.  A general theory of classificatory sorting strategies: II. Clustering systems , 1967, Comput. J..

[2]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[3]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[4]  R.P. Lippmann,et al.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[5]  Martin T. Hagan,et al.  Gauss-Newton approximation to Bayesian learning , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[6]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[7]  Herbert H. Nelson,et al.  Enhanced discrimination among UXO-like targets using extremely low-frequency magnetic fields , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[8]  P. Mahalanobis On the generalized distance in statistics , 1936 .

[9]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[10]  Lutz Prechelt,et al.  Early Stopping-But When? , 1996, Neural Networks: Tricks of the Trade.

[11]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[12]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[13]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[14]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[15]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[16]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[17]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[18]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  D. Oldenburg,et al.  A Discrimination Algorithm for UXO Using Time Domain Electromagnetics , 2001 .

[21]  Irma Shamatava,et al.  Fast and accurate calculation of physically complete EMI response by a heterogeneous metallic object , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Lutz Prechelt,et al.  Automatic early stopping using cross validation: quantifying the criteria , 1998, Neural Networks.

[23]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[24]  Jin Au Kong,et al.  Support Vector Machine and Neural Network Classification of Metallic Objects Using Coefficients of the Spheroidal MQS Response Modes , 2008, IEEE Transactions on Geoscience and Remote Sensing.