A study of the effect of alternative similarity measures on the performance of graph-based anomaly detection algorithms

We investigate an anomaly detection framework that uses manifold-based distances within the existing skeleton kernel principle component analysis (SkPCA) manifold-learning technique. SkPCA constructs a manifold from the an adjacency matrix built using a sparse subsample of the data and a similarity measure. In anomaly detection the relative abundance of the anomalous class is rare by definition and in practice anomalous samples are unlikely to be randomly selected for inclusion in the sparse data subsample. Thus, anomalies should not be well modeled by the SkPCA-constructed model. Here, we consider alternative distance measures based on viewing spectral pixels as points in projective space, that is, each pixel is a 1-dimensional line through the origin. Chordal and geodesic distances are computed between hyperspectral pixels and detection performance leveraging these distances is compared to alternative anomaly detection algorithms. In addition, we introduce Ensemble SkPCA which utilizes the ensemble of mean, normalized detection scores corresponding to multiple randomly generated skeletons. For acceptable false alarm tolerances, the ensemble detection score derived from chordaland geodesic-based methods achieves higher probability of detection than Euclidean distance-based Ensemble SkPCA or the benchmark RX algorithm.

[1]  R. Taylor,et al.  The Numerical Treatment of Integral Equations , 1978 .

[2]  Heiko Hoffmann,et al.  Kernel PCA for novelty detection , 2007, Pattern Recognit..

[3]  David W. Messinger,et al.  A study of anomaly detection performance as a function of relative spectral abundances for graph- and statistics-based detection algorithms , 2017 .

[4]  David W. Messinger,et al.  A graph theoretic approach to anomaly detection in hyperspectral imagery , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[5]  Timothy Doster,et al.  Building robust neighborhoods for manifold learning-based image classification and anomaly detection , 2016, SPIE Defense + Security.

[6]  Heesung Kwon,et al.  Kernel RX-algorithm: a nonlinear anomaly detector for hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[7]  David W. Messinger,et al.  An adaptive locally linear embedding manifold learning approach for hyperspectral target detection , 2015, Defense + Security Symposium.

[8]  David W. Messinger,et al.  Anomaly detection using topology , 2007, SPIE Defense + Commercial Sensing.

[9]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[10]  Avner Halevy,et al.  An Overview of Numerical Acceleration Techniques for Nonlinear Dimension Reduction , 2017 .

[11]  John J. Benedetto,et al.  Spatial-spectral operator theoretic methods for hyperspectral image classification , 2016 .

[12]  Colin C. Olson,et al.  A Novel Detection Paradigm and Its Comparison to Statistical and Kernel-Based Anomaly Detection Algorithms for Hyperspectral Imagery , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  David W. Messinger,et al.  The SHARE 2012 data campaign , 2013, Defense, Security, and Sensing.

[14]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[15]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[16]  Michael Kirby,et al.  An application of persistent homology on Grassmann manifolds for the detection of signals in hyperspectral imagery , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[17]  W. Torgerson Multidimensional scaling: I. Theory and method , 1952 .

[18]  Xiaoli Yu,et al.  Adaptive multiple-band CFAR detection of an optical pattern with unknown spectral distribution , 1990, IEEE Trans. Acoust. Speech Signal Process..

[19]  Jonathan M. Nichols,et al.  Improved outlier identification in hyperspectral imaging via nonlinear dimensionality reduction , 2010, Defense + Commercial Sensing.

[20]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[21]  Bernhard Schölkopf,et al.  Kernel Principal Component Analysis , 1997, ICANN.

[22]  Timothy Doster,et al.  A parametric study of unsupervised anomaly detection performance in maritime imagery using manifold learning techniques , 2016, SPIE Defense + Security.

[23]  Alan P. Schaum,et al.  Spectral subspace matched filtering , 2001, SPIE Defense + Commercial Sensing.

[24]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[25]  David W. Messinger,et al.  Hyperspectral target detection using manifold learning and multiple target spectra , 2015, 2015 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[26]  Joydeep Ghosh,et al.  Applying nonlinear manifold learning to hyperspectral data for land cover classification , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[27]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[29]  C. C. Olson,et al.  Kernel PCA for anomaly detection in hyperspectral images using spectral-spatial fusion , 2018, Defense + Security.

[30]  David W. Messinger,et al.  Initial study of Schroedinger eigenmaps for spectral target detection , 2016 .

[31]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[32]  Y. Chikuse Statistics on special manifolds , 2003 .

[33]  Wojciech Czaja,et al.  Schroedinger Eigenmaps with nondiagonal potentials for spatial-spectral clustering of hyperspectral imagery , 2014, Defense + Security Symposium.

[34]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Michael Kirby,et al.  Sparse Grassmannian Embeddings for Hyperspectral Data Representation and Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[36]  Jonathan M. Nichols,et al.  Manifold learning techniques for unsupervised anomaly detection , 2018, Expert Syst. Appl..

[37]  Tom Fleischer Advances In Kernel Methods Support Vector Learning , 2016 .