Efficient Kernel Cook's Distance for Remote Sensing Anomalous Change Detection

Detecting anomalous changes in remote sensing images is a challenging problem, where many approaches and techniques have been presented so far. We rely on the standard field of multivariate statistics of diagnostic measures, which are concerned about the characterization of distributions, detection of anomalies, extreme events, and changes. One useful tool to detect multivariate anomalies is the celebrated Cook's distance. Instead of assuming a linear relationship, we present a novel kernelized version of the Cook's distance to address anomalous change detection in remote sensing images. Due to the large computational burden involved in the direct kernelization, and the lack of out-of-sample formulas, we introduce and compare both random Fourier features and Nyström implementations to approximate the solution. We study the kernel Cook's distance for anomalous change detection in a chronochrome scheme, where the anomalousness indicator comes from evaluating the statistical leverage of the residuals of regressors between time acquisitions. We illustrate the performance of all algorithms in a representative number of multispectral and very high resolution satellite images involving changes due to droughts, urbanization, wildfires, and floods. Very good results and computational efficiency confirm the validity of the approach.

[1]  James Theiler,et al.  Proposed Framework for Anomalous Change Detection , 2006 .

[2]  James Theiler,et al.  Background estimation in multispectral imagery , 2019, Optical Sensors and Sensing Congress (ES, FTS, HISE, Sensors).

[3]  Daniele Calandriello,et al.  On Fast Leverage Score Sampling and Optimal Learning , 2018, NeurIPS.

[4]  Matthias W. Seeger,et al.  Using the Nyström Method to Speed Up Kernel Machines , 2000, NIPS.

[5]  R. L. Eubank,et al.  Diagnostics for Smoothing Splines , 1985 .

[6]  C. Bouman,et al.  Statistical Methods for Materials Science , 2019 .

[7]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[8]  J. Anitha,et al.  Change detection techniques for remote sensing applications: a survey , 2019, Earth Science Informatics.

[9]  R. Dennis Cook,et al.  Detection of Influential Observation in Linear Regression , 2000, Technometrics.

[10]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[11]  N. Kishore Kumar,et al.  Literature survey on low rank approximation of matrices , 2016, ArXiv.

[12]  J. Ibrahim,et al.  Diagnostic measures for the Cox regression model with missing covariates , 2015, Biometrika.

[13]  Marco Diani,et al.  Introductory view of anomalous change detection in hyperspectral images within a theoretical gaussian framework , 2017, IEEE Aerospace and Electronic Systems Magazine.

[14]  Rong Jin,et al.  Nyström Method vs Random Fourier Features: A Theoretical and Empirical Comparison , 2012, NIPS.

[15]  Knut Conradsen,et al.  Multivariate Alteration Detection (MAD) and MAF Postprocessing in Multispectral, Bitemporal Image Data: New Approaches to Change Detection Studies , 1998 .

[16]  Alison Nordon,et al.  Early Detection Of Drought Stress in Arabidopsis Thaliana Utilsing a Portable Hyperspectral Imaging Setup , 2019, 2019 10th Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[17]  P. Switzer,et al.  A transformation for ordering multispectral data in terms of image quality with implications for noise removal , 1988 .

[18]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[19]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[20]  Choongrak Kim,et al.  Cook's distance in local polynomial regression , 2001 .

[21]  Francesca Bovolo,et al.  A Review of Change Detection in Multitemporal Hyperspectral Images: Current Techniques, Applications, and Challenges , 2019, IEEE Geoscience and Remote Sensing Magazine.

[22]  Daniel Llamocca,et al.  Using support vector machines for anomalous change detection , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[23]  David A. Clifton,et al.  A review of novelty detection , 2014, Signal Process..

[24]  Bo-Cheng Wei,et al.  Case-deletion measures for models with incomplete data , 2001 .

[25]  Michael W. Mahoney,et al.  Fast Randomized Kernel Ridge Regression with Statistical Guarantees , 2015, NIPS.

[26]  Mei-Ling Shyu,et al.  Unconstrained Flood Event Detection Using Adversarial Data Augmentation , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[27]  Kaare Brandt Petersen,et al.  Kernel Multivariate Analysis Framework for Supervised Subspace Learning: A Tutorial on Linear and Kernel Multivariate Methods , 2013, IEEE Signal Processing Magazine.

[28]  W. W. Muir,et al.  Regression Diagnostics: Identifying Influential Data and Sources of Collinearity , 1980 .

[29]  Redha Touati,et al.  Anomaly Feature Learning for Unsupervised Change Detection in Heterogeneous Images: A Deep Sparse Residual Model , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[31]  James Theiler,et al.  Total least squares for anomalous change detection , 2010, Defense + Commercial Sensing.

[32]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[33]  S. Weisberg,et al.  Characterizations of an Empirical Influence Function for Detecting Influential Cases in Regression , 1980 .

[34]  A. Schaum,et al.  Linear chromodynamics models for hyperspectral target detection , 2003, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652).

[35]  Whasoo Bae,et al.  Influence diagnostics in the varying coefficient model with longitudinal data , 2008, Comput. Stat..

[36]  Shannon R. McCurdy Ridge Regression and Provable Deterministic Ridge Leverage Score Sampling , 2018, NeurIPS.

[37]  James Theiler,et al.  Spatio-spectral anomalous change detection in hyperspectral imagery , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[38]  James Theiler,et al.  Elliptically Contoured Distributions for Anomalous Change Detection in Hyperspectral Imagery , 2010, IEEE Geoscience and Remote Sensing Letters.

[39]  Valero Laparra,et al.  Kernel Anomalous Change Detection for Remote Sensing Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Gustau Camps-Valls,et al.  Nonlinear Cook Distance for Anomalous Change Detection , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[41]  Dean A. Scribner,et al.  Object detection by using "whitening/dewhitening" to transform target signatures in multitemporal hyperspectral and multispectral imagery , 2003, IEEE Trans. Geosci. Remote. Sens..

[42]  Bo Du,et al.  Hyperspectral anomalous change detection based on joint sparse representation , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[43]  Chunhui Zhao,et al.  Hyperspectral Image Unmixing Based on Fast Kernel Archetypal Analysis , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  James Theiler,et al.  Local Coregistration Adjustment for Anomalous Change Detection , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Benjamin Recht,et al.  Random Features for Large-Scale Kernel Machines , 2007, NIPS.

[46]  Jon Atli Benediktsson,et al.  Advances in Hyperspectral Image Classification: Earth Monitoring with Statistical Learning Methods , 2013, IEEE Signal Processing Magazine.

[47]  Dan G. Blumberg,et al.  Analysis of hyperspectral anomaly change detection algorithms , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[48]  Chris Clifton Change Detection in Overhead Imagery Using Neural Networks , 2004, Applied Intelligence.

[49]  Choongrak Kim,et al.  Reference values for cook's distance , 1996 .

[50]  James Theiler,et al.  Quantitative comparison of quadratic covariance-based anomalous change detectors. , 2008, Applied optics.

[51]  Gustavo Camps-Valls,et al.  A family of kernel anomaly change detectors , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[52]  J. Ibrahim,et al.  Diagnostic Measures for Generalized Linear Models with Missing Covariates , 2009, Scandinavian journal of statistics, theory and applications.

[53]  Peijun Du,et al.  Fusion of Difference Images for Change Detection Over Urban Areas , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.