A deep learning approach to detecting volcano deformation from satellite imagery using synthetic datasets

Abstract Satellites enable widespread, regional or global surveillance of volcanoes and can provide the first indication of volcanic unrest or eruption. Here we consider Interferometric Synthetic Aperture Radar (InSAR), which can be employed to detect surface deformation with a strong statistical link to eruption. Recent developments in technology as well as improved computational power have resulted in unprecedented quantities of monitoring data, which can no longer be inspected manually. The ability of machine learning to automatically identify signals of interest in these large InSAR datasets has already been demonstrated, but data-driven techniques, such as convolutional neutral networks (CNN) require balanced training datasets of positive and negative signals to effectively differentiate between real deformation and noise. As only a small proportion of volcanoes are deforming and atmospheric noise is ubiquitous, the use of machine learning for detecting volcanic unrest is more challenging than many other applications. In this paper, we address this problem using synthetic interferograms to train the AlexNet CNN. The synthetic interferograms are composed of 3 parts: 1) deformation patterns based on a Monte Carlo selection of parameters for analytic forward models, 2) stratified atmospheric effects derived from weather models and 3) turbulent atmospheric effects based on statistical simulations of correlated noise. The AlexNet architecture trained with synthetic data outperforms that trained using real interferograms alone, based on classification accuracy and positive predictive value (PPV). However, the models used to generate the synthetic signals are a simplification of the natural processes, so we retrain the CNN with a combined dataset consisting of synthetic models and selected real examples, achieving a final PPV of 82%. Although applying atmospheric corrections to the entire dataset is computationally expensive, it is relatively simple to apply them to the small subset of positive results. This further improves the detection performance without a significant increase in computational burden (PPV of 100%). Thus, we demonstrate that training with synthetic examples can improve the ability of CNNs to detect volcano deformation in satellite images, and propose an efficient workflow for the development of automated systems.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Min Chen,et al.  Deep Learning for Imbalanced Multimedia Data Classification , 2015, 2015 IEEE International Symposium on Multimedia (ISM).

[3]  Zhenhong Li,et al.  Generation of real‐time mode high‐resolution water vapor fields from GPS observations , 2017 .

[4]  David Bull,et al.  Application of Machine Learning to Classification of Volcanic Deformation in Routinely Generated InSAR Data , 2018, Journal of Geophysical Research: Solid Earth.

[5]  Dimitrios Gunopulos,et al.  Indexing Multidimensional Time-Series , 2004, The VLDB Journal.

[6]  Joachim Weickert,et al.  How to Choose Interpolation Data in Images , 2009, SIAM J. Appl. Math..

[7]  Zhenhong Li,et al.  Interferometric synthetic aperture radar atmospheric correction using a GPS-based iterative tropospheric decomposition model , 2018 .

[8]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[9]  Marie-Pierre Doin,et al.  Improving InSAR geodesy using Global Atmospheric Models , 2014 .

[10]  Ian Parsons,et al.  Surface deformation due to shear and tensile faults in a half-space , 1986 .

[11]  Zhong Lu,et al.  Investigating long-term subsidence at Medicine Lake Volcano, CA, using multitemporal InSAR , 2014 .

[12]  Susanna K. Ebmeier,et al.  Application of independent component analysis to multitemporal InSAR data with volcanic case studies , 2016 .

[13]  Lars Schmidt-Thieme,et al.  Cost-sensitive learning methods for imbalanced data , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[14]  Masakazu Matsugu,et al.  Subject independent facial expression recognition with robust face detection using a convolutional neural network , 2003, Neural Networks.

[15]  Rowena B. Lohman,et al.  Some thoughts on the use of InSAR data to constrain models of surface deformation: Noise structure and data downsampling , 2005 .

[16]  Andrew Hooper,et al.  Blind Signal Separation Methods for InSAR: The Potential to Automatically Detect and Monitor Signals of Volcanic Deformation , 2018, Journal of Geophysical Research: Solid Earth.

[17]  Yuhong Li,et al.  CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  James Jackson,et al.  The 1994 Sefidabeh (eastern Iran) earthquakes revisited: new evidence from satellite radar interferometry and carbonate dating about the growth of an active fold above a blind thrust fault , 2006 .

[19]  Mark Simons,et al.  Deformation due to a pressurized horizontal circular crack in an elastic half-space, with applications to volcano geodesy , 2001 .

[20]  Fuk K. Li,et al.  Synthetic aperture radar interferometry , 2000, Proceedings of the IEEE.

[21]  Tamsin A. Mather,et al.  Applicability of InSAR to tropical volcanoes: insights from Central America , 2013 .

[22]  Pierre Baldi,et al.  Learning Activation Functions to Improve Deep Neural Networks , 2014, ICLR.

[23]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[24]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[25]  Jan-Peter Muller,et al.  Interferometric synthetic aperture radar (InSAR) atmospheric correction: GPS, moderate resolution Imaging spectroradiometer (MODIS), and InSAR integration , 2005 .

[26]  David R. Bull,et al.  Defectnet: Multi-Class Fault Detection on Highly-Imbalanced Datasets , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[27]  R. S. J. Sparks,et al.  Global link between deformation and volcanic eruption quantified by satellite imagery , 2014, Nature Communications.

[28]  K. Mogi Relations between the Eruptions of Various Volcanoes and the Deformations of the Ground Surfaces around them , 1958 .

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  T. Wright,et al.  Statistical comparison of InSAR tropospheric correction techniques , 2015 .

[31]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[32]  Zhong Lu,et al.  Systematic assessment of atmospheric uncertainties for InSAR data at volcanic arcs using large-scale atmospheric models: Application to the Cascade volcanoes, United States , 2015 .

[33]  Vir V. Phoha,et al.  K-Means+ID3: A Novel Method for Supervised Anomaly Detection by Cascading K-Means Clustering and ID3 Decision Tree Learning Methods , 2007, IEEE Transactions on Knowledge and Data Engineering.

[34]  Nathalie Japkowicz,et al.  Concept-Learning in the Presence of Between-Class and Within-Class Imbalances , 2001, Canadian Conference on AI.

[35]  Simon A. Carn,et al.  Synthesizing multi-sensor, multi-satellite, multi-decadal datasets for global volcano monitoring , 2018, Journal of Volcanology and Geothermal Research.

[36]  R. Hanssen Radar Interferometry: Data Interpretation and Error Analysis , 2001 .

[37]  Zhenhong Li,et al.  Generic Atmospheric Correction Model for Interferometric Synthetic Aperture Radar Observations , 2018, Journal of Geophysical Research: Solid Earth.

[38]  Christian S. Jensen,et al.  Outlier Detection for Multidimensional Time Series Using Deep Neural Networks , 2018, 2018 19th IEEE International Conference on Mobile Data Management (MDM).

[39]  T. Wright,et al.  Multi-interferogram method for measuring interseismic deformation: Denali Fault, Alaska , 2007 .

[40]  A. Hooper,et al.  Volcanology: lessons learned from synthetic aperture radar imagery , 2014 .