TransQuake: A transformer-based deep learning approach for seismic P-wave detection

Abstract Recent years have witnessed the increasing research interest in developing machine learning, especially deep learning which provides approaches for enhancing the performance of microearthquake detection. While considerable research efforts have been made in this direction, most of the state-of-the-art solutions are based on Convolutional Neural Network (CNN) structure, due to its remarkable capability of modeling local and static features. Indeed, the globally dynamic characteristics contained within time series data (i.e., seismic waves), which cannot be fully captured by CNN-based models, have been largely ignored in previous studies. In this paper, we propose a novel deep learning approach, TransQuake, for seismic P-wave detection. The approach is based on the most advanced sequential model, namely Transformer. To be specific, TransQuake can exploit the STA/LTA algorithm for adapting the three-component structure of seismic waves as input, and take advantage of the multi-head attention mechanism for conducting explainable model learning. Extensive evaluations of the aftershocks following the 2008 Wenchuan MW7.9 earthquake clearly demonstrates that TransQuake is able to achieve the best detection performance which excels the results obtained using other baselines. Meanwhile, experimental results also validate the interpretability of the results obtained by TransQuake, such as the attention distribution of seismic waves in different positions, and the analysis of the optimal relationship between coda wave and P-wave for noise identification.

[1]  Liu Ha,et al.  STA/LTA algorithm analysis and improvement of Microseismic signal automatic detection , 2014 .

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Paul A. Johnson,et al.  Continuous chatter of the Cascadia subduction zone revealed by machine learning , 2018, Nature Geoscience.

[5]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[8]  Paul Rodríguez,et al.  A Recurrent Neural Network that Learns to Count , 1999, Connect. Sci..

[9]  ZhouZhi-Hua,et al.  Training Cost-Sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2006 .

[10]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[11]  Enhong Chen,et al.  Aftershock Detection with Multi-scale Description Based Neural Network , 2019, 2019 IEEE International Conference on Data Mining (ICDM).

[12]  Steven J. Gibbons,et al.  The detection and location of low magnitude earthquakes in northern Norway using multi-channel waveform correlation at regional distances , 2007 .

[13]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[14]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[15]  C. Satriano,et al.  Automatic Picker Developments and Optimization: FilterPicker—a Robust, Broadband Picker for Real-Time Seismic Monitoring and Earthquake Early Warning , 2012 .

[16]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[17]  Christopher John Young,et al.  A comparison of select trigger algorithms for automated global seismic phase and event detection , 1998, Bulletin of the Seismological Society of America.

[18]  Stavros M. Panas,et al.  Automatic S-phase arrival determination of seismic signals using nonlinear filtering and higher-order statistics , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[19]  James H. McClellan,et al.  Deep learning for seismic phase detection and picking in the aftershock zone of 2008 Mw7.9 Wenchuan earthquake , 2019, Physics of the Earth and Planetary Interiors.

[20]  José Luis Rojo-Álvarez,et al.  On the use of multi-class support vector machines for classification of seismic signals at Cotopaxi volcano , 2017, 2017 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC).

[21]  Zhibo Chen,et al.  Locating induced earthquakes with a network of seismic stations in Oklahoma via a deep learning method , 2018, Scientific Reports.

[22]  Michaël Gharbi,et al.  Convolutional neural network for earthquake detection and location , 2017, Science Advances.

[23]  Clara E Yoon,et al.  Earthquake detection through computationally efficient similarity search , 2015, Science Advances.

[24]  R. V. Allen,et al.  Automatic phase pickers: Their present use and future prospects , 1982 .

[25]  A. Ng Feature selection, L1 vs. L2 regularization, and rotational invariance , 2004, Twenty-first international conference on Machine learning - ICML '04.

[26]  Bertrand Rouet-Leduc,et al.  Probing Slow Earthquakes With Deep Learning , 2019, Geophysical research letters.

[27]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  A. Husker,et al.  Using systematically characterized low‐frequency earthquakes as a fault probe in Guerrero, Mexico , 2014 .