Fast scalable implicit solver with convergence of equation-based modeling and data-driven learning: earthquake city simulation on low-order unstructured finite element

We developed a new approach in converging equation-based modeling and data-driven learning on high-performance computing resources to accelerate physics-based earthquake simulations. Here, data-driven learning based on data generated while conducting equation-based modeling was used to accelerate the convergence process of an implicit low-order unstructured finite-element solver. This process involved a suitable combination of data-driven learning for estimating high-frequency components and coarsened equation-based models for estimating low-frequency components of the problem. The developed solver achieved a 12.8-fold speedup over the state-of-art solver with a 96.4% size-up scalability up to 24,576 nodes (98,304 MPI processes × 12 OpenMP threads = 1,179,648 CPU cores) of Fugaku with 126,581,788,413 degrees-of-freedom, leading to solving a huge city earthquake shaking analysis in a 10.1-fold shorter time than the previous state-of-the-art solver. Furthermore, to show that the developed method attains high performance on variety of systems with small implementation costs, we ported the developed method to recent GPU systems by use of directive based methods (OpenACC). The equation based modeling and the data-driven learning are of utterly different characteristics, and hence they are rarely combined. The developed approach of combining them is effective, and remarkable results mentioned above are achieved.

[1]  Takayuki Okamoto,et al.  The Tofu Interconnect D , 2018, 2018 IEEE International Conference on Cluster Computing (CLUSTER).

[2]  Pher Errol Balde Quinay,et al.  Implicit nonlinear wave simulation with 1.08T DOF and 0.270T unstructured finite elements to enhance comprehensive earthquake simulation , 2015, SC15: International Conference for High Performance Computing, Networking, Storage and Analysis.

[3]  Franck Cappello,et al.  Big data and extreme-scale computing , 2018, Int. J. High Perform. Comput. Appl..

[4]  John Kubiatowicz,et al.  Hot Chips 30 , 2019, IEEE Micro.

[5]  S. Ide,et al.  The slow earthquake spectrum in the Japan Trench illuminated by the S-net seafloor observatories , 2019, Science.

[6]  Pradeep Dubey,et al.  Petascale High Order Dynamic Rupture Earthquake Simulations on Heterogeneous Supercomputers , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[7]  Naonori Ueda,et al.  AI with Super-computed Data for Monte Carlo Earthquake Hazard Classification , 2017 .

[8]  Thomas J. R. Hughes,et al.  Solution algorithms for nonlinear transient heat conduction analysis employing element-by-element iterative strategies , 1985 .

[9]  T. Straatsma,et al.  Low-Order Finite Element Solver with Small Matrix-Matrix Multiplication Accelerated by AI-Specific Hardware for Crustal Deformation Computation , 2020, PASC.

[10]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[11]  Tjerk P. Straatsma,et al.  A Fast Scalable Implicit Solver for Nonlinear Time-Evolution Earthquake City Problem on Low-Ordered Unstructured Finite Elements with Artificial Intelligence and Transprecision Computing , 2018, SC18: International Conference for High Performance Computing, Networking, Storage and Analysis.

[12]  Tsuyoshi Ichimura,et al.  Physics-Based Urban Earthquake Simulation Enhanced by 10.7 BlnDOF × 30 K Time-Step Unstructured FE Non-Linear Seismic Wave Simulation , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[13]  Egill Hauksson,et al.  Searching for hidden earthquakes in Southern California , 2019, Science.

[14]  Tsuyoshi Ichimura,et al.  Wave Propagation Simulation of Complex Multi-Material Problems with Fast Low-Order Unstructured Finite-Element Meshing and Analysis , 2018, HPC Asia.

[15]  I. Mezić,et al.  Analysis of Fluid Flows via Spectral Properties of the Koopman Operator , 2013 .

[16]  Tsuyoshi Ichimura,et al.  Fast and Scalable Low-Order Implicit Unstructured Finite-Element Solver for Earth's Crust Deformation Problem , 2017, PASC.

[17]  Tsuyoshi Ichimura,et al.  High-fidelity nonlinear low-order unstructured implicit finite-element seismic simulation of important structures by accelerated element-by-element method , 2021, J. Comput. Sci..

[18]  A. Kato,et al.  Connecting slow earthquakes to huge earthquakes , 2016, Science.

[19]  Jonathan B. Ajo-Franklin,et al.  Illuminating seafloor faults and ocean dynamics with dark fiber distributed acoustic sensing , 2019, Science.

[20]  Alice-Agnes Gabriel,et al.  Extreme Scale Multi-Physics Simulations of the Tsunamigenic 2004 Sumatra Megathrust Earthquake , 2017, SC17: International Conference for High Performance Computing, Networking, Storage and Analysis.

[21]  Maarten V. de Hoop,et al.  Machine learning for data-driven discovery in solid Earth geoscience , 2019, Science.