Bi-Stride Multi-Scale Graph Neural Network for Mesh-Based Physical Simulation

Learning physical systems on unstructured meshes by flat Graph neural networks (GNNs) faces the challenge of modeling the long-range interactions due to the scaling complexity w.r.t. the number of nodes, limiting the generalization under mesh refinement. On regular grids, the convolutional neural networks (CNNs) with a U-net structure can resolve this challenge by efficient stride, pooling, and upsampling operations. Nonetheless, these tools are much less developed for graph neural networks (GNNs), especially when GNNs are employed for learning large-scale mesh-based physics. The challenges arise from the highly irregular meshes and the lack of effective ways to construct the multi-level structure without losing connectivity. Inspired by the bipartite graph determination algorithm, we introduce Bi-Stride Multi-Scale Graph Neural Network (BSMS-GNN) by proposing bi-stride as a simple pooling strategy for building the multi-level GNN. Bi-stride pools nodes by striding every other BFS frontier; it 1) works ro-bustly on any challenging mesh in the wild, 2) avoids using a mesh generator at coarser levels, 3) avoids the spatial proximity for building coarser levels, and 4) uses non-parametrized aggregating/returning instead of MLPs during pooling and unpooling. Experiments show that our framework significantly outperforms the state-of-the-art method’s computational efficiency in representative physics-based simulation cases.

[1]  A. Pritzel,et al.  MultiScale MeshGraphNets , 2022, ArXiv.

[2]  A. Bharath,et al.  Multi-scale rotation-equivariant graph neural networks for unsteady Eulerian fluid dynamics , 2022, Physics of Fluids.

[3]  Daniel Z. Huang,et al.  Fourier Neural Operator with Learned Deformations for PDEs on General Geometries , 2022, ArXiv.

[4]  A. Bharath,et al.  Towards Fast Simulation of Environmental Fluid Mechanics with Multi-Scale Graph Neural Networks , 2022, ArXiv.

[5]  Mridul Aanjaneya,et al.  An Efficient B-Spline Lagrangian/Eulerian Method for Compressible Flow, Shock Waves, and Fracturing Solids , 2022, ACM Trans. Graph..

[6]  T. Pfaff,et al.  Predicting Physics in Mesh-reduced Space with Temporal Attention , 2022, ICLR.

[7]  D. Kaufman,et al.  Guaranteed globally injective 3D deformation processing , 2021, ACM Trans. Graph..

[8]  Matthew J. Zahr,et al.  Physics-informed graph neural Galerkin networks: A unified framework for solving PDE-governed forward and inverse problems , 2021, Computer Methods in Applied Mechanics and Engineering.

[9]  Anil A. Bharath,et al.  Simulating Continuum Mechanics with Multi-Scale Graph Neural Networks , 2021, ArXiv.

[10]  S. Riedelbauch,et al.  Direct Prediction of Steady-State Flow Fields in Meshed Domain with Graph Networks , 2021, ArXiv.

[11]  Samuel Kaski,et al.  Rethinking pooling in graph neural networks , 2020, NeurIPS.

[12]  T. Pfaff,et al.  Learning Mesh-Based Simulation with Graph Networks , 2020, ICLR.

[13]  Timothy R. Langlois,et al.  Incremental potential contact , 2020, ACM Trans. Graph..

[14]  J. Zico Kolter,et al.  Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Prediction , 2020, ICML.

[15]  Nikola B. Kovachki,et al.  Multipole Graph Neural Operator for Parametric Partial Differential Equations , 2020, NeurIPS.

[16]  Abhinav Vishnu,et al.  CFDNet: a deep learning-based accelerator for fluid simulations , 2020, ICS.

[17]  Han Gao,et al.  PhyGeoNet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain , 2020, J. Comput. Phys..

[18]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[19]  Mario Lino Valencia,et al.  Comparing recurrent and convolutional neural networks for predicting wave propagation , 2020, ArXiv.

[20]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[21]  Jiajun Bu,et al.  Hierarchical Graph Pooling with Structure Learning , 2019, AAAI 2020.

[22]  Xu Sun,et al.  Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View , 2019, AAAI.

[23]  Luning Sun,et al.  Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data , 2019, Computer Methods in Applied Mechanics and Engineering.

[24]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[26]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[27]  Markus H. Gross,et al.  Deep Fluids: A Generative Network for Parameterized Fluid Simulations , 2018, Comput. Graph. Forum.

[28]  Raia Hadsell,et al.  Graph networks as learnable physics engines for inference and control , 2018, ICML.

[29]  Jessica B. Hamrick,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[30]  Daniel L. K. Yamins,et al.  Flexible Neural Representation for Physics Prediction , 2018, NeurIPS.

[31]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[32]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[34]  Joshua B. Tenenbaum,et al.  A Compositional Object-Based Approach to Learning Physical Dynamics , 2016, ICLR.

[35]  Wei Li,et al.  Convolutional Neural Networks for Steady Flow Approximation , 2016, KDD.

[36]  Chenfanfu Jiang,et al.  The material point method for simulating continuum materials , 2016, SIGGRAPH Courses.

[37]  Ken Perlin,et al.  Accelerating Eulerian Fluid Simulation With Convolutional Networks , 2016, ICML.

[38]  Pierre Vandergheynst,et al.  Geodesic Convolutional Neural Networks on Riemannian Manifolds , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[39]  Robert Bridson,et al.  Fluid Simulation for Computer Graphics , 2008 .

[40]  Marc Schoenauer,et al.  Multi-resolution Graph Neural Networks for PDE Approximation , 2021, ICANN.

[41]  A. Wills,et al.  Physics-Informed Machine , 2021 .

[42]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[43]  R. Häggkvist,et al.  Bipartite graphs and their applications , 1998 .

[44]  Kunihiko Fukushima,et al.  Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition , 1982 .