A structure-preserving surrogate model for the closure of the moment system of the Boltzmann equation using convex deep neural networks

Direct simulation of physical processes on a kinetic level is prohibitively expensive in aerospace applications due to the extremely high dimension of the solution spaces. In this paper, we consider the moment system of the Boltzmann equation, which projects the kinetic physics onto the hydrodynamic scale. The unclosed moment system can be solved in conjunction with the entropy closure strategy. Using an entropy closure provides structural benefits to the physical system of partial differential equations. Usually computing such closure of the system spends the majority of the total computational cost, since one needs to solve an ill-conditioned constrained optimization problem. Therefore, we build a neural network surrogate model to close the moment system, which preserves the structural properties of the system by design, but reduces the computational cost significantly. Numerical experiments are conducted to illustrate the performance of the current method in comparison to the traditional closure.

[1]  Martin Frank,et al.  Ray effect mitigation for the discrete ordinates method through quadrature rotation , 2018, J. Comput. Phys..

[2]  R. Molinaro,et al.  Physics Informed Neural Networks for Simulating Radiative Transfer , 2020, Journal of Quantitative Spectroscopy and Radiative Transfer.

[3]  Tianbai Xiao,et al.  Using neural networks to accelerate the solution of the Boltzmann equation , 2020, J. Comput. Phys..

[4]  Razvan Pascanu,et al.  Sobolev Training for Neural Networks , 2017, NIPS.

[5]  Thierry Goudon,et al.  Analysis of the M1 model: Well-posedness and diffusion asymptotics , 2013 .

[6]  R. Maulik,et al.  Neural network representability of fully ionized plasma fluid model closures , 2020, 2002.04106.

[7]  Emmanuel Franck,et al.  A neural network closure for the Euler-Poisson system based on kinetic simulations , 2020, ArXiv.

[8]  C. David Levermore,et al.  Entropy-based moment closures for kinetic equations , 1997 .

[9]  Martin Frank,et al.  A Regularized Entropy-Based Moment Method for Kinetic Equations , 2018, SIAM J. Appl. Math..

[10]  C. Cercignani.  The Boltzmann equation and its applications , 1988 .

[11]  B. Dubroca,et al.  Etude théorique et numérique d'une hiérarchie de modèles aux moments pour le transfert radiatif , 1999 .

[12]  D. S. Kershaw,et al.  Flux limiting nature`s own way -- A new method for numerical solution of the transport equation , 1976 .

[13]  Tianbai Xiao,et al.  Kinetic.jl: A portable finite volume toolbox for scientific and neural computing , 2021, J. Open Source Softw..

[14]  Cory D. Hauck,et al.  High-Order Entropy-Based Closures for Linear Transport in Slab Geometry II: A Computational Study of the Optimization Problem , 2012, SIAM J. Sci. Comput..

[15]  Moustafa T. Chahine,et al.  Foundations of Radiation Hydrodynamics (Dimitri Mihalas and Barbara Weibel Mihalas) , 1987 .

[16]  Chao Ma,et al.  Uniformly accurate machine learning-based hydrodynamic models for kinetic equations , 2019, Proceedings of the National Academy of Sciences.

[17]  Juntao Huang,et al.  Machine learning moment closure models for the radiative transfer equation I: directly learning a gradient based closure , 2021, J. Comput. Phys..

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  C. Schmeiser,et al.  Semiconductor equations , 1990 .

[20]  K. Atkinson,et al.  Spherical Harmonics and Approximations on the Unit Sphere: An Introduction , 2012 .

[21]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[22]  Martin Frank,et al.  Moment realizability and Kershaw closures in radiative transfer , 2013 .

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Cory D. Hauck,et al.  Optimization and large scale computation of an entropy-based moment closure , 2015, J. Comput. Phys..

[25]  Lei Xu,et al.  Input Convex Neural Networks : Supplementary Material , 2017 .

[26]  T. Luo,et al.  Physics-informed neural networks for solving multiscale mode-resolved phonon Boltzmann transport equation , 2021, Materials Today Physics.

[27]  C. D. Levermore,et al.  Moment closure hierarchies for kinetic theories , 1996 .

[28]  Chenhao Ma,et al.  Machine learning surrogate models for Landau fluid closure , 2019 .

[29]  Thomas A. Brunner,et al.  Forms of Approximate Radiation Transport , 2002 .

[30]  Kendall Atkinson,et al.  Numerical integration on the sphere , 1982, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[31]  Kun Xu,et al.  A velocity-space adaptive unified gas kinetic scheme for continuum and rarefied flows , 2018, J. Comput. Phys..

[32]  Cory D. Hauck,et al.  A Comparison of Moment Closures for Linear Kinetic Transport Equations: The Line Source Benchmark , 2013 .

[33]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[34]  George Em Karniadakis,et al.  Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation , 2020, J. Comput. Phys..

[35]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[36]  M. Frank,et al.  Entropy–Based Methods for Uncertainty Quantification of Hyperbolic Conservation Laws , 2021 .

[37]  E. Lewis,et al.  Computational Methods of Neutron Transport , 1993 .

[38]  Cory D. Hauck,et al.  Data-driven, structure-preserving approximations to entropy-based moment closures for kinetic equations , 2021, Communications in Mathematical Sciences.