Acceleration of Boltzmann Collision Integral Calculation Using Machine Learning

The Boltzmann equation is essential to the accurate modeling of rarefied gases. Unfortunately, traditional numerical solvers for this equation are too computationally expensive for many practical applications. With modern interest in hypersonic flight and plasma flows, to which the Boltzmann equation is relevant, there would be immediate value in an efficient simulation method. The collision integral component of the equation is the main contributor of the large complexity. A plethora of new mathematical and numerical approaches have been proposed in an effort to reduce the computational cost of solving the Boltzmann collision integral, yet it still remains prohibitively expensive for large problems. This paper aims to accelerate the computation of this integral via machine learning methods. In particular, we build a deep convolutional neural network to encode/decode the solution vector, and enforce conservation laws during post-processing of the collision integral before each time-step. Our preliminary results for the spatially homogeneous Boltzmann equation show a drastic reduction of computational cost. Specifically, our algorithm requires O(n3) operations, while asymptotically converging direct discretization algorithms require O(n6), where n is the number of discrete velocity points in one velocity dimension. Our method demonstrated a speed up of 270 times compared to these methods while still maintaining reasonable accuracy.

[1]  Truong Nguyen,et al.  A deterministic-stochastic method for computing the Boltzmann collision integral in $\mathcal{O}(MN)$ operations , 2018 .

[2]  Jingwei Hu,et al.  A Fast Spectral Method for the Boltzmann Collision Operator with General Collision Kernels , 2016, SIAM J. Sci. Comput..

[3]  Akil Narayan,et al.  Deterministic Numerical Schemes for the Boltzmann Equation , 2009, 0911.3589.

[4]  A. Alekseenko,et al.  Evaluating High Order Discontinuous Galerkin Discretization of the Boltzmann Collision Integral in $O(N^2)$ Operations Using the Discrete Fourier Transform , 2018, 1801.05892.

[5]  Arnout M. P. Boelens,et al.  Tensor methods for the Boltzmann-BGK equation , 2019, J. Comput. Phys..

[6]  Rishabh Jain,et al.  Numerical scheme for the far-out-of-equilibrium time-dependent Boltzmann collision operator: 1D second-degree momentum discretisation and adaptive time stepping , 2021, Comput. Phys. Commun..

[7]  Justin A. Sirignano,et al.  DGM: A deep learning algorithm for solving partial differential equations , 2017, J. Comput. Phys..

[8]  R. Hiptmair,et al.  Hyperbolic cross approximation for the spatially homogeneous Boltzmann equation , 2015 .

[9]  George Em Karniadakis,et al.  Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation , 2020, J. Comput. Phys..

[10]  R. Hiptmair,et al.  Tensor-Product Discretization for the Spatially Inhomogeneous and Transient Boltzmann Equation in Two Dimensions , 2017 .

[11]  D. B. Goldstein,et al.  Monte Carlo solution of the Boltzmann equation via a discrete velocity model , 2011, J. Comput. Phys..

[12]  S. Rjasanow,et al.  Fast deterministic method of solving the Boltzmann equation for hard spheres , 1999 .

[13]  Lorenzo Pareschi,et al.  A Fourier spectral method for homogeneous boltzmann equations , 1996 .

[14]  Sergej Rjasanow,et al.  Numerical solution of the Boltzmann equation on the uniform grid , 2002, Computing.

[15]  F. G. Tcheremissine,et al.  Solution to the Boltzmann kinetic equation for high-speed flows , 2006 .

[16]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[17]  Lorenzo Pareschi,et al.  Fast algorithms for computing the Boltzmann collision operator , 2006, Math. Comput..

[18]  Raphaël Loubère,et al.  An efficient numerical method for solving the Boltzmann equation in multidimensions , 2016, J. Comput. Phys..

[19]  Lorenzo Pareschi,et al.  Convolutive decomposition and fast summation methods for discrete-velocity approximations of the Boltzmann equation , 2012, 1201.3986.

[20]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[21]  Yonghao Zhang,et al.  A fast spectral method for the Boltzmann equation for monatomic gas mixtures , 2015, J. Comput. Phys..

[22]  Irene M. Gamba,et al.  SHOCK AND BOUNDARY STRUCTURE FORMATION BY SPECTRAL-LAGRANGIAN METHODS FOR THE INHOMOGENEOUS BOLTZMANN TRANSPORT EQUATION * , 2010 .

[23]  S. Rjasanow,et al.  Difference scheme for the Boltzmann equation based on the Fast Fourier Transform , 1997 .

[24]  Jingwei Hu,et al.  A Discontinuous Galerkin Fast Spectral Method for the Full Boltzmann Equation with General Collision Kernels , 2018, J. Comput. Phys..

[25]  C. Cercignani Rarefied Gas Dynamics: From Basic Concepts to Actual Calculations , 2000 .

[26]  Irene M. Gamba,et al.  A spectral-Lagrangian Boltzmann solver for a multi-energy level gas , 2013, J. Comput. Phys..

[27]  S. Rjasanow,et al.  A Weak Formulation of the Boltzmann Equation Based on the Fourier Transform , 2007 .

[28]  V. Aristov Direct Methods for Solving the Boltzmann Equation and Study of Nonequilibrium Flows , 2001 .

[29]  Boris Hanin,et al.  Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations , 2017, Mathematics.

[30]  Piotr Kowalczyk,et al.  Fast numerical method for the Boltzmann equation on non-uniform grids , 2008, J. Comput. Phys..

[31]  Irene M. Gamba,et al.  A Conservative Discontinuous Galerkin Solver for the Space Homogeneous Boltzmann Equation for Binary Interactions , 2018, SIAM J. Numer. Anal..

[32]  Yonghao Zhang,et al.  Deterministic numerical solutions of the Boltzmann equation using the fast spectral method , 2013, J. Comput. Phys..

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Giacomo Dimarco,et al.  Numerical methods for kinetic equations* , 2014, Acta Numerica.

[35]  E Weinan,et al.  Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations , 2017, Communications in Mathematics and Statistics.

[36]  Lei Wu,et al.  Influence of intermolecular potentials on rarefied gas flows: Fast spectral solutions of the Boltzmann equation , 2015, Physics of Fluids.

[37]  Lorenzo Pareschi,et al.  Solving the Boltzmann Equation in N log2N , 2006, SIAM J. Sci. Comput..

[38]  A. Wood,et al.  An ultra-sparse approximation of kinetic solutions to spatially homogeneous flows of non-continuum gas , 2020 .

[39]  Irene M. Gamba,et al.  Spectral-Lagrangian methods for collisional models of non-equilibrium statistical states , 2009, J. Comput. Phys..

[40]  S. A. Schaaf Rarefied Gas Dynamics , 1969 .