Hybrid quadrature moment method for accurate and stable representation of non-Gaussian processes and their dynamics

Solving the population balance equation (PBE) for the dynamics of a dispersed phase coupled to a continuous fluid is expensive. Still, one can reduce the cost by representing the evolving particle density function in terms of its moments. In particular, quadrature-based moment methods (QBMMs) invert these moments with a quadrature rule, approximating the required statistics. QBMMs have been shown to accurately model sprays and soot with a relatively compact set of moments. However, significantly non-Gaussian processes such as bubble dynamics lead to numerical instabilities when extending their moment sets accordingly. We solve this problem by training a recurrent neural network (RNN) that adjusts the QBMM quadrature to evaluate unclosed moments with higher accuracy. The proposed method is tested on a simple model of bubbles oscillating in response to a temporally fluctuating pressure field. The approach decreases model-form error by a factor of 10 when compared to traditional QBMMs. It is both numerically stable and computationally efficient since it does not expand the baseline moment set. Additional quadrature points are also assessed, optimally placed and weighted according to an additional RNN. These points further decrease the error at low cost since the moment set is again unchanged.

[1]  Juntao Huang,et al.  Machine learning moment closure models for the radiative transfer equation II: enforcing global hyperbolicity in gradient based closures , 2021, Multiscale Model. Simul..

[2]  T. Sapsis,et al.  Machine-learning energy-preserving nonlocal closures for turbulent fluid flows and inertial tracers , 2021, Physical Review Fluids.

[3]  F. Laurent,et al.  Multi-fluid modelling of laminar polydisperse spray flames: origin, assumptions and comparison of sectional and sampling methods , 2001 .

[4]  R. Menikoff,et al.  The Riemann problem for fluid flow of real materials , 1989 .

[5]  Victor L. Streeter,et al.  An Investigation of the Effect of Cavitation Bubbles on the Momentum Loss in Transient Pipe Flow , 1971 .

[6]  G. Tryggvason,et al.  Using statistical learning to close two-fluid multiphase flow equations for bubbly flows in vertical channels , 2016 .

[7]  Robert McGraw,et al.  Description of Aerosol Dynamics by the Quadrature Method of Moments , 1997 .

[8]  Juntao Huang,et al.  Machine Learning Moment Closure Models for the Radiative Transfer Equation III: Enforcing Hyperbolicity and Physical Characteristic Speeds , 2021, Journal of Scientific Computing.

[9]  Petros Koumoutsakos,et al.  Data-driven forecasting of high-dimensional chaotic systems with long short-term memory networks , 2018, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[10]  Victor L. Streeter Transient Cavitating Pipe Flow , 1983 .

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Frédérique Laurent,et al.  Conditional hyperbolic quadrature method of moments for kinetic equations , 2018, J. Comput. Phys..

[13]  Ronald A. Roy,et al.  Liver hemostasis using high-intensity focused ultrasound. , 1997, Ultrasound in medicine & biology.

[14]  R. Bauer Remarkable Shrimps–Adaptations and Natural History of the Carideans , 2004 .

[15]  M. Gavaises,et al.  Unveiling the physical mechanism behind pistol shrimp cavitation , 2017, Scientific Reports.

[16]  Characterizing viscoelastic materials via ensemble-based data assimilation of bubble collapse observations. , 2020, Journal of the mechanics and physics of solids.

[17]  A. Evan,et al.  Cavitation bubble cluster activity in the breakage of kidney stones by lithotripter shockwaves. , 2003, Journal of endourology.

[18]  Yoshinobu Tsujimoto,et al.  A review of cavitation in hydraulic machinery , 2016 .

[19]  Olivier Desjardins,et al.  Three-dimensional conditional hyperbolic quadrature method of moments , 2019, J. Comput. Phys. X.

[20]  C. Yuan,et al.  Conditional quadrature method of moments for kinetic equations , 2011, J. Comput. Phys..

[22]  Spencer H. Bryngelson,et al.  A Gaussian moment method and its augmentation via LSTM recurrent neural networks for the statistics of cavitating bubble populations , 2019, International Journal of Multiphase Flow.

[23]  Jeremy N. Thornock,et al.  Large eddy simulation of polydisperse particles in turbulent coaxial jets using the direct quadrature method of moments , 2014 .

[24]  Andrea Prosperetti,et al.  Ensemble phase‐averaged equations for bubbly flows , 1994 .

[25]  Xiangyu Y. Hu,et al.  Phenomenology of bubble-collapse-driven penetration of biomaterial-surrogate liquid-liquid interfaces , 2018, Physical Review Fluids.

[26]  L. Crum,et al.  Physical mechanisms of the therapeutic effect of ultrasound (a review) , 2003 .

[27]  R. Caldwell,et al.  Biomechanics: Deadly strike mechanism of a mantis shrimp , 2004, Nature.

[28]  Christopher Earls Brennen,et al.  Cavitation in medicine , 2015, Interface Focus.

[29]  Doraiswami Ramkrishna,et al.  Population Balances: Theory and Applications to Particulate Systems in Engineering , 2000 .

[30]  Daniele Marchisio,et al.  Computational Models for Polydisperse Particulate and Multiphase Systems , 2013 .

[31]  S. D. Sharma,et al.  Cavitation noise studies on marine propellers , 1990 .

[32]  M. Kraft,et al.  A stochastic approach to calculate the particle size distribution function of soot particles in laminar premixed flames , 2003 .

[33]  Eric Johnsen,et al.  The effects of heat and mass diffusion on freely oscillating bubbles in a viscoelastic, tissue-like medium. , 2017, The Journal of the Acoustical Society of America.

[34]  Marc Massot,et al.  Simulation of reactive polydisperse sprays strongly coupled to unsteady flows in solid rocket motors: Efficient strategy using Eulerian Multi-Fluid methods , 2017, J. Comput. Phys..

[35]  Haibo Zhao,et al.  Analysis of four Monte Carlo methods for the solution of population balances in dispersed systems , 2007 .

[36]  C. Brennen Cavitation and Bubble Dynamics , 1995 .

[37]  Juntao Huang,et al.  Machine learning moment closure models for the radiative transfer equation I: directly learning a gradient based closure , 2021, J. Comput. Phys..

[38]  M. Frenklach,et al.  Dynamic Modeling of Soot Particle Coagulation and Aggregation: Implementation With the Method of Moments and Application to High-Pressure Laminar Premixed Flames , 1998 .

[39]  G. Tryggvason,et al.  Using statistical learning to close two-fluid multiphase flow equations for a simple bubbly system , 2015 .

[40]  R. P. Saini,et al.  Study of cavitation in hydro turbines—A review , 2010 .

[41]  Jitendra Kumar,et al.  A new framework for population balance modeling of spray fluidized bed agglomeration , 2015 .

[42]  Tim Colonius,et al.  QBMMlib: A library of quadrature-based moment methods , 2020, SoftwareX.

[43]  Tim Colonius,et al.  Numerical simulation of shock propagation in a polydisperse bubbly liquid , 2011 .

[44]  Spencer H. Bryngelson,et al.  A quantitative comparison of phase-averaged models for bubbly, cavitating flows , 2019, International Journal of Multiphase Flow.

[45]  T. Leighton,et al.  Numerical studies of cavitation erosion on an elastic–plastic material caused by shock-induced bubble collapse , 2017, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[46]  D. E. Rosner,et al.  Multivariate Population Balances via Moment and Monte Carlo Simulation Methods: An Important Sol Reaction Engineering Bivariate Example and “Mixed” Moments for the Estimation of Deposition, Scavenging, and Optical Properties for Populations of Nonspherical Suspended Particles , 2003 .

[47]  L A Crum,et al.  Acoustic cavitation generated by an extracorporeal shockwave lithotripter. , 1987, Ultrasound in medicine & biology.

[48]  P. Marmottant,et al.  Bubble Dynamics in Soft and Biological Matter , 2019, Annual Review of Fluid Mechanics.

[49]  Eduard Egusquiza,et al.  Detection of cavitation in hydraulic turbines , 2006 .

[50]  Timothy G. Leighton,et al.  An acoustical hypothesis for the spiral bubble nets of humpback whales and the implications for whale feeding , 2007 .

[51]  Bin Ji,et al.  Numerical analysis of cavitation evolution and excited pressure fluctuation around a propeller in non-uniform wake , 2012 .

[52]  Timothy G. Leighton,et al.  Trapped within a 'wall of sound': a possible mechanism for the bubble nets of the humpback whales , 2004 .

[53]  Jeffrey C. Heylmun,et al.  An open-source quadrature-based population balance solver for OpenFOAM , 2018 .

[54]  E. Johnsen,et al.  Bubble dynamics in a viscoelastic medium with nonlinear elasticity , 2015, Journal of Fluid Mechanics.

[55]  Michael E. Mueller,et al.  A joint volume-surface model of soot aggregation with the method of moments , 2009 .

[56]  K. Ando,et al.  Cavitation bubble nucleation induced by shock-bubble interaction in a gelatin gel , 2018 .

[57]  C D Kelman,et al.  Phaco-Emulsification and Aspiration , 1967 .

[58]  R. Martí,et al.  Hemostasis using high intensity focused ultrasound. , 1999, European journal of ultrasound : official journal of the European Federation of Societies for Ultrasound in Medicine and Biology.