DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks

Electroconvection is a multiphysics problem involving coupling of the flow field with the electric field as well as the cation and anion concentration fields. For small Debye lengths, very steep boundary layers are developed, but standard numerical methods can simulate the different regimes quite accurately. Here, we use electroconvection as a benchmark problem to put forward a new data assimilation framework, the DeepM&Mnet, for simulating multiphysics and multiscale problems at speeds much faster than standard numerical methods using pre-trained neural networks (NNs). We first pre-train DeepONets that can predict independently each field, given general inputs from the rest of the fields of the coupled system. DeepONets can approximate nonlinear operators and are composed of two sub-networks, a branch net for the input fields and a trunk net for the locations of the output field. DeepONets, which are extremely fast, are used as building blocks in the DeepM&Mnet and form constraints for the multiphysics solution along with some sparse available measurements of any of the fields. We demonstrate the new methodology and document the accuracy of each individual DeepONet, and subsequently we present two different DeepM&Mnet architectures that infer accurately and efficiently 2D electroconvection fields for unseen electric potentials. The DeepM&Mnet framework is general and can be applied for building any complex multiphysics and multiscale models based on very few measurements using pre-trained DeepONets in a plug-and-play mode.

[1]  Ali Mani,et al.  Direct numerical simulation of electroconvective instability and hydrodynamic chaos near an ion-selective surface , 2013 .

[2]  Karthik Duraisamy,et al.  Prediction of aerodynamic flow fields using convolutional neural networks , 2019, Computational Mechanics.

[3]  Ali Mani,et al.  Simulation of chaotic electrokinetic transport: performance of commercial software versus custom-built direct numerical simulation codes. , 2015, Journal of colloid and interface science.

[4]  Bin Dong,et al.  PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network , 2018, J. Comput. Phys..

[5]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[6]  Tamer A. Zaki,et al.  Discrete adjoint of fractional-step incompressible Navier-Stokes solver in curvilinear coordinates and application to data assimilation , 2019, J. Comput. Phys..

[7]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[8]  George Em Karniadakis,et al.  NSFnets (Navier-Stokes flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations , 2020, J. Comput. Phys..

[9]  George Em Karniadakis,et al.  Systems biology informed deep learning for inferring parameters and hidden dynamics , 2020, PLoS computational biology.

[10]  George Em Karniadakis,et al.  Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators , 2019, Nature Machine Intelligence.

[11]  Chao Xu,et al.  Dense motion estimation of particle images via a convolutional neural network , 2019, Experiments in Fluids.

[12]  Changhoon Lee,et al.  Prediction of turbulent heat transfer using convolutional neural networks , 2019, Journal of Fluid Mechanics.

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  I. Rubinstein,et al.  Electro-osmotic slip and electroconvective instability , 2007, Journal of Fluid Mechanics.

[15]  George Em Karniadakis,et al.  Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations , 2020, Science.

[16]  Zaltzman,et al.  Electro-osmotically induced convection at a permselective membrane , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[17]  Michael S. Triantafyllou,et al.  Deep learning of vortex-induced vibrations , 2018, Journal of Fluid Mechanics.

[18]  Tamer A. Zaki,et al.  Spatial reconstruction of steady scalar sources from remote measurements in turbulent flow , 2019, Journal of Fluid Mechanics.

[19]  A. Mani,et al.  Statistical analysis of electroconvection near an ion-selective membrane in the highly chaotic regime , 2016 .

[20]  Jacob K. White,et al.  Helical vortex formation in three-dimensional electrochemical systems with ion-selective membranes. , 2016, Physical Review E.

[21]  G. Karniadakis,et al.  Spectral/hp Element Methods for Computational Fluid Dynamics , 2005 .

[22]  Zhiping Mao,et al.  DeepXDE: A Deep Learning Library for Solving Differential Equations , 2019, AAAI Spring Symposium: MLPS.

[23]  Yin Yang,et al.  Sea Surface Flow Estimation via Ensemble-based Variational Data Assimilation , 2018, 2018 Annual American Control Conference (ACC).

[24]  Petros Koumoutsakos,et al.  Machine Learning for Fluid Mechanics , 2019, Annual Review of Fluid Mechanics.

[25]  Liu Yang,et al.  Reinforcement learning for bluff body active flow control in experiments and simulations , 2020, Proceedings of the National Academy of Sciences.

[26]  Paris Perdikaris,et al.  Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations , 2017, ArXiv.

[27]  Miss A.O. Penney.  (b) , 1974, The New Yale Book of Quotations.

[28]  Liu Yang,et al.  Reinforcement Learning for Active Flow Control in Experiments , 2020, ArXiv.

[29]  Karthik Duraisamy,et al.  Turbulence Modeling in the Age of Data , 2018, Annual Review of Fluid Mechanics.

[30]  L. Dal Negro,et al.  Physics-informed neural networks for inverse problems in nano-optics and metamaterials. , 2019, Optics express.

[31]  J. Templeton,et al.  Reynolds averaged turbulence modelling using deep neural networks with embedded invariance , 2016, Journal of Fluid Mechanics.

[32]  Steven L. Brunton,et al.  Data-driven discovery of partial differential equations , 2016, Science Advances.

[33]  Luning Sun,et al.  Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data , 2019, Computer Methods in Applied Mechanics and Engineering.

[34]  George Em Karniadakis,et al.  Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems , 2018, J. Comput. Phys..

[35]  Hong Chen,et al.  Approximations of continuous functionals by neural networks with application to dynamic systems , 1993, IEEE Trans. Neural Networks.

[36]  George Em Karniadakis,et al.  fPINNs: Fractional Physics-Informed Neural Networks , 2018, SIAM J. Sci. Comput..

[37]  Vincent Mons,et al.  Kriging-enhanced ensemble variational data assimilation for scalar-source identification in turbulent environments , 2019, J. Comput. Phys..

[38]  George Em Karniadakis,et al.  DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators , 2019, ArXiv.

[39]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[40]  Justin A. Sirignano,et al.  DGM: A deep learning algorithm for solving partial differential equations , 2017, J. Comput. Phys..

[41]  S M Rubinstein,et al.  Direct observation of a nonequilibrium electro-osmotic instability. , 2008, Physical review letters.

[42]  Matthias Wessling,et al.  Coupling between Buoyancy Forces and Electroconvective Instability near Ion-Selective Surfaces. , 2016, Physical review letters.

[43]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[44]  A. Mani,et al.  Electroconvection Near Electrochemical Interfaces: Experiments, Modeling, and Computation , 2020 .