Solving Inverse Problems in Steady State Navier-Stokes Equations using Deep Neural Networks

Inverse problems in fluid dynamics are ubiquitous in science and engineering, with applications ranging from electronic cooling system design to ocean modeling. We propose a general and robust approach for solving inverse problems for the steady state Navier-Stokes equations by combining deep neural networks and numerical PDE schemes. Our approach expresses numerical simulation as a computational graph with differentiable operators. We then solve inverse problems by constrained optimization, using gradients calculated from the computational graph with reverse-mode automatic differentiation. This technique enables us to model unknown physical properties using deep neural networks and embed them into the PDE model. Specifically, we express the Newton's iteration to solve the highly nonlinear Navier-Stokes equations as a computational graph. We demonstrate the effectiveness of our method by computing spatially-varying viscosity and conductivity fields with deep neural networks (DNNs) and training DNNs using partial observations of velocity fields. We show that DNNs are capable of modeling complex spatially-varying physical field with sparse and noisy data. We implement our method using ADCME, a library for solving inverse modeling problems in scientific computing using automatic differentiation.

[1]  Anthony Skjellum,et al.  A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard , 1996, Parallel Comput..

[2]  A. Jameson,et al.  A multigrid method for the Navier Stokes equations , 1986 .

[3]  Jinlong Wu,et al.  Physics-informed machine learning approach for reconstructing Reynolds stress modeling discrepancies based on DNS data , 2016, 1606.07987.

[4]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[5]  Zhixin Li,et al.  A lattice Boltzmann algorithm for fluid–solid conjugate heat transfer , 2007 .

[6]  Charles C. Margossian,et al.  A review of automatic differentiation and its efficient implementation , 2018, WIREs Data Mining Knowl. Discov..

[7]  James C. Robinson,et al.  Bayesian inverse problems for functions and applications to fluid mechanics , 2009 .

[8]  S. E. Haupt,et al.  A preliminary study of assimilating numerical weather prediction data into computational fluid dynamics models for wind prediction , 2011 .

[9]  R. Viskanta,et al.  Three-dimensional conjugate heat transfer in the microchannel heat sink for electronic packaging , 2000 .

[10]  Rolf Rannacher,et al.  Finite Element Methods for the Incompressible Navier-Stokes Equations , 2000 .

[11]  Eric Darve,et al.  Physics Constrained Learning for Data-driven Inverse Modeling from Sparse Observations , 2020, J. Comput. Phys..

[12]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[13]  Rolf Rannacher,et al.  Fundamental directions in mathematical fluid mechanics , 2000 .

[14]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..

[15]  Julia S. Kimbell,et al.  Numerical evaluation of spray position for improved nasal drug delivery , 2020, Scientific Reports.