Physics-informed neural networks with hard constraints for inverse design

Inverse design arises in a variety of areas in engineering such as acoustic, mechanics, thermal/electronic transport, electromagnetism, and optics. Topology optimization is a major form of inverse design, where we optimize a designed geometry to achieve targeted properties and the geometry is parameterized by a density function. This optimization is challenging, because it has a very high dimensionality and is usually constrained by partial differential equations (PDEs) and additional inequalities. Here, we propose a new deep learning method—physics-informed neural networks with hard constraints (hPINNs)—for solving topology optimization. hPINN leverages the recent development of PINNs for solving PDEs, and thus does not rely on any numerical PDE solver. However, all the constraints in PINNs are soft constraints, and hence we impose hard constraints by using the penalty method and the augmented Lagrangian method. We demonstrate the effectiveness of hPINN for a holography problem in optics and a fluid problem of Stokes flow. We achieve the same objective as conventional PDE-constrained optimization methods based on adjoint methods and numerical PDE solvers, but find that the design obtained from hPINN is often simpler and smoother for problems whose solution is not unique. Moreover, the implementation of inverse design with hPINN can be easier than that of conventional methods.

[1]  Xian Luo,et al.  Smoothed profile method for particulate flows: Error analysis and simulations , 2009, J. Comput. Phys..

[2]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[3]  Markus J. Buehler,et al.  Artificial intelligence and machine learning in design of mechanical materials. , 2021, Materials horizons.

[4]  Zongfu Yu,et al.  Training Deep Neural Networks for the Inverse Design of Nanophotonic Structures , 2017, 2019 Conference on Lasers and Electro-Optics (CLEO).

[5]  George Em Karniadakis,et al.  Systems biology informed deep learning for inferring parameters and hidden dynamics , 2020, PLoS computational biology.

[6]  Kyu-Tae Lee,et al.  A Generative Model for Inverse Design of Metamaterials , 2018, Nano letters.

[7]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[8]  Daniel A. White,et al.  Multiscale topology optimization using neural network surrogate models , 2019, Computer Methods in Applied Mechanics and Engineering.

[9]  Jonathan A. Fan,et al.  Simulator-based training of generative neural networks for the inverse design of metasurfaces , 2019, Nanophotonics.

[10]  Jelena Vucković,et al.  Inverse design in nanophotonics , 2018, Nature Photonics.

[11]  G. Karniadakis,et al.  A spectral-element/Fourier smoothed profile method for large-eddy simulations of complex VIV problems , 2018, Computers & Fluids.

[12]  James K. Guest,et al.  Topology optimization of creeping fluid flows using a Darcy–Stokes finite element , 2006 .

[13]  Steven G. Johnson,et al.  Inverse Designed Metalenses with Extended Depth of Focus , 2020, 2020 Conference on Lasers and Electro-Optics (CLEO).

[14]  Chao Yang,et al.  PFNN: A Penalty-Free Neural Network Method for Solving a Class of Second-Order Boundary-Value Problems on Complex Geometries , 2020, J. Comput. Phys..

[15]  Raphaël Pestourie Assume Your Neighbor is Your Equal: Inverse Design in Nanophotonics , 2020 .

[16]  Trevon Badloe,et al.  Deep learning enabled inverse design in nanophotonics , 2020, Nanophotonics.

[17]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[18]  Martin Siebenborn,et al.  Computational Comparison of Surface Metrics for PDE Constrained Shape Optimization , 2015, Comput. Methods Appl. Math..

[19]  Santiago Badia,et al.  Gridap: An extensible Finite Element toolbox in Julia , 2020, J. Open Source Softw..

[20]  J. Petersson,et al.  Topology optimization of fluids in Stokes flow , 2003 .

[21]  Parag Singla,et al.  A Primal Dual Formulation For Deep Learning With Constraints , 2019, NeurIPS.

[22]  Mengqi Zhang,et al.  Inverse Design of Airfoil Using a Deep Convolutional Neural Network , 2019, AIAA Journal.

[23]  George Em Karniadakis,et al.  Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations , 2020, Science.

[24]  Yibo Yang,et al.  Physics-Informed Neural Networks for Cardiac Activation Mapping , 2020, Frontiers in Physics.

[25]  Steven G. Johnson,et al.  Active learning of deep surrogates for PDEs: application to metasurface design , 2020, npj Computational Materials.

[26]  Hajime Igarashi,et al.  Topology Optimization Accelerated by Deep Learning , 2019, IEEE Transactions on Magnetics.

[27]  Jiaqi Jiang,et al.  Deep neural networks for the evaluation and design of photonic devices , 2020, Nature Reviews Materials.

[28]  M. Wegener,et al.  3D metamaterials , 2019, Nature Reviews Physics.

[29]  Ole Sigmund,et al.  Topology optimization for nano‐photonics , 2011 .

[30]  Zhiping Mao,et al.  DeepXDE: A Deep Learning Library for Solving Differential Equations , 2019, AAAI Spring Symposium: MLPS.

[31]  L. Dal Negro,et al.  Physics-informed neural networks for inverse problems in nano-optics and metamaterials. , 2019, Optics express.

[32]  Toshiaki Koike-Akino,et al.  Deep Neural Network Inverse Design of Integrated Photonic Power Splitters , 2019, Scientific Reports.

[33]  Suchuan Dong,et al.  A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networks , 2021, J. Comput. Phys..

[34]  J. Goodman Introduction to Fourier optics , 1969 .

[35]  Steven G. Johnson,et al.  Notes on Perfectly Matched Layers (PMLs) , 2021, ArXiv.

[36]  George Em Karniadakis,et al.  Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness , 2019, Neural Networks.

[37]  Xinqiang Qin,et al.  Topology optimization of Stokes flow using an implicit coupled level set method , 2016 .

[38]  I-Jeng Wang,et al.  Stochastic optimisation with inequality constraints using simultaneous perturbations and penalty functions , 2008, Int. J. Control.

[39]  Yi Yang,et al.  Nanophotonic particle simulation and inverse design using artificial neural networks , 2018, Science Advances.

[40]  James G. Berryman,et al.  FDFD: a 3D finite-difference frequency-domain code for electromagnetic induction tomography , 2001 .

[41]  George Em Karniadakis,et al.  Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks , 2019, SIAM J. Sci. Comput..

[42]  P. Perdikaris,et al.  Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks , 2019 .

[43]  George Em Karniadakis,et al.  Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems , 2018, J. Comput. Phys..

[44]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[45]  P. L. Lagari,et al.  Systematic Construction of Neural Forms for Solving Partial Differential Equations Inside Rectangular Domains, Subject to Initial, Boundary and Interface Conditions , 2020, Int. J. Artif. Intell. Tools.

[46]  O. Sigmund,et al.  Topology optimization approaches , 2013, Structural and Multidisciplinary Optimization.

[47]  Steven G. Johnson,et al.  Inverse design of large-area metasurfaces. , 2018, Optics express.

[48]  O. SIAMJ.,et al.  A CLASS OF GLOBALLY CONVERGENT OPTIMIZATION METHODS BASED ON CONSERVATIVE CONVEX SEPARABLE APPROXIMATIONS∗ , 2002 .

[49]  I. Kevrekidis,et al.  Physics-informed machine learning , 2021, Nature Reviews Physics.

[50]  Christophe Geuzaine,et al.  Gmsh: A 3‐D finite element mesh generator with built‐in pre‐ and post‐processing facilities , 2009 .

[51]  Kaiyong Zhao,et al.  AutoML: A Survey of the State-of-the-Art , 2019, Knowl. Based Syst..