Learning Homogenization for Elliptic Operators

Multiscale partial differential equations (PDEs) arise in various applications, and several schemes have been developed to solve them efficiently. Homogenization theory is a powerful methodology that eliminates the small-scale dependence, resulting in simplified equations that are computationally tractable. In the field of continuum mechanics, homogenization is crucial for deriving constitutive laws that incorporate microscale physics in order to formulate balance laws for the macroscopic quantities of interest. However, obtaining homogenized constitutive laws is often challenging as they do not in general have an analytic form and can exhibit phenomena not present on the microscale. In response, data-driven learning of the constitutive law has been proposed as appropriate for this task. However, a major challenge in data-driven learning approaches for this problem has remained unexplored: the impact of discontinuities and corner interfaces in the underlying material. These discontinuities in the coefficients affect the smoothness of the solutions of the underlying equations. Given the prevalence of discontinuous materials in continuum mechanics applications, it is important to address the challenge of learning in this context; in particular to develop underpinning theory to establish the reliability of data-driven methods in this scientific domain. The paper addresses this unexplored challenge by investigating the learnability of homogenized constitutive laws for elliptic operators in the presence of such complexities. Approximation theory is presented, and numerical experiments are performed which validate the theory for the solution operator defined by the cell-problem arising in homogenization for elliptic PDEs.

[1]  Peter Yichen Chen,et al.  Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamics , 2023, ICML.

[2]  H. Owhadi,et al.  Kernel Methods are Competitive for Operator Learning , 2023, ArXiv.

[3]  A. Stuart,et al.  The Nonlocal Neural Operator: Universal Approximation , 2023, ArXiv.

[4]  A. Stuart,et al.  Learning macroscopic internal variables and history dependence from microscopic models , 2022, Journal of the Mechanics and Physics of Solids.

[5]  C. Schwab,et al.  Neural and gpc operator surrogates: construction and expression rate bounds , 2022, ArXiv.

[6]  Yoonsang Lee,et al.  A Neural Network Approach for Homogenization of Multiscale Problems , 2022, Multiscale Modeling & Simulation.

[7]  Burigede Liu,et al.  Learning Markovian Homogenized Models in Viscoelasticity , 2022, Multiscale Model. Simul..

[8]  A. Stuart,et al.  The Cost-Accuracy Trade-Off In Operator Learning With Neural Networks , 2022, Journal of Machine Learning.

[9]  R. Vaziri,et al.  Constitutive model characterization and discovery using physics-informed deep learning , 2022, Eng. Appl. Artif. Intell..

[10]  C. Farhat,et al.  A mechanics‐informed artificial neural network approach in data‐driven constitutive modeling , 2022, AIAA SCITECH 2022 Forum.

[11]  Wenbin Yu,et al.  A review of artificial neural networks in the constitutive modeling of composite materials , 2021 .

[12]  Jan N. Fuhg,et al.  On physics-informed data-driven isotropic and anisotropic constitutive models through probabilistic machine learning and space-filling sampling , 2021, Computer Methods in Applied Mechanics and Engineering.

[13]  Siddhartha Mishra,et al.  On universal approximation and error bounds for Fourier Neural Operators , 2021, J. Mach. Learn. Res..

[14]  J. A. A. Opschoor,et al.  Exponential ReLU DNN Expression of Holomorphic Maps in High Dimension , 2021, Constructive Approximation.

[15]  George Em Karniadakis,et al.  Error estimates for DeepOnets: A deep learning framework in infinite dimensions , 2021, Transactions of Mathematics and Its Applications.

[16]  Nikola B. Kovachki,et al.  A learning-based multiscale method and its application to inelastic impact problems , 2021, 2102.07256.

[17]  Marta D'Elia,et al.  Data-driven Learning of Nonlocal Models: from high-fidelity simulations to constitutive laws , 2020, AAAI Spring Symposium: MLPS.

[18]  Christian J. Cyron,et al.  Constitutive artificial neural networks: A fast and general approach to predictive data-driven constitutive modeling by deep learning , 2020, J. Comput. Phys..

[19]  Fei Tao,et al.  A neural network enhanced system for learning nonlinear constitutive law and failure initiation criterion of composites using indirectly measurable data , 2020 .

[20]  C. Schwab,et al.  Exponential ReLU Neural Network Approximation Rates for Point and Edge Singularities , 2020, Foundations of Computational Mathematics.

[21]  Nikola B. Kovachki,et al.  Fourier Neural Operator for Parametric Partial Differential Equations , 2020, ICLR.

[22]  Mark Chen,et al.  Language Models are Few-Shot Learners , 2020, NeurIPS.

[23]  Nicholas H. Nelsen,et al.  The Random Feature Model for Input-Output Maps between Banach Spaces , 2020, SIAM J. Sci. Comput..

[24]  Nikola B. Kovachki,et al.  Model Reduction and Neural Networks for Parametric PDEs , 2020, The SMAI journal of computational mathematics.

[25]  Paris Perdikaris,et al.  Physics‐Informed Deep Neural Networks for Learning Parameters and Constitutive Relationships in Subsurface Flow Problems , 2020, Water Resources Research.

[26]  Eric Darve,et al.  Learning Constitutive Relations using Symmetric Positive Definite Neural Networks , 2020, J. Comput. Phys..

[27]  M Mozaffar,et al.  Deep learning predicts path-dependent plasticity , 2019, Proceedings of the National Academy of Sciences.

[28]  George Em Karniadakis,et al.  Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators , 2019, Nature Machine Intelligence.

[29]  Eric F Darve,et al.  Learning constitutive relations from indirect observations using deep neural networks , 2019, J. Comput. Phys..

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Georges Teyssot Crystals , 2013, Metaphors in Architecture and Urbanism.

[32]  Ricardo H. Nochetto,et al.  Adaptive Finite Element Methods for Elliptic Problems with Discontinuous Coefficients , 2013, SIAM J. Numer. Anal..

[33]  R. DeVore,et al.  ANALYTIC REGULARITY AND POLYNOMIAL APPROXIMATION OF PARAMETRIC AND STOCHASTIC ELLIPTIC PDE'S , 2011 .

[34]  Jöran Bergh,et al.  Interpolation Spaces: An Introduction , 2011 .

[35]  Albert Cohen,et al.  Sparse adaptive Taylor approximation algorithms for parametric and stochastic elliptic PDEs , 2011 .

[36]  Albert Cohen,et al.  Convergence Rates of Best N-term Galerkin Approximations for a Class of Elliptic sPDEs , 2010, Found. Comput. Math..

[37]  David Rubin,et al.  Introduction to Continuum Mechanics , 2009 .

[38]  Jean-Luc Guermond,et al.  The LBB condition in fractional Sobolev spaces and applications , 2009 .

[39]  Grigorios A. Pavliotis,et al.  Multiscale Methods: Averaging and Homogenization , 2008 .

[40]  H. Owhadi,et al.  Numerical homogenization of the acoustic wave equations with a continuum of scales , 2006, math/0604380.

[41]  P. Donato,et al.  An introduction to homogenization , 2000 .

[42]  K. Bhattacharya Phase boundary propagation in a heterogeneous body , 1999, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[43]  Thomas Y. Hou,et al.  A Multiscale Finite Element Method for Elliptic Problems in Composite Materials and Porous Media , 1997 .

[44]  A. Magnus Constructive Approximation, Grundlehren der mathematischen Wissenschaften, Vol. 303, R. A. DeVore and G. G. Lorentz, Springer-Verlag, 1993, x + 449 pp. , 1994 .

[45]  G. Allaire Homogenization and two-scale convergence , 1992 .

[46]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[47]  H. Triebel,et al.  Topics in Fourier Analysis and Function Spaces , 1987 .

[48]  A. Bensoussan,et al.  Asymptotic analysis for periodic structures , 1979 .

[49]  E. Stein,et al.  Introduction to Fourier Analysis on Euclidean Spaces. , 1971 .

[50]  J. Dugundji An extension of Tietze's theorem. , 1951 .

[51]  Nikola B. Kovachki,et al.  Neural Operator: Learning Maps Between Function Spaces With Applications to PDEs , 2023, J. Mach. Learn. Res..

[52]  German Capuano,et al.  Smart constitutive laws: Inelastic homogenization through machine learning , 2021 .

[53]  G. Burton Sobolev Spaces , 2013 .

[54]  R. Nochetto,et al.  Theory of adaptive finite element methods: An introduction , 2009 .

[55]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.