Learning Composable Energy Surrogates for PDE Order Reduction

Meta-materials are an important emerging class of engineered materials in which complex macroscopic behaviour--whether electromagnetic, thermal, or mechanical--arises from modular substructure. Simulation and optimization of these materials are computationally challenging, as rich substructures necessitate high-fidelity finite element meshes to solve the governing PDEs. To address this, we leverage parametric modular structure to learn component-level surrogates, enabling cheaper high-fidelity simulation. We use a neural network to model the stored potential energy in a component given boundary conditions. This yields a structured prediction task: macroscopic behavior is determined by the minimizer of the system's total potential energy, which can be approximated by composing these surrogate models. Composable energy surrogates thus permit simulation in the reduced basis of component boundaries. Costly ground-truth simulation of the full structure is avoided, as training data are generated by performing finite element analysis with individual components. Using dataset aggregation to choose training boundary conditions allows us to learn energy surrogates which produce accurate macroscopic behavior when composed, accelerating simulation of parametric meta-materials.

[1]  K. Bertoldi,et al.  Flexible mechanical metamaterials , 2017 .

[2]  Renjie Liao,et al.  Understanding Short-Horizon Bias in Stochastic Meta-Optimization , 2018, ICLR.

[3]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[4]  Yann Ollivier,et al.  Unbiasing Truncated Backpropagation Through Time , 2017, ArXiv.

[5]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[6]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[8]  Scott W. Sloan,et al.  An Automatic Newton–Raphson Scheme , 2002 .

[9]  Geoffrey J. Gordon,et al.  A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning , 2010, AISTATS.

[10]  Anders Logg,et al.  The FEniCS Project Version 1.5 , 2015 .

[11]  J. Lions Optimal Control of Systems Governed by Partial Differential Equations , 1971 .

[12]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[13]  Michael I. Jordan,et al.  Ray: A Distributed Framework for Emerging AI Applications , 2017, OSDI.

[14]  Byron Boots,et al.  Truncated Back-propagation for Bilevel Optimization , 2018, AISTATS.

[15]  John Langford,et al.  Search-based structured prediction , 2009, Machine Learning.

[16]  Anders Logg,et al.  DOLFIN: Automated finite element computing , 2010, TOMS.

[17]  Yee Whye Teh,et al.  A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation , 2006, NIPS.

[18]  A. Chatterjee An introduction to the proper orthogonal decomposition , 2000 .

[19]  Ryan P. Adams,et al.  Efficient Optimization of Loops and Limits with Randomized Telescoping Sums , 2019, ICML.

[20]  Levent Burak Kara,et al.  Deep Learning for Stress Field Prediction Using Convolutional Neural Networks , 2018, J. Comput. Inf. Sci. Eng..

[21]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[22]  Anders Logg,et al.  Automated Solution of Differential Equations by the Finite Element Method: The FEniCS Book , 2012 .

[23]  Igor I. Smolyaninov,et al.  Hyperbolic Metamaterials , 2018 .

[24]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[25]  R. Ogden Non-Linear Elastic Deformations , 1984 .

[26]  J. Andrew Bagnell,et al.  Efficient Reductions for Imitation Learning , 2010, AISTATS.

[27]  Theodore Lim,et al.  SMASH: One-Shot Model Architecture Search through HyperNetworks , 2017, ICLR.

[28]  Jun S. Liu,et al.  The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation Problem , 1994 .

[29]  Anders Logg,et al.  DOLFIN: a C++/Python Finite Element Library , 2012 .

[30]  Simon W. Funke,et al.  dolfin-adjoint 2018.1: automated adjoints for FEniCS and Firedrake , 2019, J. Open Source Softw..

[31]  E. Narimanov,et al.  Hyperbolic metamaterials , 2013, 2015 11th Conference on Lasers and Electro-Optics Pacific Rim (CLEO-PR).

[32]  Yannick Schroecker,et al.  State Aware Imitation Learning , 2017, NIPS.

[33]  Johannes T. B. Overvelde,et al.  Relating pore shape to the non-linear response of periodic elastomeric structures , 2014 .

[34]  P. Holmes,et al.  The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows , 1993 .

[35]  Razvan Pascanu,et al.  Sobolev Training for Neural Networks , 2017, NIPS.

[36]  Pk Kythe,et al.  An Introduction to Linear and Nonlinear Finite Element Analysis: A Computational Approach , 2003 .

[37]  Pedro Lopes,et al.  Metamaterial Mechanisms , 2016, UIST.