Physically informed artificial neural networks for atomistic modeling of materials

Large-scale atomistic computer simulations of materials heavily rely on interatomic potentials predicting the energy and Newtonian forces on atoms. Traditional interatomic potentials are based on physical intuition but contain few adjustable parameters and are usually not accurate. The emerging machine-learning (ML) potentials achieve highly accurate interpolation within a large DFT database but, being purely mathematical constructions, suffer from poor transferability to unknown structures. We propose a new approach that can drastically improve the transferability of ML potentials by informing them of the physical nature of interatomic bonding. This is achieved by combining a rather general physics-based model (analytical bond-order potential) with a neural-network regression. This approach, called the physically informed neural network (PINN) potential, is demonstrated by developing a general-purpose PINN potential for Al. We suggest that the development of physics-based ML potentials is the most effective way forward in the field of atomistic simulations.Traditional machine learning potentials suffer from poor transferability to unknown structures. Here the authors present an approach to improve the transferability of machine-learning potentials by including information on the physical nature of interatomic bonding.

[1]  Ajeevsing Bholoa,et al.  A new approach to potential fitting using neural networks , 2007 .

[2]  Allan Pinkus,et al.  Approximation theory of the MLP model in neural networks , 1999, Acta Numerica.

[3]  Alexandre Tkatchenko,et al.  Non-covalent interactions across organic and biological subsets of chemical space: Physics-based potentials parametrized from machine learning. , 2017, The Journal of chemical physics.

[4]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[5]  Alexie M. Kolpak,et al.  Discovering charge density functionals and structure-property relationships with PROPhet: A general framework for coupling machine learning and first-principles methods , 2017, Scientific Reports.

[6]  Aidan P Thompson,et al.  Extending the accuracy of the SNAP interatomic potential form. , 2017, The Journal of chemical physics.

[7]  M. Baskes,et al.  Application of the embedded-atom method to covalent materials: A semiempirical potential for silicon. , 1987, Physical review letters.

[8]  Donald W. Brenner,et al.  The Art and Science of an Analytic Potential , 2000 .

[9]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[10]  Peter Sollich,et al.  Accurate interatomic force fields via machine learning with covariant kernels , 2016, 1611.03877.

[11]  Michael J. Mehl,et al.  Interatomic potentials for monoatomic metals from experimental data and ab initio calculations , 1999 .

[12]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[13]  Rampi Ramprasad,et al.  Learning scheme to predict atomic forces and accelerate materials simulations , 2015, 1505.02701.

[14]  Cormac Toher,et al.  Charting the complete elastic properties of inorganic crystalline compounds , 2015, Scientific Data.

[15]  Steven D. Brown,et al.  Neural network models of potential energy surfaces , 1995 .

[16]  J. Behler,et al.  Metadynamics simulations of the high-pressure phases of silicon employing a high-dimensional neural network potential. , 2008, Physical review letters.

[17]  Hybrid atomistic modelling of materials processes , 2005 .

[18]  Rampi Ramprasad,et al.  Adaptive machine learning framework to accelerate ab initio molecular dynamics , 2015 .

[19]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[20]  G. Kresse,et al.  Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set , 1996 .

[21]  Haydn N. G. Wadley,et al.  Bond-order potential for silicon , 2007 .

[22]  Jackson,et al.  Atoms, molecules, solids, and surfaces: Applications of the generalized gradient approximation for exchange and correlation. , 1992, Physical review. B, Condensed matter.

[23]  K. Kelton,et al.  High energy x-ray scattering studies of the local order in liquid Al. , 2011, The Journal of chemical physics.

[24]  J. Hafner,et al.  Shear deformation, ideal strength, and stacking fault formation of fcc metals: A density-functional study of Al and Cu , 2009 .

[25]  Tristan Bereau,et al.  Transferable Atomic Multipole Machine Learning Models for Small Organic Molecules. , 2015, Journal of chemical theory and computation.

[26]  Aldo Glielmo,et al.  Efficient nonparametric n -body force fields from machine learning , 2018, 1801.04823.

[27]  Jörg Behler,et al.  Automatic selection of atomic fingerprints and reference configurations for machine-learning potentials. , 2018, The Journal of chemical physics.

[28]  P. Alam ‘O’ , 2021, Composites Engineering: An A–Z Guide.

[29]  A. V. Duin,et al.  ReaxFF: A Reactive Force Field for Hydrocarbons , 2001 .

[30]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[31]  M. Baskes,et al.  Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals , 1984 .

[32]  Zhenwei Li,et al.  Molecular dynamics with on-the-fly machine learning of quantum-mechanical forces. , 2015, Physical review letters.

[33]  Kristin A. Persson,et al.  Surface energies of elemental crystals , 2016, Scientific Data.

[34]  Noel Jakse,et al.  Liquid Aluminum: Atomic diffusion and viscosity from ab initio molecular dynamics , 2013, Scientific Reports.

[35]  Michael J. Mehl,et al.  Phase stability in the Fe–Ni system: Investigation by first-principles calculations and atomistic simulations , 2005 .

[36]  J. F. Devlin Stacking fault energies of Be, Mg, Al, Cu, Ag, and Au , 1974 .

[37]  Sidney Yip,et al.  Ideal Pure Shear Strength of Aluminum and Copper , 2002, Science.

[38]  Richard Dawes,et al.  Interpolating moving least-squares methods for fitting potential energy surfaces: a strategy for efficient automatic data point placement in high dimensions. , 2008, The Journal of chemical physics.

[39]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[40]  Suleiman Y. Oloriegbe Hybrid Bond-Order Potential for Silicon , 2008 .

[41]  P. Popelier,et al.  Potential energy surfaces fitted by artificial neural networks. , 2010, The journal of physical chemistry. A.

[42]  Satish T. S. Bukkapatnam,et al.  Neural Networks in Chemical Reaction Dynamics , 2012 .

[43]  Ajeevsing Bholoa,et al.  Silicon potentials investigated using density functional theory fitted neural networks , 2008 .

[44]  J. Behler Atom-centered symmetry functions for constructing high-dimensional neural network potentials. , 2011, The Journal of chemical physics.

[45]  G. Kresse,et al.  From ultrasoft pseudopotentials to the projector augmented-wave method , 1999 .

[46]  R. Ramprasad,et al.  Machine Learning in Materials Science , 2016 .

[47]  Y. Mishin,et al.  Atomistic modeling of interfaces and their impact on microstructure and properties , 2010 .

[48]  M. Baskes,et al.  Semiempirical, Quantum Mechanical Calculation of Hydrogen Embrittlement in Metals , 1983 .

[49]  Haiyan Lu,et al.  Energetics of intrinsic point defects in aluminium via orbital-free density functional theory , 2016, 1611.07631.

[50]  J. Tersoff,et al.  New empirical approach for the structure and energy of covalent systems. , 1988, Physical review. B, Condensed matter.

[51]  E. Carter,et al.  Elastic and Thermodynamic Properties of Complex Mg-Al Intermetallic Compounds via Orbital-Free Density Functional Theory , 2016 .

[52]  Germany,et al.  Neural network interatomic potential for the phase change material GeTe , 2012, 1201.2026.

[53]  Noam Bernstein,et al.  Machine Learning a General-Purpose Interatomic Potential for Silicon , 2018, Physical Review X.

[54]  Haydn N. G. Wadley,et al.  Analytic bond-order potentials for modelling the growth of semiconductor thin films , 2007 .

[55]  Thomas D. Kuhne,et al.  Ab initio quality neural-network potential for sodium , 2010, 1002.2879.

[56]  C. Kittel Introduction to solid state physics , 1954 .

[57]  K. Müller,et al.  Towards exact molecular dynamics simulations with machine-learned force fields , 2018, Nature Communications.

[58]  Jörg Behler,et al.  Constructing high‐dimensional neural network potentials: A tutorial review , 2015 .

[59]  R. Parr,et al.  Local hardness equalization: exploiting the ambiguity. , 2008, The Journal of chemical physics.

[60]  J. Tersoff,et al.  Empirical interatomic potential for silicon with improved elastic properties. , 1988, Physical review. B, Condensed matter.

[61]  M. Platt,et al.  Atoms , 2009, Archives of Disease in Childhood.

[62]  J. Tersoff,et al.  Modeling solid-state chemistry: Interatomic potentials for multicomponent systems. , 1989, Physical review. B, Condensed matter.

[63]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[64]  Atsuto Seko,et al.  First-principles interatomic potentials for ten elemental metals via compressed sensing , 2015, 1505.03994.

[65]  Marcus Elstner,et al.  Generalized Density-Functional Tight-Binding Repulsive Potentials from Unsupervised Machine Learning. , 2018, Journal of chemical theory and computation.

[66]  Wataru Mizukami,et al.  A compact and accurate semi-global potential energy surface for malonaldehyde from constrained least squares regression. , 2014, The Journal of chemical physics.

[67]  J. Behler Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations. , 2011, Physical chemistry chemical physics : PCCP.

[68]  R Komanduri,et al.  Parametrization of analytic interatomic potential functions using neural networks. , 2008, The Journal of chemical physics.

[69]  Y. Mishin,et al.  Interatomic Potentials for Metals , 2005 .

[70]  S. Stuart,et al.  A reactive potential for hydrocarbons with intermolecular interactions , 2000 .

[71]  D. Brenner,et al.  Empirical potential for hydrocarbons for use in simulating the chemical vapor deposition of diamond films. , 1990, Physical review. B, Condensed matter.

[72]  Tim Mueller,et al.  Machine Learning in Materials Science , 2016 .

[73]  Hua Huang,et al.  MET , 2020, Proceedings of the 26th Annual International Conference on Mobile Computing and Networking.

[74]  Tao Liang,et al.  Variable charge reactive potential for hydrocarbons to simulate organic-copper interactions. , 2012, The journal of physical chemistry. A.

[75]  S. Crockett,et al.  Multiphase aluminum equations of state via density functional theory , 2016 .

[76]  H. Sehitoglu,et al.  Predicting twinning stress in fcc metals: Linking twin-energy pathways to twin nucleation , 2007 .

[77]  Singh,et al.  Erratum: Atoms, molecules, solids, and surfaces: Applications of the generalized gradient approximation for exchange and correlation , 1993, Physical review. B, Condensed matter.

[78]  Burke,et al.  Generalized Gradient Approximation Made Simple. , 1996, Physical review letters.