Completing density functional theory by machine learning hidden messages from molecules

Kohn–Sham density functional theory (DFT) is the basis of modern computational approaches to electronic structures. Their accuracy heavily relies on the exchange-correlation energy functional, which encapsulates electron–electron interaction beyond the classical model. As its universal form remains undiscovered, approximated functionals constructed with heuristic approaches are used for practical studies. However, there are problems in their accuracy and transferability, while any systematic approach to improve them is yet obscure. In this study, we demonstrate that the functional can be systematically constructed using accurate density distributions and energies in reference molecules via machine learning. Surprisingly, a trial functional machine learned from only a few molecules is already applicable to hundreds of molecules comprising various first- and second-row elements with the same accuracy as the standard functionals. This is achieved by relating density and energy using a flexible feed-forward neural network, which allows us to take a functional derivative via the back-propagation algorithm. In addition, simply by introducing a nonlocal density descriptor, the nonlocal effect is included to improve accuracy, which has hitherto been impractical. Our approach thus will help enrich the DFT framework by utilizing the rapidly advancing machine-learning technique.

[1]  J. Cizek On the Correlation Problem in Atomic and Molecular Systems. Calculation of Wavefunction Components in Ursell-Type Expansion Using Quantum-Field Theoretical Methods , 1966 .

[2]  Alberto Fabrizio,et al.  Transferable Machine-Learning Model of the Electron Density , 2018, ACS central science.

[3]  Li Li,et al.  Understanding Machine-learned Density Functionals , 2014, ArXiv.

[4]  S. H. Vosko,et al.  Accurate spin-dependent electron liquid correlation energies for local spin density calculations: a critical analysis , 1980 .

[5]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[6]  M. G. Medvedev,et al.  Density functional theory is straying from the path toward the exact functional , 2017, Science.

[7]  Adrienn Ruzsinszky,et al.  Strongly Constrained and Appropriately Normed Semilocal Density Functional. , 2015, Physical review letters.

[8]  Krishnan Raghavachari,et al.  Gaussian-2 theory for molecular energies of first- and second-row compounds , 1991 .

[9]  K. Burke Perspective on density functional theory. , 2012, The Journal of chemical physics.

[10]  Klaus-Robert Müller,et al.  Finding Density Functionals with Machine Learning , 2011, Physical review letters.

[11]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[12]  L. Curtiss,et al.  Assessment of Gaussian-2 and density functional theories for the computation of enthalpies of formation , 1997 .

[13]  G. Scuseria,et al.  Climbing the density functional ladder: nonempirical meta-generalized gradient approximation designed for molecules and solids. , 2003, Physical review letters.

[14]  M. Frisch,et al.  Ab Initio Calculation of Vibrational Absorption and Circular Dichroism Spectra Using Density Functional Force Fields , 1994 .

[15]  Anand Chandrasekaran,et al.  Solving the electronic structure problem with machine learning , 2019, npj Computational Materials.

[16]  Filipp Furche,et al.  Molecular tests of the random phase approximation to the exchange-correlation energy functional , 2001 .

[17]  R. Ahlrichs,et al.  Efficient molecular numerical integration schemes , 1995 .

[18]  D. Truhlar,et al.  A new local density functional for main-group thermochemistry, transition metal bonding, thermochemical kinetics, and noncovalent interactions. , 2006, The Journal of chemical physics.

[19]  Sandeep Sharma,et al.  PySCF: the Python‐based simulations of chemistry framework , 2017, 1701.08223.

[20]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[21]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[22]  J. C. Slater A Simplification of the Hartree-Fock Method , 1951 .

[23]  I. A. Abrikosov,et al.  Assessing the SCAN functional for itinerant electron ferromagnets , 2018, Physical Review B.

[24]  A. Becke,et al.  Density-functional exchange-energy approximation with correct asymptotic behavior. , 1988, Physical review. A, General physics.

[25]  John C. Snyder,et al.  Orbital-free bond breaking via machine learning. , 2013, The Journal of chemical physics.

[26]  Burke,et al.  Generalized Gradient Approximation Made Simple. , 1996, Physical review letters.

[27]  Donald G Truhlar,et al.  Benchmark database of barrier heights for heavy atom transfer, nucleophilic substitution, association, and unimolecular reactions and its use to test theoretical methods. , 2005, The journal of physical chemistry. A.

[28]  G. L. Oliver,et al.  Spin-density gradient expansion for the kinetic energy , 1979 .

[29]  Nicholas C. Handy,et al.  Exchange‐correlation potentials , 1996 .

[30]  P. Rennert,et al.  Many‐particle Physics , 1982 .

[31]  Kieron Burke,et al.  Can exact conditions improve machine-learned density functionals? , 2018, The Journal of chemical physics.

[32]  D. Truhlar,et al.  The M06 suite of density functionals for main group thermochemistry, thermochemical kinetics, noncovalent interactions, excited states, and transition elements: two new functionals and systematic testing of four M06-class functionals and 12 other functionals , 2008 .

[33]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[34]  G. Scuseria,et al.  Prescription for the design and selection of density functional approximations: more constraint satisfaction with fewer fits. , 2005, The Journal of chemical physics.

[35]  R. Bartlett,et al.  A full coupled‐cluster singles and doubles model: The inclusion of disconnected triples , 1982 .

[36]  J. Perdew,et al.  Density-Functional Theory for Fractional Particle Number: Derivative Discontinuities of the Energy , 1982 .

[37]  J. Conte,et al.  A Critical Analysis , 1969 .

[38]  V. Lebedev,et al.  A QUADRATURE FORMULA FOR THE SPHERE OF THE 131ST ALGEBRAIC ORDER OF ACCURACY , 1999 .

[39]  M. Gillan,et al.  Perspective: How good is DFT for water? , 2016, The Journal of chemical physics.

[40]  Jonathan Schmidt,et al.  Machine Learning the Physical Nonlocal Exchange-Correlation Functional of Density-Functional Theory. , 2019, The journal of physical chemistry letters.

[41]  M. Head‐Gordon,et al.  Thirty years of density functional theory in computational chemistry: an overview and extensive assessment of 200 density functionals , 2017 .

[42]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[43]  Jeffrey C Grossman,et al.  Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties. , 2017, Physical review letters.

[44]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[45]  Ryo Nagai,et al.  Neural-network Kohn-Sham exchange-correlation potential and its out-of-training transferability. , 2018, The Journal of chemical physics.

[46]  Mats Jonson,et al.  Descriptions of exchange and correlation effects in inhomogeneous electron systems , 1979 .

[47]  G. Scuseria,et al.  Assessment of the Perdew–Burke–Ernzerhof exchange-correlation functional , 1999 .

[48]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[49]  Donald G. Truhlar,et al.  Effectiveness of Diffuse Basis Functions for Calculating Relative Energies by Density Functional Theory , 2003 .

[50]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[51]  Parr,et al.  Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density. , 1988, Physical review. B, Condensed matter.

[52]  A. Becke A multicenter numerical integration scheme for polyatomic molecules , 1988 .

[53]  A. D. McLACHLAN,et al.  Time-Dependent Hartree—Fock Theory for Molecules , 1964 .

[54]  John P. Perdew,et al.  Jacob’s ladder of density functional approximations for the exchange-correlation energy , 2001 .

[55]  Sandeep Sharma,et al.  PySCF: the Python‐based simulations of chemistry framework , 2018 .