Toward the Exact Exchange–Correlation Potential: A Three-Dimensional Convolutional Neural Network Construct

A deep neural network is constructed to yield in principle exact exchange−correlation potential. It requires merely the electron densities of small molecules and ions and yet can determine the exchange−correlation potentials of large molecules. We train and validate the neural network based on the data for H2 and HeH + and subsequently determine the ground-state electron density of stretched HeH, linear H3 , and H−He−He−H. Moreover, the deep neural network is proven to model the van der Waals interaction by being trained and validated on a data set containing He2. Comparisons to B3LYP are given to illustrate the accuracy and transferability of the neural network. D theory (DFT) has become the most widely used quantum mechanical simulation method. Despite its success, DFT suffers from chronic deficiencies such as the self-interaction error, chemical accuracy issue for thermochemistry, poor treatment of van der Waals interaction, inaccurate reaction barrier, hydrogen bond, charge-transfer, delocalization error, and static correlation and strong correlation error. Medvedev et al. showed that although the accuracy in energy of DFT methods had been improving over the past decade or two, the calculated electron density distribution had become less accurate. Despite the continuing efforts to find more accurate exchange−correlation (xc) functionals, the improvement in calculated accuracy has slowed down. Alternatives beyond the traditional approaches must be sought. Efforts have been made to construct high-quality xc potentials for given electron densities via optimization procedures. Modern machine learning techniques have also been incorporated in the DFT method aiming at boosting calculations, calibrating results, or improving the xc functional. In 2004 we proposed a neural network-based B3LYP xc functional. The three hybrid parameters in the B3LYP xc functional, a0, ax, and ac, are in principle the functionals of the ground-state electron density function and thus system-dependent. Their values were evaluated via a neural network which had been trained and tested against the experimental data. The input descriptors of the neural network were the number of electrons, dipole moment, quadrupole moment, kinetic energy, and spin multiplicity of the system, which are the functionals of the ground-state electron density function of the molecule. In 2012, Burke and co-workers proposed a machine learning-based density functional for the kinetic energy of one-dimensional electron gas, which was later extended for real molecules. All these machine learning-based functionals require the knowledge of the global electron density function. For small molecules or ions, it is straightforward to obtain their electron density functions and the corresponding energies using highly accurate quantum chemistry methods such as the coupled-cluster method, quantum Monte Carlo, and the density matrix renormalization group technique. However, electron density functions and energies of larger molecules or ions are difficult to determine, if not impossible. As a result, no or little data are available for large molecular systems. This problem is difficult to circumvent and prevents all the existing machine learningbased methods for the DFT xc functional from being applicable for large molecular systems. The xc potential vxc(r) of the density-functional theory 2

[1]  The densities produced by the density functional theory: comparison to full configuration interaction. , 2008, The Journal of chemical physics.

[2]  Donald G Truhlar,et al.  Benchmark Databases for Nonbonded Interactions and Their Use To Test Density Functional Theory. , 2005, Journal of chemical theory and computation.

[3]  Nicholas C. Handy,et al.  Exchange‐correlation potentials , 1996 .

[4]  A. Becke Density-functional thermochemistry. V. Systematic optimization of exchange-correlation functionals , 1997 .

[5]  Kun Yao,et al.  Kinetic Energy of Hydrocarbons as a Function of Electron Density and Convolutional Neural Networks. , 2015, Journal of chemical theory and computation.

[6]  José M. Pérez-Jordá,et al.  A density-functional study of van der Waals forces: rare gas diatomics. , 1995 .

[7]  Lihong Hu,et al.  A generalized exchange-correlation functional: the Neural-Networks approach ☆ , 2003, physics/0311024.

[8]  Peter Pulay,et al.  Ab initio calculation of force constants and equilibrium geometries in polyatomic molecules , 1969 .

[9]  Weitao Yang,et al.  Challenges for density functional theory. , 2012, Chemical reviews.

[10]  Junji Seino,et al.  Semi-local machine-learned kinetic energy density functional with third-order gradients of electron density. , 2018, The Journal of chemical physics.

[11]  Weitao Yang,et al.  Fractional spins and static correlation error in density functional theory. , 2008, The Journal of chemical physics.

[12]  Yan Mo,et al.  Time-dependent density-functional theory for open systems , 2007 .

[13]  Improving approximate-optimized effective potentials by imposing exact conditions: Theory and applications to electronic statics and dynamics , 2009, 0905.1260.

[14]  Lihong Hu,et al.  Combined first-principles calculation and neural-network correction approach for heat of formation , 2003 .

[15]  John P. Perdew,et al.  Jacob’s ladder of density functional approximations for the exchange-correlation energy , 2001 .

[16]  M. G. Medvedev,et al.  Density functional theory is straying from the path toward the exact functional , 2017, Science.

[17]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[18]  David A. Strubbe,et al.  Deep learning and density-functional theory , 2018, Physical Review A.

[19]  Weitao Yang,et al.  Fractional charge perspective on the band gap in density-functional theory , 2007, 0708.3175.

[20]  Matthias Troyer,et al.  Quantum Monte Carlo , 2004 .

[21]  G. Scuseria,et al.  Climbing the density functional ladder: nonempirical meta-generalized gradient approximation designed for molecules and solids. , 2003, Physical review letters.

[22]  Weitao Yang,et al.  A challenge for density functionals: Self-interaction error increases for systems with a noninteger number of electrons , 1998 .

[23]  W. Münch,et al.  The theorem of hohenberg and kohn for subdomains of a quantum system , 1981 .

[24]  P. Zimmerman,et al.  Exact exchange-correlation potentials from ground-state electron densities , 2019, Nature Communications.

[25]  Burke,et al.  Generalized Gradient Approximation Made Simple. , 1996, Physical review letters.

[26]  Ryo Nagai,et al.  Neural-network Kohn-Sham exchange-correlation potential and its out-of-training transferability. , 2018, The Journal of chemical physics.

[27]  Karina Sendt,et al.  Failure of density-functional theory and time-dependent density-functional theory for large extended π systems , 2002 .

[28]  David E. Woon,et al.  Gaussian basis sets for use in correlated molecular calculations. IV. Calculation of static electrical response properties , 1994 .

[29]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[30]  M. Head‐Gordon,et al.  Highly correlated calculations with a polynomial cost algorithm: A study of the density matrix renormalization group , 2002 .

[31]  Qin Wu,et al.  A direct optimization method for calculating density functionals and exchange–correlation potentials from electron densities , 2003 .

[32]  R. Bader,et al.  Forces in molecules. , 2007, Faraday discussions.

[33]  Anand Chandrasekaran,et al.  Solving the electronic structure problem with machine learning , 2019, npj Computational Materials.

[34]  Peter Pulay,et al.  CAN (SEMI) LOCAL DENSITY FUNCTIONAL THEORY ACCOUNT FOR THE LONDON DISPERSION FORCES , 1994 .

[35]  Donald G. Truhlar,et al.  Development and Assessment of a New Hybrid Density Functional Model for Thermochemical Kinetics , 2004 .

[36]  V. Lebedev,et al.  A QUADRATURE FORMULA FOR THE SPHERE OF THE 131ST ALGEBRAIC ORDER OF ACCURACY , 1999 .

[37]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[38]  John C. Snyder,et al.  Orbital-free bond breaking via machine learning. , 2013, The Journal of chemical physics.

[39]  Weitao Yang,et al.  Localization and delocalization errors in density functional theory and implications for band-gap prediction. , 2007, Physical review letters.

[40]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[41]  Klaus-Robert Müller,et al.  Finding Density Functionals with Machine Learning , 2011, Physical review letters.