Deep-neural-network solution of the electronic Schrödinger equation

The electronic Schrödinger equation can only be solved analytically for the hydrogen atom, and the numerically exact full configuration-interaction method is exponentially expensive in the number of electrons. Quantum Monte Carlo methods are a possible way out: they scale well for large molecules, they can be parallelized and their accuracy has, as yet, been only limited by the flexibility of the wavefunction ansatz used. Here we propose PauliNet, a deep-learning wavefunction ansatz that achieves nearly exact solutions of the electronic Schrödinger equation for molecules with up to 30 electrons. PauliNet has a multireference Hartree–Fock solution built in as a baseline, incorporates the physics of valid wavefunctions and is trained using variational quantum Monte Carlo. PauliNet outperforms previous state-of-the-art variational ansatzes for atoms, diatomic molecules and a strongly correlated linear H 10 , and matches the accuracy of highly specialized quantum chemistry methods on the transition-state energy of cyclobutadiene, while being computationally efficient. High-accuracy quantum chemistry methods struggle with a combinatorial explosion of Slater determinants in larger molecular systems, but now a method has been developed that learns electronic wavefunctions with deep neural networks and reaches high accuracy with only a few determinants. The method is applicable to realistic chemical processes such as the automerization of cyclobutadiene.

[1]  Matthias Troyer,et al.  Computational complexity and fundamental limitations to fermionic quantum Monte Carlo simulations , 2004, Physical review letters.

[2]  D. Ceperley,et al.  Monte Carlo simulation of a many-fermion study , 1977 .

[3]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Klaus-Robert Müller,et al.  Machine learning of accurate energy-conserving molecular force fields , 2016, Science Advances.

[5]  Eric Neuscamman,et al.  Suppressing Ionic Terms with Number-Counting Jastrow Factors in Real Space. , 2017, Journal of chemical theory and computation.

[6]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[7]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[8]  Dmitry I. Lyakh,et al.  Multireference nature of chemistry: the coupled-cluster view. , 2012, Chemical reviews.

[9]  David M. Ceperley,et al.  Towards the solution of the many-electron problem in real materials: equation of state of the hydrogen chain with state-of-the-art many-body methods , 2017, 1705.01608.

[10]  Alex J W Thom,et al.  Stochastic coupled cluster theory. , 2010, Physical review letters.

[11]  Garnet Kin-Lic Chan,et al.  Optimizing large parameter sets in variational quantum Monte Carlo , 2011, 1108.0900.

[12]  J S Smith,et al.  ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost , 2016, Chemical science.

[13]  Anders S. Christensen,et al.  Alchemical and structural distribution based representation for universal quantum machine learning. , 2017, The Journal of chemical physics.

[14]  Sandeep Sharma,et al.  PySCF: the Python‐based simulations of chemistry framework , 2017, 1701.08223.

[15]  Mosé Casalegno,et al.  Computing accurate forces in quantum Monte Carlo using Pulay’s corrections and energy minimization , 2003 .

[16]  Claudia Filippi,et al.  Multiconfiguration wave functions for quantum Monte Carlo calculations of first‐row diatomic molecules , 1996 .

[17]  L. Wolniewicz,et al.  PotentialEnergy Curves for the X 1 Σg + , b 3 Σu + , and C 1 Πu States of the Hydrogen Molecule , 2013 .

[18]  R. Needs,et al.  Jastrow correlation factor for atoms, molecules, and solids , 2004, 0801.0378.

[19]  R J Needs,et al.  Energies of the first row atoms from quantum Monte Carlo. , 2007, The Journal of chemical physics.

[20]  Kristof T. Schütt,et al.  Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions , 2019, Nature Communications.

[21]  R. Needs,et al.  Continuum variational and diffusion quantum Monte Carlo calculations , 2010, Journal of physics. Condensed matter : an Institute of Physics journal.

[22]  A. Tkatchenko,et al.  Fast and accurate quantum Monte Carlo for molecular crystals , 2018, Proceedings of the National Academy of Sciences.

[23]  Thomas F. Miller,et al.  Transferability in Machine Learning for Electronic Structure via the Molecular Orbital Basis. , 2018, Journal of chemical theory and computation.

[24]  R. Needs,et al.  Quantum Monte Carlo simulations of solids , 2001 .

[25]  Sandeep Sharma,et al.  PySCF: the Python‐based simulations of chemistry framework , 2018 .

[26]  Martin Head-Gordon,et al.  Benchmark variational coupled cluster doubles results , 2000 .

[27]  Hiroki Saito,et al.  Method to Solve Quantum Few-Body Problems with Artificial Neural Networks , 2018, Journal of the Physical Society of Japan.

[28]  C. Umrigar,et al.  A diffusion Monte Carlo algorithm with very small time-step errors , 1993 .

[29]  Bryan K. Clark,et al.  Backflow Transformations via Neural Networks for Quantum Many-Body Wave Functions. , 2018, Physical review letters.

[30]  Isaiah Shavitt,et al.  Many-Body Methods in Chemistry and Physics: MBPT and Coupled-Cluster Theory , 2009 .

[31]  Alexandre Tkatchenko,et al.  Hard Numbers for Large Molecules: Toward Exact Energetics for Supramolecular Systems. , 2014, The journal of physical chemistry letters.

[32]  C J Umrigar,et al.  Full optimization of Jastrow-Slater wave functions with application to the first-row atoms and homonuclear diatomic molecules. , 2008, The Journal of chemical physics.

[33]  Kevin Schmidt,et al.  New variational wave function for liquid He3 , 1979 .

[34]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[35]  G. Carleo,et al.  Fermionic neural-network states for ab-initio electronic structure , 2019, Nature Communications.

[36]  Markus Holzmann,et al.  Nonlinear Network Description for Many-Body Quantum Systems in Continuous Space. , 2017, Physical review letters.

[37]  A. Szabó,et al.  Modern quantum chemistry : introduction to advanced electronic structure theory , 1982 .

[38]  Michael Deible,et al.  H4: A model system for assessing the performance of diffusion Monte Carlo calculations using a single Slater determinant trial function. , 2017, The Journal of chemical physics.

[39]  L. Wolniewicz,et al.  Potential-Energy Curves for the X1Sg+, b3Su+, and C1Pu States of the Hydrogen Molecule , 1965 .

[40]  R J Needs,et al.  Scheme for adding electron-nucleus cusps to Gaussian orbitals. , 2005, The Journal of chemical physics.

[41]  W. Lester,et al.  Quantum Monte Carlo and related approaches. , 2012, Chemical reviews.

[42]  E Weinan,et al.  Solving many-electron Schrödinger equation using deep neural networks , 2018, J. Comput. Phys..

[43]  David Pfau,et al.  Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks , 2019, Physical Review Research.

[44]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[45]  Markus Meuwly,et al.  PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments, and Partial Charges. , 2019, Journal of chemical theory and computation.

[46]  Alberto Fabrizio,et al.  Transferable Machine-Learning Model of the Electron Density , 2018, ACS central science.

[47]  Noam Bernstein,et al.  Machine learning unifies the modeling of materials and molecules , 2017, Science Advances.

[48]  Jeongnim Kim,et al.  Multideterminant Wave Functions in Quantum Monte Carlo. , 2012, Journal of chemical theory and computation.

[49]  R. Needs,et al.  Quantum Monte Carlo study of the first-row atoms and ions. , 2010, The Journal of chemical physics.

[50]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[51]  Lucjan Piela,et al.  Ideas of Quantum Chemistry , 2007 .

[52]  Richard Phillips Feynman,et al.  Energy Spectrum of the Excitations in Liquid Helium , 1956 .

[53]  Wojciech Cencek,et al.  Benchmark calculations for He2+ and LiH molecules using explicitly correlated Gaussian functions , 2000 .

[54]  Tosio Kato,et al.  On the Eigenfunctions of Many-Particle Systems in Quantum Mechanics , 2011 .

[55]  R. Nieminen,et al.  Stochastic gradient approximation: An efficient method to optimize many-body wave functions , 1997 .

[56]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[57]  Ali Alavi,et al.  Fermion Monte Carlo without fixed nodes: a game of life, death, and annihilation in Slater determinant space. , 2009, The Journal of chemical physics.

[58]  R J Needs,et al.  Inhomogeneous backflow transformations in quantum Monte Carlo calculations. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.