Approximating quantum many-body wave functions using artificial neural networks

In this paper, we demonstrate the expressibility of artificial neural networks (ANNs) in quantum many-body physics by showing that a feed-forward neural network with a small number of hidden layers can be trained to approximate with high precision the ground states of some notable quantum many-body systems. We consider the one-dimensional free bosons and fermions, spinless fermions on a square lattice away from half-filling, as well as frustrated quantum magnetism with a rapidly oscillating ground-state characteristic function. In the latter case, an ANN with a standard architecture fails, while that with a slightly modified one successfully learns the frustration-induced complex sign rule in the ground state and approximates the ground states with high precisions. As an example of practical use of our method, we also perform the variational method to explore the ground state of an anti-ferromagnetic $J_1-J_2$ Heisenberg model.

[1]  Yang Qi,et al.  Self-learning Monte Carlo method , 2016, 1610.03137.

[2]  David J. Schwab,et al.  An exact mapping between the Variational Renormalization Group and Deep Learning , 2014, ArXiv.

[3]  White,et al.  Density matrix formulation for quantum renormalization groups. , 1992, Physical review letters.

[4]  Lei Wang,et al.  Exploring cluster Monte Carlo updates with Boltzmann machines. , 2017, Physical review. E.

[5]  Amnon Shashua,et al.  Deep Learning and Quantum Entanglement: Fundamental Connections with Implications to Network Design , 2017, ICLR.

[6]  V. Tikhomirov.  On the Representation of Continuous Functions of Several Variables as Superpositions of Continuous Functions of a Smaller Number of Variables , 1991 .

[7]  A. Sandvik,et al.  Quantum Monte Carlo simulation method for spin systems. , 1991, Physical review. B, Condensed matter.

[8]  Lu-Ming Duan,et al.  Efficient representation of quantum many-body states with deep neural networks , 2017, Nature Communications.

[9]  Yang Qi,et al.  Self-learning Monte Carlo method and cumulative update in fermion systems , 2017 .

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Tomi Ohtsuki,et al.  Deep Learning the Quantum Phase Transitions in Random Two-Dimensional Electron Systems , 2016, 1610.00462.

[12]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[13]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[14]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[15]  J. Chen,et al.  Equivalence of restricted Boltzmann machines and tensor network states , 2017, 1701.04831.

[16]  Yichen Huang,et al.  Neural Network Representation of Tensor Network and Chiral States. , 2017, Physical review letters.

[17]  D. Deng,et al.  Quantum Entanglement in Neural Network States , 2017, 1701.04844.

[18]  Juan Carrasquilla,et al.  Machine learning quantum phases of matter beyond the fermion sign problem , 2016, Scientific Reports.

[19]  Hiroki Saito,et al.  Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice , 2017, 1709.05468.

[20]  Max Tegmark,et al.  Why Does Deep and Cheap Learning Work So Well? , 2016, Journal of Statistical Physics.

[21]  Kristin A. Persson,et al.  Predicting crystal structures with data mining of quantum calculations. , 2003, Physical review letters.

[22]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[23]  Roger G. Melko,et al.  Kernel methods for interpretable machine learning of order parameters , 2017, 1704.05848.

[24]  Lei Wang,et al.  Can Boltzmann Machines Discover Cluster Updates ? , 2017, Physical review. E.

[25]  Boris Svistunov,et al.  “Worm” algorithm in quantum Monte Carlo simulations☆ , 1998 .

[26]  H. Saito.  Solving the Bose–Hubbard Model with Machine Learning , 2017, 1707.09723.

[27]  R. Melko,et al.  Machine Learning Phases of Strongly Correlated Fermions , 2016, Physical Review X.

[28]  J. Gubernatis,et al.  Quantum Monte Carlo Methods: Algorithms for Lattice Models , 2016 .

[29]  Saito Hiroki,et al.  Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice , 2018 .

[30]  J. Vybíral,et al.  Big data of materials science: critical role of the descriptor. , 2014, Physical review letters.

[31]  Li Huang,et al.  Accelerated Monte Carlo simulations with restricted Boltzmann machines , 2016, 1610.02746.

[32]  Dong-Ling Deng,et al.  Exact Machine Learning Topological States , 2016 .

[33]  Lei Wang,et al.  Recommender engine for continuous-time quantum Monte Carlo methods. , 2016, Physical review. E.

[34]  Dong-Ling Deng,et al.  Machine Learning Topological States , 2016, 1609.09060.

[35]  Sergei V. Kalinin,et al.  Big-deep-smart data in imaging for guiding materials design. , 2015, Nature materials.

[36]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[37]  F. Verstraete,et al.  Matrix product states, projected entangled pair states, and variational renormalization group methods for quantum spin systems , 2008, 0907.2796.

[38]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[39]  Yi Zhang,et al.  Quantum Loop Topography for Machine Learning. , 2016, Physical review letters.

[40]  U. Schollwoeck.  The density-matrix renormalization group in the age of matrix product states , 2010, 1008.3477.

[41]  Lei Wang,et al.  Discovering phase transitions with unsupervised learning , 2016, 1606.00318.