Quantum Neural Network States: A Brief Review of Methods and Applications

One of the main challenges of quantum many-body physics is that the dimensionality of the Hilbert space grows exponentially with the system size, which makes it extremely difficult to solve the Schrodinger equations of the system. But typically, many physical systems have a simplified internal structure which makes the parameters needed to characterize their ground states exponentially smaller. This makes many numerical methods possible in capture the physics of the system. Among these modern numerical techniques, neural networks, which show great power in approximating functions and extracting features of the big data, are now attracting many interests. Neural network representation of quantum many-body states shows great potential in solving some traditionally difficult quantum problems involving large number of freedoms. In this work, we briefly review the progress of using the artificial neural network to build quantum many-body ansatz states. We take Boltzmann machine representation as a prototypical example to illustrate various aspects of neural network representation of quantum many-body states. We first briefly review the classical neural networks, then we illustrate how to use neural networks to represent quantum states and density operators. Some physical properties of the neural network states, including entanglement features, representational power, and the relation with tensor network states, are discussed. For applications, we briefly review the progress of many-body calculating based on neural network states, neural network state approach to tomography, and also the classical simulation of quantum computing based on Boltzmann machine states. At the end of the work, some outlooks and open problems are given.

[1]  M. Lewenstein,et al.  Machine learning by unitary tensor network of hierarchical tree structure , 2017, New Journal of Physics.

[2]  J. Zittartz,et al.  Matrix Product Ground States for One-Dimensional Spin-1 Quantum Antiferromagnets , 1993, cond-mat/9307028.

[3]  Nadav Cohen,et al.  Bridging Many-Body Quantum Physics and Deep Learning via Tensor Networks. , 2018 .

[4]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[5]  Moritz August,et al.  Using Recurrent Neural Networks to Optimize Dynamical Decoupling for Quantum Memory , 2016, ArXiv.

[6]  C. Schwemmer,et al.  Permutationally invariant quantum tomography. , 2010, Physical review letters.

[7]  V. Tikhomirov On the Representation of Continuous Functions of Several Variables as Superpositions of Continuous Functions of a Smaller Number of Variables , 1991 .

[8]  A. H. Werner,et al.  Many-Body Localization Implies that Eigenvectors are Matrix-Product States. , 2014, Physical review letters.

[9]  Zhao Yang,et al.  Machine Learning Spatial Geometry from Entanglement Features , 2017, 1709.01223.

[10]  D. V. Alexeev Neural-network approximation of functions of several variables , 2010 .

[11]  M. Parish,et al.  Quantum dynamics of impurities coupled to a Fermi sea , 2016, 1608.00864.

[12]  J. Chen,et al.  Equivalence of restricted Boltzmann machines and tensor network states , 2017, 1701.04831.

[13]  M. R. Lemes,et al.  Using neural networks to solve nonlinear differential equations in atomic and molecular physics , 2011 .

[14]  F. Verstraete,et al.  Matrix product states, projected entangled pair states, and variational renormalization group methods for quantum spin systems , 2008, 0907.2796.

[15]  Yichen Huang,et al.  Neural Network Representation of Tensor Network and Chiral States. , 2017, Physical review letters.

[16]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[17]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[18]  H. Saito Solving the Bose–Hubbard Model with Machine Learning , 2017, 1707.09723.

[19]  Jun Wang,et al.  Unsupervised Generative Modeling Using Matrix Product States , 2017, Physical Review X.

[20]  Hans-J. Briegel,et al.  Quantum-enhanced machine learning , 2016, Physical review letters.

[21]  J. Cirac,et al.  Variational Matrix Product Operators for the Steady State of Dissipative Quantum Systems. , 2015, Physical review letters.

[22]  Guang-Can Guo,et al.  Efficient machine-learning representations of a surface code with boundaries, defects, domain walls, and twists , 2018, Physical Review A.

[23]  M. Fannes,et al.  Finitely correlated states on quantum spin chains , 1992 .

[24]  Yi Zhang,et al.  Quantum Loop Topography for Machine Learning. , 2016, Physical review letters.

[25]  Jinguo Liu,et al.  Approximating quantum many-body wave functions using artificial neural networks , 2017, 1704.05148.

[26]  Anurag Anshu,et al.  How local is the information in tensor networks of matrix product states or projected entangled pairs states , 2016 .

[27]  Wen-Cong Gan,et al.  Holography as deep learning , 2017, 1705.05750.

[28]  I. Chuang,et al.  Quantum Computation and Quantum Information: Introduction to the Tenth Anniversary Edition , 2010 .

[29]  L. Duan,et al.  Quantum Supremacy for Simulating a Translation-Invariant Ising Spin Model. , 2016, Physical review letters.

[30]  F. Verstraete,et al.  Time-dependent variational principle for quantum lattices. , 2011, Physical review letters.

[31]  Wei Li,et al.  Exponential Thermal Tensor Network Approach for Quantum Lattice Models , 2017, Physical Review X.

[32]  G. Evenbly,et al.  Class of highly entangled many-body states that can be efficiently simulated. , 2012, Physical review letters.

[33]  Andrew S. Darmawan,et al.  Restricted Boltzmann machine learning for solving strongly correlated quantum systems , 2017, 1709.06475.

[34]  L. Duan,et al.  Efficient representation of topologically ordered states with restricted Boltzmann machines , 2018, Physical Review B.

[35]  John Preskill,et al.  Quantum computing and the entanglement frontier , 2012, 1203.5813.

[36]  F. Verstraete,et al.  Computational complexity of projected entangled pair states. , 2007, Physical review letters.

[37]  Michael Zwolak,et al.  Mixed-state dynamics in one-dimensional quantum lattice systems: a time-dependent superoperator renormalization algorithm. , 2004, Physical review letters.

[38]  Hendrik Weimer,et al.  A simple tensor network algorithm for two-dimensional steady states , 2016, Nature Communications.

[39]  E. Miles Stoudenmire,et al.  Learning relevant features of data with multi-scale tensor networks , 2017, ArXiv.

[40]  Steven Weinstein,et al.  Learning the Einstein-Podolsky-Rosen correlations on a Restricted Boltzmann Machine , 2017, 1707.03114.

[41]  J I Cirac,et al.  Matrix product states for dynamical simulation of infinite chains. , 2009, Physical review letters.

[42]  Fred Garnett,et al.  Colloquium , 2008, Br. J. Educ. Technol..

[43]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.

[44]  Lu-Ming Duan,et al.  Efficient representation of quantum many-body states with deep neural networks , 2017, Nature Communications.

[45]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[46]  Román Orús,et al.  Tensor networks for complex quantum systems , 2018, Nature Reviews Physics.

[47]  F. Verstraete,et al.  Renormalization algorithms for Quantum-Many Body Systems in two and higher dimensions , 2004, cond-mat/0407066.

[48]  Li Huang,et al.  Accelerated Monte Carlo simulations with restricted Boltzmann machines , 2016, 1610.02746.

[49]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[50]  Roman Orus,et al.  A Practical Introduction to Tensor Networks: Matrix Product States and Projected Entangled Pair States , 2013, 1306.2164.

[51]  Stephen Becker,et al.  Quantum state tomography via compressed sensing. , 2009, Physical review letters.

[52]  White,et al.  Density matrix formulation for quantum renormalization groups. , 1992, Physical review letters.

[53]  Fernando Quijandría,et al.  Continuous matrix product states for quantum fields , 2015 .

[54]  Giacomo Torlai,et al.  Neural Decoder for Topological Codes. , 2016, Physical review letters.

[55]  D. Gross,et al.  Efficient quantum state tomography. , 2010, Nature communications.

[56]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[57]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[58]  J. Eisert,et al.  Area laws for the entanglement entropy - a review , 2008, 0808.3773.

[59]  G. Vidal,et al.  Classical simulation of quantum many-body systems with a tree tensor network , 2005, quant-ph/0511070.

[60]  Barenco,et al.  Elementary gates for quantum computation. , 1995, Physical review. A, Atomic, molecular, and optical physics.

[61]  Nihat Ay,et al.  Refinements of Universal Approximation Results for Deep Belief Networks and Restricted Boltzmann Machines , 2010, Neural Computation.

[62]  V. Vedral,et al.  Entanglement in Many-Body Systems , 2007, quant-ph/0703044.

[63]  Dong-Ling Deng,et al.  Machine Learning Topological States , 2016, 1609.09060.

[64]  K. Birgitta Whaley,et al.  Towards quantum machine learning with tensor networks , 2018, Quantum Science and Technology.

[65]  R. Jastrow Many-Body Problem with Strong Forces , 1955 .

[66]  M. B. Hastings,et al.  Solving gapped Hamiltonians locally , 2006 .

[67]  F. Verstraete,et al.  Entanglement renormalization for quantum fields in real space. , 2011, Physical review letters.

[68]  Umesh Vazirani,et al.  Rigorous RG Algorithms and Area Laws for Low Energy Eigenstates in 1D , 2016, Communications in Mathematical Physics.

[69]  Roger G. Melko,et al.  Learning Thermodynamics with Boltzmann Machines , 2016, ArXiv.

[70]  Geoffrey E. Hinton,et al.  OPTIMAL PERCEPTUAL INFERENCE , 1983 .

[71]  R. S-A. Gatsaeva,et al.  On the representation of continuous functions of several variables as superpositions of continuous functions of one variable and addition , 2018 .

[72]  Giacomo Torlai,et al.  Latent Space Purification via Neural Density Operators. , 2018, Physical review letters.

[73]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[74]  Piotr Czarnik,et al.  Variational approach to projected entangled pair states at finite temperature , 2015, 1503.01077.

[75]  David J. Schwab,et al.  Supervised Learning with Tensor Networks , 2016, NIPS.

[76]  Teuvo Kohonen,et al.  An introduction to neural computing , 1988, Neural Networks.

[77]  Guang-Can Guo,et al.  An Efficient Algorithmic Way to Construct Boltzmann Machine Representations for Arbitrary Stabilizer Code , 2018, 1809.08631.

[78]  Guifre Vidal,et al.  Scaling of entanglement entropy in the (branching) multiscale entanglement renormalization ansatz , 2013, 1310.8372.

[79]  Masoud Mohseni,et al.  Quantum support vector machine for big feature and big data classification , 2013, Physical review letters.

[80]  Frank Verstraete Quantum Hamiltonian complexity: Worth the wait , 2015 .

[81]  C. F. Roos,et al.  Efficient tomography of a quantum many-body system , 2016, Nature Physics.

[82]  G. Vidal Efficient classical simulation of slightly entangled quantum computations. , 2003, Physical review letters.

[83]  U. Vazirani,et al.  A polynomial time algorithm for the ground state of one-dimensional gapped local Hamiltonians , 2015, Nature Physics.

[84]  Jacob biamonte,et al.  Quantum machine learning , 2016, Nature.

[85]  B. Bauer,et al.  Neural-network states for the classical simulation of quantum computing , 2018, 1808.05232.

[86]  T. Osborne Hamiltonian complexity , 2011, Reports on progress in physics. Physical Society.

[87]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[88]  Ying-Jer Kao,et al.  Steady States of Infinite-Size Dissipative Quantum Chains via Imaginary Time Evolution. , 2016, Physical review letters.

[89]  Andreas Schadschneider,et al.  Equivalence and solution of anisotropic spin-1 models and generalized t-J fermion models in one dimension , 1991 .

[90]  Yong-Sheng Zhang,et al.  Solving frustrated quantum many-particle models with convolutional neural networks , 2018, Physical Review B.

[91]  Peter Wittek,et al.  Inductive Supervised Quantum Learning. , 2017, Physical review letters.

[92]  Roger Melko,et al.  Quantum Boltzmann Machine , 2016, 1601.02036.

[93]  J. Cirac,et al.  Neural-Network Quantum States, String-Bond States, and Chiral Topological States , 2017, 1710.04045.

[94]  J. Orbach Principles of Neurodynamics. Perceptrons and the Theory of Brain Mechanisms. , 1962 .

[95]  C. Monterola,et al.  Solving the nonlinear Schrodinger equation with an unsupervised neural network. , 2003, Optics express.

[96]  Jerzy Słupecki,et al.  A criterion of fullness of many-valued systems of propositional logic , 1972 .

[97]  F. Verstraete,et al.  Post-matrix product state methods: To tangent space and beyond , 2013, 1305.1894.

[98]  M. Hastings,et al.  An area law for one-dimensional quantum systems , 2007, 0705.2024.

[99]  Matthias Troyer,et al.  Neural-network quantum state tomography , 2018 .

[100]  Doreen Meier,et al.  Fundamentals Of Neural Networks Architectures Algorithms And Applications , 2016 .

[101]  T. Carrington,et al.  An improved neural network method for solving the Schrödinger equation1 , 2009 .

[102]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[103]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[104]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[105]  D. Deng,et al.  Quantum Entanglement in Neural Network States , 2017, 1701.04844.

[106]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[107]  G. Vidal Entanglement renormalization. , 2005, Physical review letters.

[108]  K. Aoki,et al.  Restricted Boltzmann machines for the long range Ising models , 2016, 1701.00246.