Finding Quantum Critical Points with Neural-Network Quantum States

Finding the precise location of quantum critical points is of particular importance to characterise quantum many-body systems at zero temperature. However, quantum many-body systems are notoriously hard to study because the dimension of their Hilbert space increases exponentially with their size. Recently, machine learning tools known as neural-network quantum states have been shown to effectively and efficiently simulate quantum many-body systems. We present an approach to finding the quantum critical points of the quantum Ising model using neural-network quantum states, analytically constructed innate restricted Boltzmann machines, transfer learning and unsupervised learning. We validate the approach and evaluate its efficiency and effectiveness in comparison with other traditional approaches.

[1]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[2]  Geoffrey E. Hinton,et al.  Replicated Softmax: an Undirected Topic Model , 2009, NIPS.

[3]  Guglielmo Mazzola,et al.  NetKet: A machine learning toolkit for many-body quantum systems , 2019, SoftwareX.

[4]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[5]  Vladimir Privman,et al.  Finite Size Scaling and Numerical Simulation of Statistical Systems , 1990 .

[6]  G. Carleo,et al.  Ground state phase diagram of the one-dimensional Bose-Hubbard model from restricted Boltzmann machines , 2019, Journal of Physics: Conference Series.

[7]  Yusuke Nomura,et al.  Constructing exact representations of quantum many-body systems with deep neural networks , 2018, Nature Communications.

[8]  G. Carleo,et al.  Fermionic neural-network states for ab-initio electronic structure , 2019, Nature Communications.

[9]  G. Carleo,et al.  Symmetries and Many-Body Excitations with Neural-Network Quantum States. , 2018, Physical review letters.

[10]  Youjin Deng,et al.  Cluster Monte Carlo simulation of the transverse Ising model. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  Yee Whye Teh,et al.  Rate-coded Restricted Boltzmann Machines for Face Recognition , 2000, NIPS.

[12]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[13]  Dario Poletti,et al.  Transfer learning for scalability of neural-network quantum states. , 2019, Physical review. E.

[14]  Geoffrey E. Hinton,et al.  The Recurrent Temporal Restricted Boltzmann Machine , 2008, NIPS.

[15]  M. Lavagna.  Quantum Phase Transitions , 2001, cond-mat/0102119.

[16]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.

[17]  Michael Weyrauch,et al.  Phase diagrams of one-, two-, and three-dimensional quantum spin systems , 2016, Quantum Inf. Comput..

[18]  Geoffrey E. Hinton,et al.  Generative versus discriminative training of RBMs for classification of fMRI images , 2008, NIPS.

[19]  Fu Jie Huang,et al.  A Tutorial on Energy-Based Learning , 2006 .

[20]  K. Wilson.  Problems in Physics with many Scales of Length , 1979 .

[21]  M. Hastings,et al.  On Complexity of the Quantum Ising Model , 2014, 1410.0703.

[22]  Lu-Ming Duan,et al.  Efficient representation of quantum many-body states with deep neural networks , 2017, Nature Communications.

[23]  Christoph Becker,et al.  Identifying quantum phase transitions using artificial neural networks on experimental data , 2018, Nature Physics.

[24]  S. Sachin Kumar,et al.  Deep Model for Classification of Hyperspectral image using Restricted Boltzmann Machine , 2014, ICONIAAC '14.

[25]  B. Chakrabarti,et al.  Quantum Ising Phases and Transitions in Transverse Ising Models , 1996 .

[26]  Kennedy,et al.  Rigorous results on valence-bond ground states in antiferromagnets. , 1987, Physical review letters.

[27]  Roman Orus,et al.  A Practical Introduction to Tensor Networks: Matrix Product States and Projected Entangled Pair States , 2013, 1306.2164.

[28]  R. Elliott.  Phenomenological Discussion of Magnetic Ordering in the Heavy Rare-Earth Metals , 1961 .

[29]  J. Chen,et al.  Equivalence of restricted Boltzmann machines and tensor network states , 2017, 1701.04831.

[30]  Ievgeniia Oshurko.  Quantum Machine Learning , 2020, Quantum Computing.

[31]  Yoshua Bengio,et al.  Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription , 2012, ICML.

[32]  S. Montangero,et al.  On the descriptive power of Neural-Networks as constrained Tensor Networks with exponentially large bond dimension , 2019, SciPost Physics Core.

[33]  Marcin Jarzyna,et al.  True precision limits in quantum metrology , 2014, 1407.4805.

[34]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[35]  Geoffrey E. Hinton,et al.  Robust Boltzmann Machines for recognition and denoising , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[37]  Alfredo De Santis,et al.  Network anomaly detection with the restricted Boltzmann machine , 2013, Neurocomputing.

[38]  White,et al.  Density matrix formulation for quantum renormalization groups. , 1992, Physical review letters.

[39]  Tzyh Jong Tarn,et al.  Fidelity-Based Probabilistic Q-Learning for Control of Quantum Systems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Haizhou Li,et al.  Conditional restricted Boltzmann machine for voice conversion , 2013, 2013 IEEE China Summit and International Conference on Signal and Information Processing.

[41]  Pengtao Xie,et al.  Diversifying Restricted Boltzmann Machine for Document Modeling , 2015, KDD.

[42]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[43]  Andrew S. Darmawan,et al.  Restricted Boltzmann machine learning for solving strongly correlated quantum systems , 2017, 1709.06475.

[44]  A. Sandvik.  Finite-size scaling of the ground-state parameters of the two-dimensional Heisenberg model , 1997, cond-mat/9707123.

[45]  Lu-Ming Duan,et al.  Machine learning meets quantum physics , 2019, Physics Today.

[46]  Sebastian Thrun,et al.  Learning to Learn: Introduction and Overview , 1998, Learning to Learn.

[47]  Trung Le,et al.  Supervised Restricted Boltzmann Machines , 2017, UAI.

[48]  Lei Wang,et al.  Discovering phase transitions with unsupervised learning , 2016, 1606.00318.

[49]  Nikita Astrakhantsev,et al.  Generalization properties of neural network approximations to frustrated magnet ground states , 2020, Nature Communications.

[50]  J. Cirac,et al.  Restricted Boltzmann machines in quantum physics , 2019, Nature Physics.

[51]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[52]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[53]  D. Deng,et al.  Quantum Entanglement in Neural Network States , 2017, 1701.04844.

[54]  G. C. Knollman,et al.  Quantum Cell Model for Bosons , 1963 .

[55]  Juan Carrasquilla,et al.  Machine learning quantum phases of matter beyond the fermion sign problem , 2016, Scientific Reports.

[56]  Sebastian Johann Wetzel,et al.  Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders , 2017, Physical review. E.

[57]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[58]  C. Lanczos.  An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[59]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[60]  Guang-Can Guo,et al.  Efficient machine-learning representations of a surface code with boundaries, defects, domain walls, and twists , 2018, Physical Review A.

[61]  Jakub M. Tomczak,et al.  Classification Restricted Boltzmann Machine for comprehensible credit scoring model , 2015, Expert Syst. Appl..

[62]  Chao Yang,et al.  ARPACK users' guide - solution of large-scale eigenvalue problems with implicitly restarted Arnoldi methods , 1998, Software, environments, tools.

[63]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[64]  Wenjing Jin,et al.  Enhanced Restricted Boltzmann Machine With Prognosability Regularization for Prognostics and Health Assessment , 2016, IEEE Transactions on Industrial Electronics.

[65]  Haitham Bou-Ammar,et al.  Automatically Mapped Transfer between Reinforcement Learning Tasks via Three-Way Restricted Boltzmann Machines , 2013, ECML/PKDD.

[66]  Geoffrey E. Hinton,et al.  Learning a better representation of speech soundwaves using restricted boltzmann machines , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[67]  Moritz August,et al.  Using Recurrent Neural Networks to Optimize Dynamical Decoupling for Quantum Memory , 2016, ArXiv.

[68]  J. Gubernatis,et al.  Quantum Monte Carlo Methods: Algorithms for Lattice Models , 2016 .

[69]  L. Duan,et al.  Efficient representation of topologically ordered states with restricted Boltzmann machines , 2018, Physical Review B.

[70]  Lorien Y. Pratt,et al.  Discriminability-Based Transfer between Neural Networks , 1992, NIPS.

[71]  B. Schölkopf,et al.  Modeling Human Motion Using Binary Latent Variables , 2007 .

[72]  S. M. Girvin,et al.  Continuous quantum phase transitions , 1997 .

[73]  Jonathan Baxter,et al.  Theoretical Models of Learning to Learn , 1998, Learning to Learn.

[74]  Nicolas Le Roux,et al.  Learning a Generative Model of Images by Factoring Appearance and Shape , 2011, Neural Computation.

[75]  Christopher K. I. Williams,et al.  Multiple Texture Boltzmann Machines , 2012, AISTATS.

[76]  B. Bauer,et al.  Neural-network states for the classical simulation of quantum computing , 2018, 1808.05232.

[77]  Geoffrey E. Hinton,et al.  Phone Recognition with the Mean-Covariance Restricted Boltzmann Machine , 2010, NIPS.

[78]  Yoshua Bengio,et al.  Classification using discriminative restricted Boltzmann machines , 2008, ICML '08.

[79]  Wenjian Hu,et al.  Discovering phases, phase transitions, and crossovers through unsupervised machine learning: A critical examination. , 2017, Physical review. E.

[80]  Kenny Choo,et al.  Two-dimensional frustrated J1−J2 model studied with neural network quantum states , 2019, Physical Review B.

[81]  Matthias Troyer,et al.  Neural-network quantum state tomography , 2018 .

[82]  U. Schollwoeck.  The density-matrix renormalization group in the age of matrix product states , 2010, 1008.3477.

[83]  J. Cirac,et al.  Neural-Network Quantum States, String-Bond States, and Chiral Topological States , 2017, 1710.04045.

[84]  D. Thouless.  The Quantum Mechanics of Many-Body Systems , 2013 .