Adversarial Domain Adaptation for Identifying Phase Transitions

The identification of phases of matter is a challenging task, especially in quantum mechanics, where the complexity of the ground state appears to grow exponentially with the size of the system. Traditionally, physicists have to identify the relevant order parameters for the classification of the different phases. We here follow a radically different approach: we address this problem with a state-of-the-art deep learning technique, adversarial domain adaptation. We derive the phase diagram of the whole parameter space starting from a fixed and known subspace using unsupervised learning. This method has the advantage that the input of the algorithm can be directly the ground state without any ad hoc feature engineering. Furthermore, the dimension of the parameter space is unrestricted. More specifically, the input data set contains both labeled and unlabeled data instances. The first kind is a system that admits an accurate analytical or numerical solution, and one can recover its phase diagram. The second type is the physical system with an unknown phase diagram. Adversarial domain adaptation uses both types of data to create invariant feature extracting layers in a deep learning architecture. Once these layers are trained, we can attach an unsupervised learner to the network to find phase transitions. We show the success of this technique by applying it on several paradigmatic models: the Ising model with different temperatures, the Bose-Hubbard model, and the Su-Schrieffer-Heeger model with disorder. The method finds unknown transitions successfully and predicts transition points in close agreement with standard methods. This study opens the door to the classification of physical systems where the phase boundaries are complex such as the many-body localization problem or the Bose glass phase.

[1]  D. Deng,et al.  Quantum Entanglement in Neural Network States , 2017, 1701.04844.

[2]  W. Zwerger,et al.  Mott-Hubbard transition of cold atoms in optical lattices , 2002 .

[3]  Andrew S. Darmawan,et al.  Restricted Boltzmann machine learning for solving strongly correlated quantum systems , 2017, 1709.06475.

[4]  Lenka Zdeborová,et al.  New tool in the box , 2017, Nature Physics.

[5]  Emil Prodan,et al.  Topological criticality in the chiral-symmetric AIII class at strong disorder. , 2013, Physical review letters.

[6]  H. Saito Solving the Bose–Hubbard Model with Machine Learning , 2017, 1707.09723.

[7]  R. Melko,et al.  Machine Learning Phases of Strongly Correlated Fermions , 2016, Physical Review X.

[8]  L'aszl'o Oroszl'any,et al.  A Short Course on Topological Insulators: Band-structure topology and edge states in one and two dimensions , 2015, 1509.02295.

[9]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[10]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[11]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[12]  Lu-Ming Duan,et al.  Efficient representation of quantum many-body states with deep neural networks , 2017, Nature Communications.

[13]  Dong-Ling Deng,et al.  Machine Learning Topological States , 2016, 1609.09060.

[14]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[15]  Pengfei Zhang,et al.  Machine Learning Topological Invariants with Neural Networks , 2017, Physical review letters.

[16]  Caffarel,et al.  Gutzwiller wave function for a model of strongly interacting bosons. , 1992, Physical review. B, Condensed matter.

[17]  Richard T. Scalettar,et al.  Principal component analysis for fermionic critical points , 2017 .

[18]  P. Marko,et al.  ABSENCE OF DIFFUSION IN CERTAIN RANDOM LATTICES , 2008 .

[19]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[20]  Hiroki Saito,et al.  Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice , 2017, 1709.05468.

[21]  Kelvin George Chng,et al.  Unsupervised machine learning account of magnetic transitions in the Hubbard model. , 2017, Physical review. E.

[22]  Shun-Qing Shen,et al.  Topological Anderson insulator. , 2008, Physical review letters.

[23]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[24]  Martin Wattenberg,et al.  How to Use t-SNE Effectively , 2016 .

[25]  R. Nandkishore,et al.  Many-Body Localization and Thermalization in Quantum Statistical Mechanics , 2014, 1404.0686.

[26]  Wenjian Hu,et al.  Discovering phases, phase transitions, and crossovers through unsupervised machine learning: A critical examination. , 2017, Physical review. E.

[27]  Ce Wang,et al.  Machine learning of frustrated classical spin models. I. Principal component analysis , 2017, 1706.07977.

[28]  N. Crokidakis First-order phase transition in a 2D random-field Ising model with conflicting dynamics , 2009, 0901.2659.

[29]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[30]  Y. Khorramzadeh,et al.  Boson core compressibility , 2012, 1201.0523.

[31]  Alexandre Dauphin,et al.  Topological characterization of chiral models through their long time dynamics , 2017, 1708.02778.

[32]  Lei Wang,et al.  Discovering phase transitions with unsupervised learning , 2016, 1606.00318.

[33]  Titus Neupert,et al.  Probing many-body localization with neural networks , 2017, 1704.01578.

[34]  Saito Hiroki,et al.  Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice , 2018 .

[35]  J. Chen,et al.  Equivalence of restricted Boltzmann machines and tensor network states , 2017, 1701.04831.

[36]  Juan Carrasquilla,et al.  Machine learning quantum phases of matter beyond the fermion sign problem , 2016, Scientific Reports.

[37]  Sebastian Johann Wetzel,et al.  Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders , 2017, Physical review. E.