Machine learning vortices at the Kosterlitz-Thouless transition

Efficient and automated classification of phases from minimally processed data is one goal of machine learning in condensed matter and statistical physics. Supervised algorithms trained on raw samples of microstates can successfully detect conventional phase transitions via learning a bulk feature such as an order parameter. In this paper, we investigate whether neural networks can learn to classify phases based on topological defects. We address this question on the two-dimensional classical XY model which exhibits a Kosterlitz-Thouless transition. We find significant feature engineering of the raw spin states is required to convincingly claim that features of the vortex configurations are responsible for learning the transition temperature. We further show a single-layer network does not correctly classify the phases of the XY model, while a convolutional network easily performs classification by learning the global magnetization. Finally, we design a deep network capable of learning vortices without feature engineering. We demonstrate the detection of vortices does not necessarily result in the best classification accuracy, especially for lattices of less than approximately 1000 spins. For larger systems, it remains a difficult task to learn vortices.

[1]  P. Minnhagen,et al.  Superfluid density of a two-dimensional fluid , 1981 .

[2]  Roger G. Melko,et al.  Kernel methods for interpretable machine learning of order parameters , 2017, 1704.05848.

[3]  J. Kosterlitz,et al.  The critical properties of the two-dimensional xy model , 1974 .

[4]  D. Thouless,et al.  Ordering, metastability and phase transitions in two-dimensional systems , 1973 .

[5]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[6]  S. Chung Essential finite-size effect in the two-dimensional XY model , 1999, cond-mat/9901314.

[7]  Sebastian Johann Wetzel,et al.  Unsupervised learning of phase transitions: from principal component analysis to variational autoencoders , 2017, Physical review. E.

[8]  W. Marsden I and J , 2012 .

[9]  Manuel Scherzer,et al.  Machine Learning of Explicit Order Parameters: From the Ising Model to SU(2) Lattice Gauge Theory , 2017, 1705.05582.

[10]  Wolff,et al.  Collective Monte Carlo updating for spin systems. , 1989, Physical review letters.

[11]  D. Nelson,et al.  Universal Jump in the Superfluid Density of Two-Dimensional Superfluids , 1977 .

[12]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[13]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[14]  Takeo Kanade,et al.  Computer Vision – ECCV 2014 , 2014, Lecture Notes in Computer Science.

[15]  Olsson Monte Carlo analysis of the two-dimensional XY model. II. Comparison with the Kosterlitz renormalization-group equations. , 1995, Physical review. B, Condensed matter.

[16]  N. Mermin,et al.  Absence of Ferromagnetism or Antiferromagnetism in One- or Two-Dimensional Isotropic Heisenberg Models , 1966 .

[17]  Yutaka Okabe,et al.  Large-Scale Monte Carlo Simulation of Two-Dimensional Classical XY Model Using Multiple GPUs , 2012, 1210.6116.

[18]  Jun Yu,et al.  Recent developments on deep big vision , 2016, Neurocomputing.

[19]  Wenjian Hu,et al.  Discovering phases, phase transitions, and crossovers through unsupervised machine learning: A critical examination. , 2017, Physical review. E.

[20]  Ce Wang,et al.  Machine learning of frustrated classical spin models. I. Principal component analysis , 2017, 1706.07977.

[21]  Lutz Prechelt,et al.  Automatic early stopping using cross validation: quantifying the criteria , 1998, Neural Networks.

[22]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  J. F. ALLEN,et al.  Flow of Liquid Helium II , 1938, Nature.

[25]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[26]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[27]  G. Barkema,et al.  An introduction to Monte Carlo methods , 2014, 1404.0209.

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  P. Kapitza,et al.  Viscosity of Liquid Helium below the λ-Point , 1938, Nature.