Descriptors for Machine Learning Model of Generalized Force Field in Condensed Matter Systems

We outline the general framework of machine learning (ML) methods for multi-scale dynamical modeling of condensed matter systems, and in particular of strongly correlated electron models. Complex spatial temporal behaviors in these systems often arise from the interplay between quasiparticles and the emergent dynamical classical degrees of freedom, such as local lattice distortions, spins, and order-parameters. Central to the proposed framework is the ML energy model that, by successfully emulating the time-consuming electronic structure calculation, can accurately predict a local energy based on the classical field in the intermediate neighborhood. In order to properly include the symmetry of the electron Hamiltonian, a crucial component of the ML energy model is the descriptor that transforms the neighborhood configuration into invariant feature variables, which are input to the learning model. A general theory of the descriptor for the classical fields is formulated, and two types of models are distinguished depending on the presence or absence of an internal symmetry for the classical field. Several specific approaches to the descriptor of the classical fields are presented. Our focus is on the group-theoretical method that offers a systematic and rigorous approach to compute invariants based on the bispectrum coefficients. We propose an efficient implementation of the bispectrum method based on the concept of reference irreducible representations. Finally, the implementations of the various descriptors are demonstrated on wellknown electronic lattice models.

[1]  Puhan Zhang,et al.  Anomalous phase separation and hidden coarsening of super-clusters in the Falicov-Kimball model , 2021, ArXiv.

[2]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[3]  V. J. Emery,et al.  Electronic liquid-crystal phases of a doped Mott insulator , 1998, Nature.

[4]  Hans-J. Briegel,et al.  Machine learning \& artificial intelligence in the quantum domain , 2017, ArXiv.

[5]  H. Eisaki,et al.  Imaging the granular structure of high-Tc superconductivity in underdoped Bi2Sr2CaCu2O8+δ , 2001, Nature.

[6]  Kazuhiro Terao,et al.  Machine learning at the energy and intensity frontiers of particle physics , 2018, Nature.

[7]  D. Baron Machine Learning in Astronomy: a practical overview , 2019, 1904.07248.

[8]  G. Grüner The dynamics of spin-density waves , 1994 .

[9]  S. H. Pan,et al.  Microscopic electronic inhomogeneity in the highT c superconductor Bi 2 Sr 2 CaCu 2 O 8 + x , 2001 .

[10]  G. Wellein,et al.  The kernel polynomial method , 2005, cond-mat/0504627.

[11]  Puhan Zhang,et al.  Machine learning dynamics of phase separation in correlated electron magnets , 2020, ArXiv.

[12]  장윤희,et al.  Y. , 2003, Industrial and Labor Relations Terms.

[13]  A. Ourmazd Science in the age of machine learning , 2020, Nature Reviews Physics.

[14]  Ramakrishna Kakarala Completeness of bispectrum on compact groups , 2009 .

[15]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[16]  G. Kotliar,et al.  New functional integral approach to strongly correlated Fermi systems: The Gutzwiller approximation as a saddle point. , 1986, Physical review letters.

[17]  M. Tuckerman,et al.  Ab initio molecular dynamics: concepts, recent developments, and future trends. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Yu-An Chen,et al.  Density matrix renormalization group , 2014 .

[19]  M. Meuwly Machine Learning for Chemical Reactions. , 2021, Chemical reviews.

[20]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[21]  Dagotto,et al.  Phase separation scenario for manganese oxides and related materials , 1999, Science.

[22]  W. Krauth,et al.  Dynamical mean-field theory of strongly correlated fermion systems and the limit of infinite dimensions , 1996 .

[23]  Sergei V. Kalinin,et al.  Big-deep-smart data in imaging for guiding materials design. , 2015, Nature materials.

[24]  Phase Separation in Electronic Models for Manganites , 1997, cond-mat/9706014.

[25]  Li Huang,et al.  Accelerated Monte Carlo simulations with restricted Boltzmann machines , 2016, 1610.02746.

[26]  R. Kakarala A group-theoretic approach to the triple correlation , 1993, [1993 Proceedings] IEEE Signal Processing Workshop on Higher-Order Statistics.

[27]  Filippo Federici Canova,et al.  DScribe: Library of Descriptors for Machine Learning in Materials Science , 2019, Comput. Phys. Commun..

[28]  S. Zhang,et al.  Roles of nonequilibrium conduction electrons on the magnetization dynamics of ferromagnets. , 2004, Physical review letters.

[29]  C. Marianetti,et al.  Electronic structure calculations with dynamical mean-field theory , 2005, cond-mat/0511085.

[30]  Zhong,et al.  Polaronic anharmonicity in the Holstein-Hubbard model. , 1992, Physical review letters.

[31]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.

[32]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[33]  Risi Kondor,et al.  A novel set of rotationally and translationally invariant features for images based on the non-commutative bispectrum , 2007, cs/0701127.

[34]  P. Alam ‘O’ , 2021, Composites Engineering: An A–Z Guide.

[35]  Klaus-Robert Müller,et al.  Finding Density Functionals with Machine Learning , 2011, Physical review letters.

[36]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[37]  Masashi Tsubaki,et al.  Quantum deep field: data-driven wave function, electron density generation, and atomization energy prediction and extrapolation with machine learning , 2020, Physical review letters.

[38]  T. Holstein,et al.  Studies of polaron motion: Part II. The “small” polaron , 1959 .

[39]  Kohn,et al.  Density functional and density matrix method scaling linearly with the number of atoms. , 1996, Physical review letters.

[40]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[41]  Popovic,et al.  Cooperative jahn-teller coupling in the manganites , 2000, Physical review letters.

[42]  Philip W. Anderson,et al.  Considerations on Double Exchange , 1955 .

[43]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[44]  P. de Gennes,et al.  Effects of Double Exchange in Magnetic Crystals , 1960 .

[45]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[46]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[47]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[48]  M. Azuma,et al.  A ‘checkerboard’ electronic crystal state in lightly hole-doped Ca2-xNaxCuO2Cl2 , 2004, Nature.

[49]  P. Hohenberg,et al.  Theory of Dynamic Critical Phenomena , 1977 .

[50]  Matthias Troyer,et al.  Quantum Monte Carlo , 2004 .

[51]  A. Bray Theory of phase-ordering kinetics , 1994, cond-mat/9501089.

[52]  Clarence Zener,et al.  Interaction Between the d Shells in the Transition Metals , 1951 .

[53]  Shraiman,et al.  Dynamic Jahn-Teller Effect and Colossal Magnetoresistance in La 1-xSrxMnO3. , 1995, Physical review letters.

[54]  Jahn-Teller effect and electron correlation in manganites , 2002, cond-mat/0202301.

[55]  Elbio Dagotto,et al.  Complexity in Strongly Correlated Electronic Systems , 2005, Science.

[56]  A. Tkatchenko,et al.  Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems , 2021, Chemical reviews.

[57]  S. Dixit,et al.  Coulomb effects on one-dimensional peierls instability: The peierls-hubbard model , 1983 .

[58]  J. C. Kimball,et al.  Simple Model for Semiconductor-Metal Transitions: SmB6and Transition-Metal Oxides , 1969 .

[59]  D. Morgan,et al.  Opportunities and Challenges for Machine Learning in Materials Science , 2020, Annual Review of Materials Research.

[60]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[61]  E. Fradkin,et al.  Field Theories of Condensed Matter Physics , 2013 .

[62]  P. Littlewood,et al.  Mesoscopic Texture in Manganites , 2003 .

[63]  E Weinan,et al.  Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics , 2017, Physical review letters.

[64]  S. Fritzsche,et al.  Generation of Clebsch-Gordan coefficients for the point and double groups , 2006, Comput. Phys. Commun..

[65]  G. Grüner,et al.  The dynamics of charge-density waves , 1988 .

[66]  Volker L. Deringer,et al.  Machine Learning Interatomic Potentials as Emerging Tools for Materials Science , 2019, Advanced materials.

[67]  William Stafford Noble,et al.  Machine learning applications in genetics and genomics , 2015, Nature Reviews Genetics.

[68]  Katherine A. Heller,et al.  Massive computational acceleration by using neural networks to emulate mechanism-based biological models , 2019, Nature Communications.

[69]  Andrew G. Taube,et al.  Improving the accuracy of Møller-Plesset perturbation theory with neural networks. , 2017, The Journal of chemical physics.

[70]  R. Kondor,et al.  On representing chemical environments , 2012, 1209.3140.

[71]  Tim Mueller,et al.  Machine learning for interatomic potential models. , 2020, The Journal of chemical physics.

[72]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[73]  Jonathan T. Barron,et al.  Continuously Differentiable Exponential Linear Units , 2017, ArXiv.

[74]  White,et al.  Density matrix formulation for quantum renormalization groups. , 1992, Physical review letters.

[75]  Shaun M. Kandathil,et al.  A guide to machine learning for biologists , 2021, Nature Reviews Molecular Cell Biology.

[76]  Frank Noé,et al.  Machine learning for molecular simulation , 2019, Annual review of physical chemistry.

[77]  Bernard R Brooks,et al.  Machine Learning Force Field Parameters from Ab Initio Data. , 2017, Journal of chemical theory and computation.

[78]  Elbio Dagotto,et al.  Nanoscale Phase Separation and Colossal Magnetoresistance , 2003 .

[79]  M. Drofenik,et al.  Ferromagnetism in suspensions of magnetic platelets in liquid crystal , 2013, Nature.

[80]  S. Uchida,et al.  Evidence for stripe correlations of spins and holes in copper oxide superconductors , 1995, Nature.

[81]  Alan J. Heeger,et al.  Soliton excitations in polyacetylene , 1980 .

[82]  Y. Asai,et al.  Deep-Learning Approach to First-Principles Transport Simulations. , 2021, Physical review letters.

[83]  K. Barros,et al.  Semiclassical dynamics of spin density waves , 2017, 1708.08050.

[84]  G. Kotliar,et al.  Slave Boson Theory of Orbital Differentiation with Crystal Field Effects: Application to UO_{2}. , 2016, Physical review letters.

[85]  Alexander V. Shapeev,et al.  Moment Tensor Potentials: A Class of Systematically Improvable Interatomic Potentials , 2015, Multiscale Model. Simul..

[86]  Yang Qi,et al.  Self-learning Monte Carlo method , 2016, 1610.03137.

[87]  J. Behler Atom-centered symmetry functions for constructing high-dimensional neural network potentials. , 2011, The Journal of chemical physics.

[88]  Rampi Ramprasad,et al.  Machine Learning Force Fields: Construction, Validation, and Outlook , 2016, 1610.02098.

[89]  Yuanbo Zhang,et al.  Electronic Identification of the Parental Phases and Mesoscopic Phase Separation of KxFe2-ySe2 Superconductors , 2011 .

[90]  Lu-Ming Duan,et al.  Machine learning meets quantum physics , 2019, Physics Today.

[91]  Zhenwei Li,et al.  Molecular dynamics with on-the-fly machine learning of quantum-mechanical forces. , 2015, Physical review letters.

[92]  Avik W. Ghosh,et al.  Machine learning electron correlation in a disordered medium , 2018, Physical Review B.

[93]  Daniel W. Davies,et al.  Machine learning for molecular and materials science , 2018, Nature.

[94]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[95]  Kristof T. Schütt,et al.  Unifying machine learning and quantum chemistry with a deep neural network for molecular wavefunctions , 2019, Nature Communications.

[96]  B. Harmon,et al.  Spin dynamics in magnets: Quantum effects and numerical simulations (invited) , 1997 .

[97]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[98]  K. Müller,et al.  Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space , 2015, The journal of physical chemistry letters.

[99]  Matthias Rupp,et al.  Unified representation of molecules and crystals for machine learning , 2017, Mach. Learn. Sci. Technol..

[100]  J. Vybíral,et al.  Big data of materials science: critical role of the descriptor. , 2014, Physical review letters.

[101]  Ralf Drautz,et al.  Atomic cluster expansion for accurate and transferable interatomic potentials , 2019, Physical Review B.

[102]  Felix A Faber,et al.  Crystal structure representations for machine learning models of formation energies , 2015, 1503.07406.

[103]  J. Hirsch Effect of Coulomb Interactions on the Peierls Instability , 1983 .

[104]  J S Smith,et al.  ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost , 2016, Chemical science.

[105]  A. Yazdani,et al.  Local Ordering in the Pseudogap State of the High-Tc Superconductor Bi2Sr2CaCu2O8+δ , 2004, Science.

[106]  W. Kohn,et al.  Nearsightedness of electronic matter. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[107]  G. Chern,et al.  Arrested Phase Separation in Double-Exchange Models: Large-Scale Simulation Enabled by Machine Learning. , 2021, Physical review letters.

[108]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[109]  Justin S. Smith,et al.  Machine learning for molecular dynamics with strongly correlated electrons , 2018, Physical Review B.

[110]  P. Alam ‘N’ , 2021, Composites Engineering: An A–Z Guide.

[111]  J. Kress,et al.  Mott Transition in a Metallic Liquid: Gutzwiller Molecular Dynamics Simulations. , 2015, Physical review letters.

[112]  R. Wilson The classical groups , 2009 .