Extensive deep neural networks for transferring small scale learning to large scale systems

We present a physically-motivated topology of a deep neural network that can efficiently infer extensive parameters (such as energy, entropy, or number of particles) of arbitrarily large systems, doing so with scaling.

[1]  Amnon Shashua,et al.  Quantum Entanglement in Deep Learning Architectures. , 2018, Physical review letters.

[2]  Volker L. Deringer,et al.  Machine learning based interatomic potential for amorphous carbon , 2016, 1611.03277.

[3]  Alexandre Tkatchenko,et al.  Quantum-chemical insights from deep tensor neural networks , 2016, Nature Communications.

[4]  G. Kresse,et al.  Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set , 1996 .

[5]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[6]  Kyle Mills,et al.  Deep learning and the Schrödinger equation , 2017, ArXiv.

[7]  Jörg Behler,et al.  Structure of aqueous NaOH solutions: insights from neural-network-based molecular dynamics simulations. , 2016, Physical chemistry chemical physics : PCCP.

[8]  W. Goddard,et al.  UFF, a full periodic table force field for molecular mechanics and molecular dynamics simulations , 1992 .

[9]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[10]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[11]  A. Becke.  Density-functional thermochemistry. III. The role of exact exchange , 1993 .

[12]  Klaus-Robert Müller,et al.  Capturing intensive and extensive DFT/TDDFT molecular properties with machine learning , 2018 .

[13]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[14]  Hafner,et al.  Ab initio molecular-dynamics simulation of the liquid-metal-amorphous-semiconductor transition in germanium. , 1994, Physical review. B, Condensed matter.

[15]  Rolf Krause,et al.  Smart energy models for atomistic simulations using a DFT-driven multifidelity approach , 2018, ArXiv.

[16]  Kresse,et al.  Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. , 1996, Physical review. B, Condensed matter.

[17]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[19]  Jeffrey C Grossman,et al.  Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties. , 2017, Physical review letters.

[20]  Isaac Tamblyn,et al.  Convolutional neural networks for atomistic systems , 2017, Computational Materials Science.

[21]  James Theiler,et al.  Adaptive Strategies for Materials Design using Uncertainties , 2016, Scientific Reports.

[22]  J S Smith,et al.  ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost , 2016, Chemical science.

[23]  G. Kresse,et al.  Ab initio molecular dynamics for liquid metals. , 1993 .

[24]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[25]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[26]  O. A. von Lilienfeld,et al.  Machine learning for many-body physics: The case of the Anderson impurity model , 2014, 1408.1143.

[27]  Kun Yao,et al.  Kinetic Energy of Hydrocarbons as a Function of Electron Density and Convolutional Neural Networks. , 2015, Journal of chemical theory and computation.

[28]  K. Burke,et al.  Rationale for mixing exact exchange with density functional approximations , 1996 .

[29]  Nongnuch Artrith,et al.  An implementation of artificial neural-network potentials for atomistic materials simulations: Performance for TiO2 , 2016 .

[30]  M. Seyed Salehi,et al.  Reconstruction of deformed microstructure using cellular automata method , 2018, Computational Materials Science.

[31]  Jackson,et al.  Atoms, molecules, solids, and surfaces: Applications of the generalized gradient approximation for exchange and correlation. , 1992, Physical review. B, Condensed matter.

[32]  Dongkyu Kim,et al.  Smallest neural network to learn the Ising criticality. , 2018, Physical review. E.

[33]  R. Kondor,et al.  On representing chemical environments , 2012, 1209.3140.

[34]  Parr,et al.  Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density. , 1988, Physical review. B, Condensed matter.

[35]  B. A. Lindquist,et al.  Unsupervised machine learning for detection of phase transitions in off-lattice systems. I. Foundations. , 2018, The Journal of chemical physics.

[36]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[37]  Alán Aspuru-Guzik,et al.  Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules , 2016, ACS central science.

[38]  S Jesse,et al.  Disorder identification in hysteresis data: recognition analysis of the random-bond-random-field Ising model. , 2009, Physical review letters.

[39]  E. Prodan.  Nearsightedness of Electronic Matter in One Dimension , 2006 .

[40]  P. Vahle,et al.  A convolutional neural network neutrino event classifier , 2016, ArXiv.

[41]  Alexandre Tkatchenko,et al.  Non-covalent interactions across organic and biological subsets of chemical space: Physics-based potentials parametrized from machine learning. , 2017, The Journal of chemical physics.

[42]  Yong-Sheng Zhang,et al.  Solving frustrated quantum many-particle models with convolutional neural networks , 2018, Physical Review B.

[43]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[44]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[45]  M. Scheffler,et al.  Insightful classification of crystal structures using deep learning , 2017, Nature Communications.

[46]  D. A. Wickremasinghe,et al.  Convolutional neural networks applied to neutrino events in a liquid argon time projection chamber , 2016, 1611.05531.

[47]  J. Fox,et al.  Combining discovery and targeted proteomics reveals a prognostic signature in oral cancer , 2018, Nature Communications.

[48]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[49]  Isaac Tamblyn,et al.  Deep neural networks for direct, featureless learning through observation: The case of two-dimensional spin models. , 2017, Physical review. E.

[50]  Alán Aspuru-Guzik,et al.  Neural Networks for the Prediction of Organic Chemistry Reactions , 2016, ACS central science.

[51]  Sergei V. Kalinin,et al.  Big Data Analytics for Scanning Transmission Electron Microscopy Ptychography , 2016, Scientific Reports.

[52]  David W Toth,et al.  The TensorMol-0.1 model chemistry: a neural network augmented with long-range physics , 2017, Chemical science.

[53]  Manh Cuong Nguyen,et al.  On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets , 2014, Scientific Reports.