Steerable Wavelet Scattering for 3D Atomic Systems with Application to Li-Si Energy Prediction

A general machine learning architecture is introduced that uses wavelet scattering coefficients of an inputted three dimensional signal as features. Solid harmonic wavelet scattering transforms of three dimensional signals were previously introduced in a machine learning framework for the regression of properties of small organic molecules. Here this approach is extended for general steerable wavelets which are equivariant to translations and rotations, resulting in a sparse model of the target function. The scattering coefficients inherit from the wavelets invariance to translations and rotations. As an illustration of this approach a linear regression model is learned for the formation energy of amorphous lithium-silicon material states trained over a database generated using plane-wave Density Functional Theory methods. State-of-the-art results are produced as compared to other machine learning approaches over similarly generated databases.

[1]  Ekin D. Cubuk,et al.  Implanted neural network potentials: Application to Li-Si alloys , 2018 .

[2]  Max Welling,et al.  Steerable CNNs , 2016, ICLR.

[3]  Yue Qi,et al.  Atomistic Simulation Derived Insight on the Irreversible Structural Changes of Si Electrode during Fast and Slow Delithiation. , 2017, Nano letters.

[4]  Yue Qi,et al.  Vacancies in Si Can Improve the Concentration-Dependent Lithiation Rate: Molecular Dynamics Studies of Lithiation Dynamics of Si Electrodes , 2015 .

[5]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[6]  C. D. Lin,et al.  Molecular integrals over spherical Gaussian-type orbitals: I , 1997 .

[7]  J S Smith,et al.  ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost , 2016, Chemical science.

[8]  Risi Kondor,et al.  On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups , 2018, ICML.

[9]  Gerbrand Ceder,et al.  Constructing first-principles phase diagrams of amorphous LixSi using machine-learning-assisted sampling with an evolutionary algorithm. , 2018, The Journal of chemical physics.

[10]  S. Mallat,et al.  Intermittent process analysis with scattering moments , 2013, 1311.4104.

[11]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[12]  Gábor Csányi,et al.  Comparing molecules and solids across structural and alchemical space. , 2015, Physical chemistry chemical physics : PCCP.

[13]  Stéphane Mallat,et al.  Rotation, Scaling and Deformation Invariant Scattering for Texture Discrimination , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Stéphane Mallat,et al.  Solid Harmonic Wavelet Scattering: Predicting Quantum Molecular Energy from Invariant Descriptors of 3D Electronic Densities , 2017, NIPS.

[15]  Alán Aspuru-Guzik,et al.  Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules , 2016, ACS central science.

[16]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Risi Kondor,et al.  Covariant Compositional Networks For Learning Graphs , 2018, ICLR.

[18]  E. Cancès,et al.  Computational quantum chemistry: A primer , 2003 .

[19]  Atsuto Seko,et al.  Descriptors for Machine Learning of Materials Data , 2017, 1709.01666.

[20]  M. Rupp,et al.  Machine learning of molecular electronic properties in chemical compound space , 2013, 1305.7074.

[21]  Paul L A Popelier,et al.  Prediction of Intramolecular Polarization of Aromatic Amino Acids Using Kriging Machine Learning. , 2014, Journal of chemical theory and computation.

[22]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[23]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[24]  Klaus-Robert Müller,et al.  Machine learning of accurate energy-conserving molecular force fields , 2016, Science Advances.

[25]  J. Behler.  Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[26]  K. Müller,et al.  Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space , 2015, The journal of physical chemistry letters.

[27]  Max Welling,et al.  Group Equivariant Convolutional Networks , 2016, ICML.

[28]  Stéphane Mallat,et al.  Wavelet Scattering Regression of Quantum Chemical Energies , 2016, Multiscale Model. Simul..

[29]  Zhenwei Li,et al.  Molecular dynamics with on-the-fly machine learning of quantum-mechanical forces. , 2015, Physical review letters.

[30]  Shawn T. Brown,et al.  Advances in methods and algorithms in a modern quantum chemistry program package. , 2006, Physical chemistry chemical physics : PCCP.

[31]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[32]  Stéphane Mallat,et al.  Solid Harmonic Wavelet Scattering for Predictions of Molecule Properties , 2018, The Journal of chemical physics.

[33]  Stéphane Mallat,et al.  Group Invariant Scattering , 2011, ArXiv.

[34]  Klaus-Robert Müller,et al.  SchNet: A continuous-filter convolutional neural network for modeling quantum interactions , 2017, NIPS.