Efficient and Accurate Simulations of Vibrational and Electronic Spectra with Symmetry-Preserving Neural Network Models for Tensorial Properties.

Machine learning has revolutionized the high-dimensional representations for molecular properties such as potential energy. However, there are scarce machine learning models targeting tensorial properties, which are rotationally covariant. Here, we propose tensorial neural network (NN) models to learn both tensorial response and transition properties in which atomic coordinate vectors are multiplied with scalar NN outputs or their derivatives to preserve the rotationally covariant symmetry. This strategy keeps structural descriptors symmetry invariant so that the resulting tensorial NN models are as efficient as their scalar counterparts. We validate the performance and universality of this approach by learning response properties of water oligomers and liquid water and transition dipole moment of a model structural unit of proteins. Machine-learned tensorial models have enabled efficient simulations of vibrational spectra of liquid water and ultraviolet spectra of realistic proteins, promising feasible and accurate spectroscopic simulations for biomolecules and materials.

[1]  M. Kasha,et al.  The exciton model in molecular spectroscopy , 1965 .

[2]  A. Stone Transformation between cartesian and spherical tensors , 1975 .

[3]  H. C. Andersen Molecular dynamics simulations at constant pressure and/or temperature , 1980 .

[4]  M. Baskes,et al.  Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals , 1984 .

[5]  T. N. Bhat,et al.  The Protein Data Bank , 2000, Nucleic Acids Res..

[6]  Joel M Bowman,et al.  Ab initio potential energy and dipole moment surfaces for H5O2 +. , 2005, The Journal of chemical physics.

[7]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[8]  S. Mukamel,et al.  Extracting single and two-exciton couplings in photosynthetic complexes by coherent two-dimensional electronic spectra. , 2009, Chemical physics.

[9]  Paul L A Popelier,et al.  Beyond Point Charges: Dynamic Polarization from Neural Net Predicted Multipole Moments. , 2008, Journal of chemical theory and computation.

[10]  Joel M. Bowman,et al.  Permutationally invariant potential energy surfaces in high dimensionality , 2009 .

[11]  Benjamin M. Bulheller,et al.  Simulation study of chiral two-dimensional ultraviolet spectroscopy of the protein backbone. , 2010, Journal of the American Chemical Society.

[12]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[13]  M. Zanni,et al.  Development and validation of transferable amide I vibrational frequency maps for peptides. , 2011, The journal of physical chemistry. B.

[14]  J. Behler Atom-centered symmetry functions for constructing high-dimensional neural network potentials. , 2011, The Journal of chemical physics.

[15]  Joel M. Bowman,et al.  Flexible, ab initio potential, and dipole moment surfaces for water. I. Tests and applications for clusters up to the 22-mer. , 2011, The Journal of chemical physics.

[16]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[17]  Barbara Kirchner,et al.  Computing vibrational spectra from ab initio molecular dynamics. , 2013, Physical chemistry chemical physics : PCCP.

[18]  Hua Guo,et al.  Permutation invariant polynomial neural network approach to fitting potential energy surfaces. , 2013, The Journal of chemical physics.

[19]  R. Kondor,et al.  On representing chemical environments , 2012, 1209.3140.

[20]  O. A. von Lilienfeld,et al.  Transferable Atomic Multipole Machine Learning Models for Small Organic Molecules. , 2015, Journal of chemical theory and computation.

[21]  Francesco Paesani,et al.  Infrared and Raman Spectroscopy of Liquid Water through "First-Principles" Many-Body Molecular Dynamics. , 2015, Journal of chemical theory and computation.

[22]  Jun Chen,et al.  Communication: Fitting potential energy surfaces with fundamental invariant neural network. , 2016, The Journal of chemical physics.

[23]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[24]  Michael Gastegger,et al.  Machine learning molecular dynamics for the simulation of infrared spectra† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c7sc02267k , 2017, Chemical science.

[25]  Atsuto Seko,et al.  Conceptual and practical bases for the high accuracy of machine learning interatomic potential , 2017, 1708.02741.

[26]  M. Ceriotti,et al.  Solvent fluctuations and nuclear quantum effects modulate the molecular hyperpolarizability of water , 2017, 1705.01649.

[27]  E Weinan,et al.  Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics , 2017, Physical review letters.

[28]  Andrea Grisafi,et al.  Symmetry-Adapted Machine Learning for Tensorial Properties of Atomistic Systems. , 2017, Physical review letters.

[29]  R. A. Vargas-Hernández,et al.  Assessing Gaussian Process Regression and Permutationally Invariant Polynomial Approaches To Represent High-Dimensional Potential Energy Surfaces. , 2018, Journal of chemical theory and computation.

[30]  J. Bowman,et al.  Permutationally Invariant Potential Energy Surfaces. , 2018, Annual review of physical chemistry.

[31]  Daniel W. Davies,et al.  Machine learning for molecular and materials science , 2018, Nature.

[32]  Kipton Barros,et al.  Discovering a Transferable Charge Assignment Model Using Machine Learning. , 2018, The journal of physical chemistry letters.

[33]  Jörg Meyer,et al.  Testing Electronic Friction Models: Vibrational De-excitation in Scattering of H2 and D2 from Cu(111) , 2018, The journal of physical chemistry letters.

[34]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[35]  R. Maurer,et al.  Symmetry-Adapted High Dimensional Neural Network Representation of Electronic Friction Tensor of Adsorbates on Metals , 2019, The Journal of Physical Chemistry C.

[36]  Markus Meuwly,et al.  PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments, and Partial Charges. , 2019, Journal of chemical theory and computation.

[37]  Edgar A. Engel,et al.  Ab initio thermodynamics of liquid and solid water , 2018, Proceedings of the National Academy of Sciences.

[38]  Anders S. Christensen,et al.  Operators in quantum machine learning: Response properties in chemical space. , 2018, The Journal of chemical physics.

[39]  R. Maurer,et al.  Hot-electron effects during reactive scattering of H2 from Ag(111): the interplay between mode-specific electronic friction and the potential energy landscape , 2018, Chemical science.

[40]  Julia Westermayr,et al.  Machine learning enables long time scale molecular photodynamics simulations , 2018, Chemical science.

[41]  Yang Yang,et al.  Accurate molecular polarizabilities with coupled cluster theory and machine learning , 2018, Proceedings of the National Academy of Sciences.

[42]  D. Yarkony,et al.  Extending the Representation of Multistate Coupled Potential Energy Surfaces to Include Properties Operators Using Neural Networks: Application to the 1,21A States of Ammonia. , 2019, Journal of chemical theory and computation.

[43]  J. Bowman,et al.  Full and fragmented permutationally invariant polynomial potential energy surfaces for trans and cis N-methyl acetamide and isomerization saddle points. , 2019, The Journal of chemical physics.

[44]  Hot electron effects during reactive scattering of H2 from Ag(111): assessing the sensitivity to initial conditions, coupling magnitude, and electronic temperature. , 2019, Faraday discussions.

[45]  Bin Jiang,et al.  Embedded Atom Neural Network Potentials: Efficient and Accurate Machine Learning with a Physically Inspired Representation. , 2019, The journal of physical chemistry letters.

[46]  Michele Ceriotti,et al.  Atom-density representations for machine learning. , 2018, The Journal of chemical physics.

[47]  Guozhen Zhang,et al.  A neural network protocol for electronic excitations of N-methylacetamide , 2019, Proceedings of the National Academy of Sciences.

[48]  Hua Guo,et al.  High-Fidelity Potential Energy Surfaces for Gas Phase and Gas-Surface Scattering Processes from Machine Learning. , 2020, The journal of physical chemistry letters.

[49]  Weinan E,et al.  Deep neural network for the dielectric response of insulators , 2020 .

[50]  R. Car,et al.  Raman spectrum and polarizability of liquid water from deep neural networks. , 2020, Physical chemistry chemical physics : PCCP.

[51]  Julia Westermayr,et al.  Combining SchNet and SHARC: The SchNarc Machine Learning Approach for Excited-State Dynamics , 2020, The journal of physical chemistry letters.

[52]  J. Behler,et al.  A Performance and Cost Assessment of Machine Learning Interatomic Potentials. , 2019, The journal of physical chemistry. A.