PiNN: A Python Library for Building Atomic Neural Networks of Molecules and Materials

Atomic neural networks (ANNs) constitute a class of machine learning methods for predicting potential energy surfaces and physico-chemical properties of molecules and materials. Despite many successes, developing interpretable ANN architectures and implementing existing ones efficiently are still challenging. This calls for reliable, general-purpose and open-source codes. Here, we present a python library named PiNN as a solution toward this goal. In PiNN, we designed a new interpretable and high-performing graph convolutional neural network variant, PiNet, as well as implemented the established Behler-Parrinello high-dimensional neural network. These implementations were tested using datasets of isolated small molecules, crystalline materials, liquid water and an aqueous alkaline electrolyte. PiNN comes with a visualizer called PiNNBoard to extract chemical insight ``learned'' by ANNs, provides analytical stress tensor calculations and interfaces to both the Atomic Simulation Environment and a development version of the Amsterdam Modeling Suite. Moreover, PiNN is highly modularized which makes it useful not only as a standalone package but also as a chain of tools to develop and to implement novel ANNs. The code is distributed under a permissive BSD license and is freely accessible at \href{https://github.com/Teoroo-CMC/PiNN/}{https://github.com/Teoroo-CMC/PiNN/} with full documentation and tutorials.

[1]  Tian Xie,et al.  Hierarchical Visualization of Materials Space with Graph Convolutional Neural Networks , 2018, The Journal of chemical physics.

[2]  Kristin A. Persson,et al.  Commentary: The Materials Project: A materials genome approach to accelerating materials innovation , 2013 .

[3]  Teter,et al.  Separable dual-space Gaussian pseudopotentials. , 1996, Physical review. B, Condensed matter.

[4]  M. Parrinello,et al.  Canonical sampling through velocity rescaling. , 2007, The Journal of chemical physics.

[5]  Parr,et al.  Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density. , 1988, Physical review. B, Condensed matter.

[6]  Joost VandeVondele,et al.  cp2k: atomistic simulations of condensed matter systems , 2014 .

[7]  Hilla Peretz,et al.  The , 1966 .

[8]  Mark E. Tuckerman,et al.  Explicit reversible integrators for extended systems dynamics , 1996 .

[9]  S. Grimme,et al.  A consistent and accurate ab initio parametrization of density functional dispersion correction (DFT-D) for the 94 elements H-Pu. , 2010, The Journal of chemical physics.

[10]  Chandler,et al.  Effect of environment on hydrogen bond dynamics in liquid water. , 1996, Physical review letters.

[11]  T. Morawietz,et al.  How van der Waals interactions determine the unique properties of water , 2016, Proceedings of the National Academy of Sciences.

[12]  Kipton Barros,et al.  Discovering a Transferable Charge Assignment Model Using Machine Learning. , 2018, The journal of physical chemistry letters.

[13]  Joost VandeVondele,et al.  Isobaric-isothermal molecular dynamics simulations utilizing density functional theory: an assessment of the structure and density of water at near-ambient conditions. , 2009, The journal of physical chemistry. B.

[14]  Jörg Behler,et al.  Nuclear Quantum Effects in Sodium Hydroxide Solutions from Neural Network Molecular Dynamics Simulations. , 2018, The journal of physical chemistry. B.

[15]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[16]  J. Behler First Principles Neural Network Potentials for Reactive Simulations of Large Molecular and Condensed Systems. , 2017, Angewandte Chemie.

[17]  A. Becke Density-functional thermochemistry. III. The role of exact exchange , 1993 .

[18]  M. Frisch,et al.  Ab Initio Calculation of Vibrational Absorption and Circular Dichroism Spectra Using Density Functional Force Fields , 1994 .

[19]  Jörg Behler,et al.  Constructing high‐dimensional neural network potentials: A tutorial review , 2015 .

[20]  Jörg Behler,et al.  Concentration-Dependent Proton Transfer Mechanisms in Aqueous NaOH Solutions: From Acceptor-Driven to Donor-Driven and Back. , 2016, The journal of physical chemistry letters.

[21]  Donald G Truhlar,et al.  Charge Model 5: An Extension of Hirshfeld Population Analysis for the Accurate Description of Molecular Interactions in Gaseous and Condensed Phases. , 2012, Journal of chemical theory and computation.

[22]  Jörg Behler,et al.  Structure of aqueous NaOH solutions: insights from neural-network-based molecular dynamics simulations. , 2016, Physical chemistry chemical physics : PCCP.

[23]  J. Nørskov,et al.  Improved adsorption energetics within density-functional theory using revised Perdew-Burke-Ernzerhof functionals , 1999 .

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  A. Becke,et al.  Density-functional exchange-energy approximation with correct asymptotic behavior. , 1988, Physical review. A, General physics.

[26]  Muratahan Aykol,et al.  The Open Quantum Materials Database (OQMD): assessing the accuracy of DFT formation energies , 2015 .

[27]  Thomas Olsen,et al.  Computational screening of perovskite metal oxides for optimal solar light capture , 2012 .

[28]  H. Berendsen,et al.  Molecular dynamics with coupling to an external bath , 1984 .