Efficient and Atomic-Resolution Uncertainty Estimation for Neural Network Potentials Using Replica Ensemble.

Neural network potentials (NNPs) are gaining much attention as they enable fast molecular dynamics (MD) simulations for a wide range of systems while maintaining accuracy of density functional theory calculations. Since NNP is constructed by machine learning on training data, its prediction uncertainty increases drastically as atomic environments deviate from training points. Therefore, it is essential to monitor the uncertainty level during MD simulations to judge soundness of the results. In this work, we propose an uncertainty estimator based on the replica ensemble in which NNPs are trained over atomic energies of a reference NNP that drives MD simulations. The replica ensemble is trained quickly and its standard deviation provides atomic-resolution uncertainties. We apply this method to a highly-reactive silicidation process of Si(001) overlaid with Ni thin films and confirm that the replica ensemble can spatially and temporally trace simulation errors at the atomic resolution, which in turn guides on augmenting the training set. The refined NNP completes a 3.6-ns simulation without any noticeable problems. By suggesting an efficient and atomic-resolution uncertainty indicator, this work will contribute to achieving reliable MD simulations by NNPs.

[1]  Geng Sun,et al.  Metastable Structures in Cluster Catalysis from First-Principles: Structural Ensemble in Reaction Conditions and Metastability Triggered Reactivity. , 2018, Journal of the American Chemical Society.

[2]  Christophe Detavernier,et al.  Towards implementation of a nickel silicide process for CMOS technologies , 2003 .

[3]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[4]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[5]  Nathan S. Lewis,et al.  Machine-Learning Methods Enable Exhaustive Searches for Active Bimetallic Facets and Reveal Active Site Motifs for CO2 Reduction , 2017 .

[6]  Adrian E. Roitberg,et al.  Less is more: sampling chemical space with active learning , 2018, The Journal of chemical physics.

[7]  Antonio Díaz Pozuelo High-dimensional neural network potentials , 2016 .

[8]  John Foggiato,et al.  Optimizing the formation of nickel silicide , 2004 .

[9]  Kyeongjae Cho,et al.  Ab initio study of Schottky barriers at metal-nanotube contacts , 2004 .

[10]  Michael Gastegger,et al.  Machine learning molecular dynamics for the simulation of infrared spectra† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c7sc02267k , 2017, Chemical science.

[11]  Adalberto Fazzio,et al.  Ab Initio Simulations and Materials Chemistry in the Age of Big Data , 2020, J. Chem. Inf. Model..

[12]  Jonathan Vandermause,et al.  On-the-fly active learning of interpretable Bayesian force fields for atomistic rare events , 2020, npj Computational Materials.

[13]  Dongheon Lee,et al.  Toward Reliable and Transferable Machine Learning Potentials: Uniform Training by Overcoming Sampling Bias , 2018, The Journal of Physical Chemistry C.

[14]  Rampi Ramprasad,et al.  A universal strategy for the creation of machine learning-based atomistic force fields , 2017, npj Computational Materials.

[15]  Steve Plimpton,et al.  Fast parallel algorithms for short-range molecular dynamics , 1993 .

[16]  Seungwu Han,et al.  Hybrid functional study on structural and electronic properties of oxides , 2011 .

[17]  Burke,et al.  Generalized Gradient Approximation Made Simple. , 1996, Physical review letters.

[18]  A. Stukowski Visualization and analysis of atomistic simulation data with OVITO–the Open Visualization Tool , 2009 .

[19]  M.C. Ozturk,et al.  Tuning of the Nickel Silicide Schottky Barrier Height on p-Type Silicon by Indium Implantation , 2009, IEEE Electron Device Letters.

[20]  Dongsun Yoo,et al.  Crystallization of amorphous GeTe simulated by neural network potential addressing medium-range order , 2020 .

[21]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[22]  Jorg Behler,et al.  Automated Fitting of Neural Network Potentials at Coupled Cluster Accuracy: Protonated Water Clusters as Testing Ground , 2019, Journal of chemical theory and computation.

[23]  Seungwu Han,et al.  SIMPLE-NN: An efficient package for training and executing neural-network interatomic potentials , 2019, Comput. Phys. Commun..

[24]  E. Wimmer,et al.  Formation of nickel-platinum silicides on a silicon substrate: Structure, phase stability, and diffusion from ab initio computations , 2013 .

[25]  Hafner,et al.  Ab initio molecular dynamics for liquid metals. , 1995, Physical review. B, Condensed matter.

[26]  J. Behler Atom-centered symmetry functions for constructing high-dimensional neural network potentials. , 2011, The Journal of chemical physics.

[27]  Alireza Khorshidi,et al.  Addressing uncertainty in atomistic machine learning. , 2017, Physical chemistry chemical physics : PCCP.

[28]  Andrew J. Kellock,et al.  Morphological stability and specific resistivity of sub-10 nm silicide films of Ni1−xPtx on Si substrate , 2010 .

[29]  S. Nosé A unified formulation of the constant temperature molecular dynamics methods , 1984 .

[30]  Seungwu Han,et al.  Atomic energy mapping of neural network potential , 2019, Physical Review Materials.

[31]  Wenwen Li,et al.  Dependence of a cooling rate on structural and vibrational properties of amorphous silicon: A neural network potential-based molecular dynamics study. , 2019, The Journal of chemical physics.

[32]  Blöchl,et al.  Projector augmented-wave method. , 1994, Physical review. B, Condensed matter.

[33]  Jörg Behler,et al.  Proton-Transfer Mechanisms at the Water-ZnO Interface: The Role of Presolvation. , 2017, The journal of physical chemistry letters.

[34]  André Vantomme,et al.  Controlling the formation and stability of ultra-thin nickel silicides - An alloying strategy for preventing agglomeration , 2018 .

[35]  D. J. Coe,et al.  Silicide formation in Ni-Si Schottky barrier diodes , 1976 .

[36]  J Behler,et al.  Representing potential energy surfaces by high-dimensional neural network potentials , 2014, Journal of physics. Condensed matter : an Institute of Physics journal.

[37]  Weitao Yang,et al.  Molecular Dynamics Simulations with Quantum Mechanics/Molecular Mechanics and Adaptive Neural Networks. , 2018, Journal of chemical theory and computation.