Local Bayesian optimizer for atomic structures

A local optimization method based on Bayesian Gaussian Processes is developed and applied to atomic structures. The method is applied to a variety of systems including molecules, clusters, bulk materials, and molecules at surfaces. The approach is seen to compare favorably to standard optimization algorithms like conjugate gradient or BFGS in all cases. The method relies on prediction of surrogate potential energy surfaces, which are fast to optimize, and which are gradually improved as the calculation proceeds. The method includes a few hyperparameters, the optimization of which may lead to further improvements of the computational speed.

[1]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[2]  N. A. Romero,et al.  Electronic structure calculations with GPAW: a real-space implementation of the projector augmented-wave method , 2010, Journal of physics. Condensed matter : an Institute of Physics journal.

[3]  Jacobsen,et al.  Interatomic interactions in the effective-medium theory. , 1987, Physical review. B, Condensed matter.

[4]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[5]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[6]  Aldo Glielmo,et al.  Efficient nonparametric n -body force fields from machine learning , 2018, 1801.04823.

[7]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[8]  Jukka Corander,et al.  Bayesian inference of atomistic structure in functional materials , 2017, npj Computational Materials.

[9]  Aki Vehtari,et al.  Nudged elastic band calculations accelerated with Gaussian process regression. , 2017, The Journal of chemical physics.

[10]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[11]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[12]  Karsten W Jacobsen,et al.  Exploration versus Exploitation in Global Atomistic Structure Optimization. , 2018, The journal of physical chemistry. A.

[13]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[14]  Thomas G. Dietterich,et al.  In Advances in Neural Information Processing Systems 12 , 1991, NIPS 1991.

[15]  Christoph Ortner,et al.  Preconditioners for the geometry optimisation and saddle point search of molecular systems , 2018, Scientific Reports.

[16]  D. Lizotte.  Practical bayesian optimization , 2008 .

[17]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[18]  Gus L. W. Hart,et al.  Accelerating high-throughput searches for new alloys with active learning of interatomic potentials , 2018, Computational Materials Science.

[19]  Noam Bernstein,et al.  Machine learning unifies the modeling of materials and molecules , 2017, Science Advances.

[20]  M C Payne,et al.  "Learn on the fly": a hybrid classical and quantum-mechanical molecular dynamics simulation. , 2004, Physical review letters.

[21]  Bo Qi,et al.  Using multiscale preconditioning to accelerate the convergence of iterative molecular calculations. , 2014, The Journal of chemical physics.

[22]  Michael Walter,et al.  The atomic simulation environment-a Python library for working with atoms. , 2017, Journal of physics. Condensed matter : an Institute of Physics journal.

[23]  Chem. , 2020, Catalysis from A to Z.

[24]  Yaliang Li,et al.  SCI , 2021, Proceedings of the 30th ACM International Conference on Information & Knowledge Management.

[25]  Takashi Miyake,et al.  Crystal structure prediction accelerated by Bayesian optimization , 2018 .

[26]  Thomas Bligaard,et al.  Low-Scaling Algorithm for Nudged Elastic Band Calculations Using a Surrogate Machine Learning Model. , 2018, Physical review letters.

[27]  Karsten Wedel Jacobsen,et al.  A semi-empirical effective medium theory for metals and alloys , 1996 .

[28]  Pekka Koskinen,et al.  Structural relaxation made simple. , 2006, Physical review letters.

[29]  B. Hammer,et al.  On-the-Fly Machine Learning of Atomic Potential in Density Functional Theory Structure Optimization. , 2018, Physical review letters.

[30]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[31]  Alireza Khorshidi,et al.  Amp: A modular approach to machine learning in atomistic simulations , 2016, Comput. Phys. Commun..

[32]  Aki Vehtari,et al.  Nudged elastic band calculations accelerated with Gaussian process regression based on inverse inter-atomic distances. , 2019, Journal of chemical theory and computation.

[33]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[34]  Ove Christiansen,et al.  Gaussian process regression to accelerate geometry optimizations relying on numerical differentiation. , 2018, The Journal of chemical physics.

[35]  Alexander Denzel,et al.  Gaussian Process Regression for Geometry Optimization , 2018, 2009.05803.

[36]  Samuel A. Assefa,et al.  SURF: improving classifiers in production by learning from busy and noisy end users , 2020, ICAIF.

[37]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[38]  Alexander V. Shapeev,et al.  Active learning of linearly parametrized interatomic potentials , 2016, 1611.09346.