FEREBUS: Highly parallelized engine for kriging training

FFLUX is a novel force field based on quantum topological atoms, combining multipolar electrostatics with IQA intraatomic and interatomic energy terms. The program FEREBUS calculates the hyperparameters of models produced by the machine learning method kriging. Calculation of kriging hyperparameters (θ and p) requires the optimization of the concentrated log‐likelihood L̂(θ,p) . FEREBUS uses Particle Swarm Optimization (PSO) and Differential Evolution (DE) algorithms to find the maximum of L̂(θ,p) . PSO and DE are two heuristic algorithms that each use a set of particles or vectors to explore the space in which L̂(θ,p) is defined, searching for the maximum. The log‐likelihood is a computationally expensive function, which needs to be calculated several times during each optimization iteration. The cost scales quickly with the problem dimension and speed becomes critical in model generation. We present the strategy used to parallelize FEREBUS, and the optimization of L̂(θ,p) through PSO and DE. The code is parallelized in two ways. MPI parallelization distributes the particles or vectors among the different processes, whereas the OpenMP implementation takes care of the calculation of L̂(θ,p) , which involves the calculation and inversion of a particular matrix, whose size increases quickly with the dimension of the problem. The run time shows a speed‐up of 61 times going from single core to 90 cores with a saving, in one case, of ∼98% of the single core time. In fact, the parallelization scheme presented reduces computational time from 2871 s for a single core calculation, to 41 s for 90 cores calculation. © 2016 The Authors. Journal of Computational Chemistry Published by Wiley Periodicals, Inc.

[1]  C. Ji,et al.  Protein polarization is critical to stabilizing AF-2 and helix-2' domains in ligand binding to PPAR-gamma. , 2008, Journal of the American Chemical Society.

[2]  Benjamin Stamm,et al.  Scalable evaluation of polarization energy and associated forces in polarizable molecular dynamics: II. Toward massively parallel computations using smooth particle mesh Ewald. , 2015, Journal of chemical theory and computation.

[3]  Dmitrii E. Makarov,et al.  FITTING POTENTIAL-ENERGY SURFACES : A SEARCH IN THE FUNCTION SPACE BY DIRECTED GENETIC PROGRAMMING , 1998 .

[4]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[5]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[6]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[7]  Ye Mei,et al.  Developing polarized protein-specific charges for protein dynamics: MD free energy calculation of pKa shifts for Asp26/Asp20 in thioredoxin. , 2008, Biophysical journal.

[8]  G. Matheron Principles of geostatistics , 1963 .

[9]  Satish T. S. Bukkapatnam,et al.  Parametrization of interatomic potential functions using a genetic algorithm accelerated with a neural network , 2006 .

[10]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[11]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[12]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[13]  Nicodemo Di Pasquale,et al.  Optimization Algorithms in Optimal Predictions of Atomistic Properties by Kriging. , 2016, Journal of chemical theory and computation.

[14]  Ruppa K. Thulasiram,et al.  A parallel Particle swarm optimization algorithm for option pricing , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[15]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[18]  Ye Mei,et al.  Communications: Electron polarization critically stabilizes the Mg2+ complex in the catalytic core domain of HIV-1 integrase. , 2010, The Journal of chemical physics.

[19]  John Z H Zhang,et al.  Electronic polarization is important in stabilizing the native structures of proteins. , 2009, The journal of physical chemistry. B.

[20]  Jörg Behler,et al.  A neural network potential-energy surface for the water dimer based on environment-dependent atomic energies and charges. , 2012, The Journal of chemical physics.

[21]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[22]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[23]  J. Behler Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations. , 2011, Physical chemistry chemical physics : PCCP.

[24]  Frederick R. Manby,et al.  Machine-learning approach for one- and two-body corrections to density functional theory: Applications to molecular and condensed water , 2013 .

[25]  A. Keane,et al.  The development of a hybridized particle swarm for kriging hyperparameter tuning , 2011 .

[26]  J. Andrew McCammon,et al.  Accelerated Molecular Dynamics Simulations with the AMOEBA Polarizable Force Field on Graphics Processing Units , 2013, Journal of chemical theory and computation.