Machine learning for parameter auto-tuning in molecular dynamics simulations: Efficient dynamics of ions near polarizable nanoparticles

Simulating the dynamics of ions near polarizable nanoparticles (NPs) using coarse-grained models is extremely challenging due to the need to solve the Poisson equation at every simulation timestep. Recently, a molecular dynamics (MD) method based on a dynamical optimization framework bypassed this obstacle by representing the polarization charge density as virtual dynamic variables and evolving them in parallel with the physical dynamics of ions. We highlight the computational gains accessible with the integration of machine learning (ML) methods for parameter prediction in MD simulations by demonstrating how they were realized in MD simulations of ions near polarizable NPs. An artificial neural network–based regression model was integrated with MD simulation and predicted the optimal simulation timestep and optimization parameters characterizing the virtual system with 94.3% success. The ML-enabled auto-tuning of parameters generated accurate dynamics of ions for ≈ 10 million steps while improving the stability of the simulation by over an order of magnitude. The integration of ML-enhanced framework with hybrid Open Multi-Processing / Message Passing Interface (OpenMP/MPI) parallelization techniques reduced the computational time of simulating systems with thousands of ions and induced charges from thousands of hours to tens of hours, yielding a maximum speedup of ≈ 3 from ML-only acceleration and a maximum speedup of ≈ 600 from the combination of ML and parallel computing methods. Extraction of ionic structure in concentrated electrolytes near oil–water emulsions demonstrates the success of the method. The approach can be generalized to select optimal parameters in other MD applications and energy minimization problems.

[1]  Rampi Ramprasad,et al.  Adaptive machine learning framework to accelerate ab initio molecular dynamics , 2015 .

[2]  Jörg Rottler,et al.  Local molecular dynamics with coulombic interactions. , 2004, Physical review letters.

[3]  Thomas E Markland,et al.  Multiple time step integrators in ab initio molecular dynamics. , 2014, The Journal of chemical physics.

[4]  Misha Denil,et al.  Predicting Parameters in Deep Learning , 2014 .

[5]  Juan J de Pablo,et al.  Adaptive enhanced sampling by force-biasing using neural networks. , 2018, The Journal of chemical physics.

[6]  Gilles Louppe,et al.  Independent consultant , 2013 .

[7]  C. Sagui,et al.  Multigrid methods for classical molecular dynamics simulations of biomolecules , 2001 .

[8]  P. Attard Variational formulation for the electrostatic potential in dielectric continua , 2003 .

[9]  Logan T. Ward,et al.  A machine learning approach for engineering bulk metallic glass alloys , 2018, Acta Materialia.

[10]  Dick H. J. Epema,et al.  Towards Machine Learning-Based Auto-tuning of MapReduce , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[11]  Car,et al.  Unified approach for molecular dynamics and density-functional theory. , 1985, Physical review letters.

[12]  James Theiler,et al.  Adaptive Strategies for Materials Design using Uncertainties , 2016, Scientific Reports.

[13]  M. Marchi,et al.  A dielectric continuum molecular dynamics method , 2001 .

[14]  Shantenu Jha,et al.  Adaptive ensemble simulations of biomolecules. , 2018, Current opinion in structural biology.

[15]  Clayton J. Radke,et al.  Variational approach to the electrostatic free energy in charged colloidal suspensions: general theory for open systems , 1990 .

[16]  R. van Roij,et al.  Spontaneous charging and crystallization of water droplets in oil. , 2008, The Journal of chemical physics.

[17]  M. Olvera de la Cruz,et al.  Precipitation of DNA by polyamines: a polyelectrolyte behavior. , 1998, Biophysical journal.

[18]  Andrew W. Long,et al.  Machine learning assembly landscapes from particle tracking data. , 2015, Soft matter.

[19]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Vikram Jadhao,et al.  Computational studies of shape control of charged deformable nanocontainers. , 2019, Journal of materials chemistry. B.

[21]  D. Clapham,et al.  Calcium signaling , 1995, Cell.

[22]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[23]  R. Melko,et al.  Machine Learning Phases of Strongly Correlated Fermions , 2016, Physical Review X.

[24]  Zhenli Xu,et al.  Multiple-image treatment of induced charges in Monte Carlo simulations of electrolytes near a spherical dielectric interface. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Y. Levin,et al.  Effects of the dielectric discontinuity on the counterion distribution in a colloidal suspension. , 2011, The Journal of chemical physics.

[26]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[27]  L. Lue,et al.  The role of image charges in the interactions between colloidal particles. , 2008, Soft matter.

[28]  Christian Holm,et al.  How to mesh up Ewald sums. I. A theoretical and numerical comparison of various particle mesh routines , 1998 .

[29]  Geoffrey C. Fox,et al.  Machine Learning for Auto-tuning of Simulation Parameters in Car-Parrinello Molecular Dynamics , 2019 .

[30]  Giovanni Scalmani,et al.  A variational formulation of the polarizable continuum model. , 2010, The Journal of chemical physics.

[31]  Gerhard Klimeck,et al.  nanoHUB.org: Advancing Education and Research in Nanotechnology , 2008, Computing in Science & Engineering.

[32]  Jie Yu,et al.  Short-term wind speed prediction using an unscented Kalman filter based state-space support vector regression approach , 2014 .

[33]  Mark E. Tuckerman,et al.  Reversible multiple time scale molecular dynamics , 1992 .

[34]  Prasanna Balaprakash,et al.  Autotuning in High-Performance Computing Applications , 2018, Proceedings of the IEEE.

[35]  Jack J. Dongarra,et al.  Automatically Tuned Linear Algebra Software , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[36]  Kaihsu Tai,et al.  Not ions alone: barriers to ion permeation in nanopores and channels. , 2004, Journal of the American Chemical Society.

[37]  Rajiv K. Kalia,et al.  Massively parallel algorithms for computational nanoelectronics based on quantum molecular dynamics , 1994 .

[38]  Y. Levin Strange electrostatics in physics, chemistry, and biology , 2005 .

[39]  Image charges in spherical geometry: Application to colloidal systems , 2002, cond-mat/0204550.

[40]  Vikram Jadhao,et al.  A variational formulation of electrostatics in a medium with spatially varying dielectric permittivity. , 2013, The Journal of chemical physics.

[41]  Geoffrey C. Fox,et al.  Machine Learning for Performance Enhancement of Molecular Dynamics Simulations , 2019, ICCS.

[42]  S. Puthusserypady,et al.  Multilayer perceptrons for the classification of brain computer interface data , 2005, Proceedings of the IEEE 31st Annual Northeast Bioengineering Conference, 2005..

[43]  Kyle Chard,et al.  Matminer: An open source toolkit for materials data mining , 2018, Computational Materials Science.

[44]  Parrinello,et al.  Adiabaticity in first-principles molecular dynamics. , 1992, Physical review. B, Condensed matter.

[45]  Roger G. Melko,et al.  Deep Learning the Ising Model Near Criticality , 2017, J. Mach. Learn. Res..

[46]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[47]  Alok Choudhary,et al.  A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials , 2016 .

[48]  Rudolph A. Marcus,et al.  On the Theory of Oxidation‐Reduction Reactions Involving Electron Transfer. I , 1956 .

[49]  R. van Roij,et al.  Liquid-liquid interfacial tension of electrolyte solutions. , 2008, Physical review letters.

[50]  Christian Holm,et al.  An iterative, fast, linear-scaling method for computing induced charges on arbitrary dielectric boundaries. , 2010, The Journal of chemical physics.

[51]  B. Honig,et al.  Classical electrostatics in biology and chemistry. , 1995, Science.

[52]  Zhenli Xu,et al.  Electrostatic interaction in the presence of dielectric interfaces and polarization-induced like-charge attraction. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Michiel Sprik,et al.  COMPUTER-SIMULATION OF THE DYNAMICS OF INDUCED POLARIZATION FLUCTUATIONS IN WATER , 1991 .

[55]  R. Fox,et al.  Classical Electrodynamics, 3rd ed. , 1999 .

[56]  Tin Wee Tan,et al.  Predicting host tropism of influenza A virus proteins using random forest , 2014, BMC Medical Genomics.

[57]  Héctor D. Abruña,et al.  Batteries and electrochemical capacitors , 2008 .

[58]  Georg Hager,et al.  Hybrid MPI/OpenMP Parallel Programming on Clusters of Multi-Core SMP Nodes , 2009, 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing.

[59]  Simone Melchionna,et al.  Electrostatic potential inside ionic solutions confined by dielectrics: a variational approach , 2001 .

[60]  Andrew L. Ferguson,et al.  Machine learning and data science in soft materials engineering , 2018, Journal of physics. Condensed matter : an Institute of Physics journal.

[61]  Martin Karplus,et al.  A Smooth Solvation Potential Based on the Conductor-Like Screening Model , 1999 .

[62]  Yang Qi,et al.  Self-learning Monte Carlo method , 2016, 1610.03137.

[63]  Kipton Barros,et al.  Comparison of efficient techniques for the simulation of dielectric objects in electrolytes , 2015, J. Comput. Phys..

[64]  S. Sacanna,et al.  Thermodynamically stable pickering emulsions. , 2007, Physical review letters.

[65]  Geoffrey C. Fox,et al.  Learning Everywhere: Pervasive Machine Learning for Effective High-Performance Computation , 2019, 2019 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

[66]  Samuel S. Schoenholz,et al.  Combining Machine Learning and Physics to Understand Glassy Systems , 2017, Journal of Physics: Conference Series.

[67]  Sharon C Glotzer,et al.  Machine learning for crystal identification and discovery , 2017, 1710.09861.

[68]  Kipton Barros,et al.  Dielectric effects in the self-assembly of binary colloidal aggregates. , 2014, Physical review letters.

[69]  Vikram Jadhao,et al.  Ionic structure in liquids confined by dielectric interfaces. , 2015, The Journal of chemical physics.

[70]  Kipton Barros,et al.  Efficient and accurate simulation of dynamic dielectric objects. , 2014, The Journal of chemical physics.

[71]  John D. Villasenor,et al.  Rigorous charge conservation for local electromagnetic field solvers , 1992 .

[72]  Dirk Gillespie,et al.  Computing induced charges in inhomogeneous dielectric media: application in a Monte Carlo simulation of complex ionic systems. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[73]  S. Chandel,et al.  Selection of most relevant input parameters using WEKA for artificial neural network based solar radiation prediction models , 2014 .

[74]  Juan J de Pablo,et al.  Image method for induced surface charge from many-body system of dielectric spheres. , 2016, The Journal of chemical physics.

[75]  A. Wynveen,et al.  Interactions of polarizable media in water: a molecular dynamics approach. , 2006, The Journal of chemical physics.

[76]  Zhenli Xu,et al.  Simulation of electric double layers around charged colloids in aqueous solution of variable permittivity. , 2013, The Journal of chemical physics.

[77]  P. Madden,et al.  Control of the adiabatic electronic state in ab initio molecular dynamics , 1993 .

[78]  R. Netz,et al.  Dielectric boundary effects on the interaction between planar charged surfaces with counterions only. , 2018, The Journal of chemical physics.

[79]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[80]  Noam Bernstein,et al.  Machine learning unifies the modeling of materials and molecules , 2017, Science Advances.

[81]  B. U. Felderhof Fluctuations of polarization and magnetization in dielectric and magnetic media , 1977 .