xTRAM: Estimating equilibrium expectations from time-correlated simulation data at multiple thermodynamic states

Computing the equilibrium properties of complex systems, such as free energy differences, is often hampered by rare events in the dynamics. Enhanced sampling methods may be used in order to speed up sampling by, for example, using high temperatures, as in parallel tempering, or simulating with a biasing potential such as in the case of umbrella sampling. The equilibrium properties of the thermodynamic state of interest (e.g., lowest temperature or unbiased potential) can be computed using reweighting estimators such as the weighted histogram analysis method or the multistate Bennett acceptance ratio (MBAR). weighted histogram analysis method and MBAR produce unbiased estimates, the simulation samples from the global equilibria at their respective thermodynamic state--a requirement that can be prohibitively expensive for some simulations such as a large parallel tempering ensemble of an explicitly solvated biomolecule. Here, we introduce the transition-based reweighting analysis method (TRAM)--a class of estimators that exploit ideas from Markov modeling and only require the simulation data to be in local equilibrium within subsets of the configuration space. We formulate the expanded TRAM (xTRAM) estimator that is shown to be asymptotically unbiased and a generalization of MBAR. Using four exemplary systems of varying complexity, we demonstrate the improved convergence (ranging from a twofold improvement to several orders of magnitude) of xTRAM in comparison to a direct counting estimator and MBAR, with respect to the invested simulation effort. Lastly, we introduce a random-swapping simulation protocol that can be used with xTRAM, gaining orders-of-magnitude advantages over simulation protocols that require the constraint of sampling from a global equilibrium.

[1]  G. Parisi,et al.  Simulated tempering: a new Monte Carlo scheme , 1992, hep-lat/9205018.

[2]  Dla Polski,et al.  EURO , 2004 .

[3]  John D. Chodera,et al.  Long-Time Protein Folding Dynamics from Short-Time Molecular Dynamics Simulations , 2006, Multiscale Model. Simul..

[4]  Y. Sugita,et al.  Replica-exchange molecular dynamics method for protein folding , 1999 .

[5]  Toni Giorgino,et al.  Identification of slow molecular order parameters for Markov model construction. , 2013, The Journal of chemical physics.

[6]  Antonio Coniglio,et al.  Spin and density overlaps in the frustrated Ising lattice gas. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  Roger G. Melko,et al.  Simulations of quantum XXZ models on two-dimensional frustrated lattices , 2006, cond-mat/0608038.

[8]  Benoît Roux,et al.  Extension to the weighted histogram analysis method: combining umbrella sampling with free energy calculations , 2001 .

[9]  Vijay S Pande,et al.  Progress and challenges in the automated construction of Markov state models for full protein systems. , 2009, The Journal of chemical physics.

[10]  Daniel J. Sindhikara,et al.  Exchange Often and Properly in Replica Exchange Molecular Dynamics. , 2010, Journal of chemical theory and computation.

[11]  Michael R. Shirts,et al.  Statistically optimal analysis of samples from multiple equilibrium states. , 2008, The Journal of chemical physics.

[12]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[13]  Anthony K. Felts,et al.  Temperature weighted histogram analysis method, replica exchange, and transition paths. , 2005, The journal of physical chemistry. B.

[14]  G. Burgio,et al.  Modified SO(3) lattice gauge theory at T ≠ 0 with parallel tempering : Monopole and vortex condensation , 2006, hep-lat/0610097.

[15]  Jeremy C. Smith,et al.  Hierarchical analysis of conformational dynamics in biomolecules: transition networks of metastable states. , 2007, The Journal of chemical physics.

[16]  Frank Noé,et al.  Optimal use of data in parallel tempering simulations for the construction of discrete-state Markov models of biomolecular dynamics. , 2011, The Journal of chemical physics.

[17]  Mark J Abraham,et al.  Ensuring Mixing Efficiency of Replica-Exchange Molecular Dynamics Simulations. , 2008, Journal of chemical theory and computation.

[18]  P. Bolhuis,et al.  Multiple state transition interface sampling of alanine dipeptide in explicit solvent. , 2011, The Journal of chemical physics.

[19]  Diwakar Shukla,et al.  OpenMM 4: A Reusable, Extensible, Hardware Independent Library for High Performance Molecular Simulation. , 2013, Journal of chemical theory and computation.

[20]  V. Pande,et al.  Error analysis and efficient sampling in Markovian state models for molecular dynamics. , 2005, The Journal of chemical physics.

[21]  Wolfhard Janke,et al.  Free-energy barriers in the Sherrington-Kirkpatrick model , 2006 .

[22]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[23]  I. Kevrekidis,et al.  Coarse master equation from Bayesian analysis of replica molecular dynamics simulations. , 2005, The journal of physical chemistry. B.

[24]  Gerhard Hummer,et al.  Error and efficiency of simulated tempering simulations. , 2010, The Journal of chemical physics.

[25]  Eric J. Sorin,et al.  Exploring the helix-coil transition via all-atom equilibrium ensemble simulations. , 2005, Biophysical journal.

[26]  G. Torrie,et al.  Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling , 1977 .

[27]  Carsten Kutzner,et al.  GROMACS 4:  Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation. , 2008, Journal of chemical theory and computation.

[28]  W. DeGrado,et al.  Temperature-dependent helix-coil transition of an alanine based peptide. , 2001, Journal of the American Chemical Society.

[29]  Oliver Beckstein,et al.  MDAnalysis: A toolkit for the analysis of molecular dynamics simulations , 2011, J. Comput. Chem..

[30]  R. Swendsen,et al.  THE weighted histogram analysis method for free‐energy calculations on biomolecules. I. The method , 1992 .

[31]  Sanghyun Park,et al.  Comparison of the serial and parallel algorithms of generalized ensemble simulations: an analytical approach. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[32]  U. Hansmann Parallel tempering algorithm for conformational studies of biological molecules , 1997, physics/9710041.

[33]  Alan M. Ferrenberg,et al.  Optimized Monte Carlo data analysis. , 1989, Physical review letters.

[34]  G. Hummer,et al.  Optimized molecular dynamics force fields applied to the helix-coil transition of polypeptides. , 2009, The journal of physical chemistry. B.

[35]  Charles H. Bennett,et al.  Efficient estimation of free energy differences from Monte Carlo data , 1976 .

[36]  Frank Noé,et al.  EMMA: A Software Package for Markov Model Building and Analysis. , 2012, Journal of chemical theory and computation.

[37]  Paul E. Smith,et al.  THE ALANINE DIPEPTIDE FREE ENERGY SURFACE IN SOLUTION , 1999 .

[38]  P. Deuflhard,et al.  A Direct Approach to Conformational Dynamics Based on Hybrid Monte Carlo , 1999 .

[39]  H. Stuben,et al.  Parallel tempering in full QCD with Wilson fermions , 2002 .

[40]  Connie Page,et al.  Computing Science and Statistics , 1992 .

[41]  Frank Noé,et al.  Markov models of molecular kinetics: generation and validation. , 2011, The Journal of chemical physics.

[42]  Gerhard Hummer,et al.  Error and efficiency of replica exchange molecular dynamics simulations. , 2009, The Journal of chemical physics.

[43]  H. Katzgraber,et al.  Monte Carlo simulations of spin glasses at low temperatures , 2000, cond-mat/0007113.

[44]  Ronald M. Levy,et al.  Long-time conformational transitions of alanine dipeptide in aqueous solution: Continuous and discrete-state kinetic models , 2004 .

[45]  W. Marsden I and J , 2012 .

[46]  Michael R. Shirts,et al.  Dynamical reweighting: improved estimates of dynamical properties from simulations at multiple temperatures. , 2011, The Journal of chemical physics.

[47]  A. Laio,et al.  Escaping free-energy minima , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[48]  R. Levy,et al.  Simulating replica exchange simulations of protein folding with a kinetic network model , 2007, Proceedings of the National Academy of Sciences.

[49]  K. Dill,et al.  Automatic discovery of metastable states for the construction of Markov models of macromolecular conformational dynamics. , 2007, The Journal of chemical physics.