Integrated VAC: A robust strategy for identifying eigenfunctions of dynamical operators.

One approach to analyzing the dynamics of a physical system is to search for long-lived patterns in its motions. This approach has been particularly successful for molecular dynamics data, where slowly decorrelating patterns can indicate large-scale conformational changes. Detecting such patterns is the central objective of the variational approach to conformational dynamics (VAC), as well as the related methods of time-lagged independent component analysis and Markov state modeling. In VAC, the search for slowly decorrelating patterns is formalized as a variational problem solved by the eigenfunctions of the system's transition operator. VAC computes solutions to this variational problem by optimizing a linear or nonlinear model of the eigenfunctions using time series data. Here, we build on VAC's success by addressing two practical limitations. First, VAC can give poor eigenfunction estimates when the lag time parameter is chosen poorly. Second, VAC can overfit when using flexible parameterizations such as artificial neural networks with insufficient regularization. To address these issues, we propose an extension that we call integrated VAC (IVAC). IVAC integrates over multiple lag times before solving the variational problem, making its results more robust and reproducible than VAC's.

[1]  Xuhui Huang,et al.  On the advantages of exploiting memory in Markov state models for biomolecular dynamics. , 2020, The Journal of chemical physics.

[2]  Wei Chen,et al.  High-Resolution Markov State Models for the Dynamics of Trp-Cage Miniprotein Constructed over Slow Folding Modes Identified by State-Free Reversible VAMPnets. , 2019, The journal of physical chemistry. B.

[3]  Wei Chen,et al.  Nonlinear Discovery of Slow Molecular Modes using Hierarchical Dynamics Encoders , 2019, The Journal of chemical physics.

[4]  Erik H. Thiede,et al.  Galerkin approximation of dynamical quantities using trajectory data. , 2018, The Journal of chemical physics.

[5]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[6]  Hao Wu,et al.  VAMPnets for deep learning of molecular kinetics , 2017, Nature Communications.

[7]  Vijay S Pande,et al.  Note: MSM lag time cannot be used for variational model selection. , 2017, The Journal of chemical physics.

[8]  Hao Wu,et al.  Data-Driven Model Reduction and Transfer Operator Approximation , 2017, J. Nonlinear Sci..

[9]  Frank Noé,et al.  Variational Koopman models: Slow collective variables and molecular kinetics from short off-equilibrium simulations. , 2016, The Journal of chemical physics.

[10]  Daniel M. Zuckerman,et al.  Accurate Estimation of Protein Folding and Unfolding Times: Beyond Markov State Models , 2016, Journal of chemical theory and computation.

[11]  T. Eisner,et al.  Operator Theoretic Aspects of Ergodic Theory , 2015 .

[12]  F. Noé,et al.  Investigating Molecular Kinetics by Variationally Optimized Diffusion Maps. , 2015, Journal of chemical theory and computation.

[13]  Hao Wu,et al.  Projected metastable Markov processes and their estimation with observable operator models. , 2015, The Journal of chemical physics.

[14]  Frank Noé,et al.  PyEMMA 2: A Software Package for Estimation, Validation, and Analysis of Markov Models. , 2015, Journal of chemical theory and computation.

[15]  Berk Hess,et al.  GROMACS: High performance molecular simulations through multi-level parallelism from laptops to supercomputers , 2015 .

[16]  F. Noé,et al.  A Basis Set for Peptides for the Variational Approach to Conformational Kinetics. , 2015, Journal of chemical theory and computation.

[17]  Carsten Kutzner,et al.  Tackling Exascale Software Challenges in Molecular Dynamics Simulations with GROMACS , 2015, EASC.

[18]  C R Schwantes,et al.  Perspective: Markov models for long-timescale biomolecular dynamics. , 2014, The Journal of chemical physics.

[19]  R. McGibbon,et al.  Variational cross-validation of slow dynamical modes in molecular kinetics. , 2014, The Journal of chemical physics.

[20]  Frank Noé,et al.  Variational Approach to Molecular Kinetics. , 2014, Journal of chemical theory and computation.

[21]  Peter M. Kasson,et al.  GROMACS 4.5: a high-throughput and highly parallel open source molecular simulation toolkit , 2013, Bioinform..

[22]  Vijay S Pande,et al.  Improvements in Markov State Model Construction Reveal Many Non-Native Interactions in the Folding of NTL9. , 2013, Journal of chemical theory and computation.

[23]  Toni Giorgino,et al.  Identification of slow molecular order parameters for Markov model construction. , 2013, The Journal of chemical physics.

[24]  Frank Noé,et al.  A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems , 2012, Multiscale Model. Simul..

[25]  R. Dror,et al.  How Fast-Folding Proteins Fold , 2011, Science.

[26]  Frank Noé,et al.  Markov models of molecular kinetics: generation and validation. , 2011, The Journal of chemical physics.

[27]  Sotaro Fuchigami,et al.  Slow dynamics in protein fluctuations revealed by time-structure based independent component analysis: the case of domain motions. , 2011, The Journal of chemical physics.

[28]  Vijay S. Pande,et al.  Everything you wanted to know about Markov State Models but were afraid to ask. , 2010, Methods.

[29]  Gerrit Groenhof,et al.  GROMACS: Fast, flexible, and free , 2005, J. Comput. Chem..

[30]  William Swope,et al.  Describing Protein Folding Kinetics by Molecular Dynamics Simulations. 1. Theory , 2004 .

[31]  William Swope,et al.  Describing Protein Folding Kinetics by Molecular Dynamics Simulations. 2. Example Applications to Alanine Dipeptide and a β-Hairpin Peptide† , 2004 .

[32]  J. Hofrichter,et al.  Experimental tests of villin subdomain folding simulations. , 2003, Journal of molecular biology.

[33]  Berk Hess,et al.  GROMACS 3.0: a package for molecular simulation and trajectory analysis , 2001 .

[34]  P. Deuflhard,et al.  A Direct Approach to Conformational Dynamics Based on Hybrid Monte Carlo , 1999 .

[35]  P. Kollman,et al.  Pathways to a protein folding intermediate observed in a 1-microsecond simulation in aqueous solution. , 1998, Science.

[36]  A. Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[37]  Hiroshi Takano,et al.  Molecular Dynamics Study of Relaxation Modes of a Single Polymer Chain , 1997 .

[38]  Berk Hess,et al.  LINCS: A linear constraint solver for molecular simulations , 1997, J. Comput. Chem..

[39]  P S Kim,et al.  A thermostable 35-residue subdomain within villin headpiece. , 1996, Journal of molecular biology.

[40]  T. Darden,et al.  A smooth particle mesh Ewald method , 1995 .

[41]  Hiroshi Takano,et al.  Relaxation modes in random spin systems , 1995 .

[42]  D. van der Spoel,et al.  GROMACS: A message-passing parallel molecular dynamics implementation , 1995 .

[43]  Schuster,et al.  Separation of a mixture of independent signals using time delayed correlations. , 1994, Physical review letters.

[44]  P. Kollman,et al.  Settle: An analytical version of the SHAKE and RATTLE algorithm for rigid water models , 1992 .

[45]  M. Parrinello,et al.  Polymorphic transitions in single crystals: A new molecular dynamics method , 1981 .

[46]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[47]  O. Kallenberg.  Foundations of Modern Probability , 2021, Probability Theory and Stochastic Modelling.

[48]  F. Noé,et al.  Analysis of Markov models. , 2014, Advances in experimental medicine and biology.

[49]  Eric Vanden-Eijnden,et al.  Transition path theory. , 2014, Advances in experimental medicine and biology.

[50]  Alexander D. MacKerell,et al.  Development and current status of the CHARMM force field for nucleic acids , 2000, Biopolymers.