Machine learning for collective variable discovery and enhanced sampling in biomolecular simulation

Classical molecular dynamics simulates the time evolution of molecular systems through the phase space spanned by the positions and velocities of the constituent atoms. Molecular-level thermodynamic, kinetic, and structural data extracted from the resulting trajectories provide valuable information for the understanding, engineering, and design of biological and molecular materials. The cost of simulating many-body atomic systems makes simulations of large molecules prohibitively expensive, and the high-dimensionality of the resulting trajectories presents a challenge for analysis. Driven by advances in algorithms, hardware, and data availability, there has been a flare of interest in recent years in the applications of machine learning – especially deep learning – to molecular simulation. These techniques have demonstrated great power and flexibility in both extracting mechanistic understanding of the important nonlinear collective variables governing the dynamics of a molecular system, and in furnishing good low-dimensional system representations with which to perform enhanced sampling or develop long-timescale dynamical models. It is the purpose of this article to introduce the key machine learning approaches, describe how they are married with statistical mechanical theory into domain-specific tools, and detail applications of these approaches in understanding and accelerating biomolecular simulation. GRAPHICAL ABSTRACT

[1]  M. Maggioni,et al.  Determination of reaction coordinates via locally scaled diffusion map. , 2011, The Journal of chemical physics.

[2]  Hao Wu,et al.  VAMPnets for deep learning of molecular kinetics , 2017, Nature Communications.

[3]  Lydia E Kavraki,et al.  Low-dimensional, free-energy landscapes of protein-folding reactions by nonlinear dimensionality reduction , 2006, Proc. Natl. Acad. Sci. USA.

[4]  Wojciech Samek,et al.  Explainable ai – preface , 2019 .

[5]  Michael A. Webb,et al.  Recent advances in machine learning towards multiscale soft materials design , 2019, Current Opinion in Chemical Engineering.

[6]  M. Karplus,et al.  Molecular dynamics simulations in biology , 1990, Nature.

[7]  Michael M. Resch,et al.  TweTriS: Twenty trillion-atom simulation , 2019, Int. J. High Perform. Comput. Appl..

[8]  Mark E Tuckerman,et al.  Stochastic Neural Network Approach for Learning High-Dimensional Free Energy Surfaces. , 2017, Physical review letters.

[9]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[10]  A. Laio,et al.  Metadynamics: a method to simulate rare events and reconstruct the free energy in biophysics, chemistry and material science , 2008 .

[11]  Ronald R. Coifman,et al.  Graph Laplacian Tomography From Unknown Random Projections , 2008, IEEE Transactions on Image Processing.

[12]  F. Noé,et al.  Kinetic distance and kinetic maps from molecular dynamics simulation. , 2015, Journal of chemical theory and computation.

[13]  Yi Isaac Yang,et al.  Enhanced sampling in molecular dynamics. , 2019, The Journal of chemical physics.

[14]  Andrew L. Ferguson,et al.  ACS Central Science Virtual Issue on Machine Learning , 2018, ACS central science.

[15]  Frank Noé,et al.  An Introduction to Markov State Models and Their Application to Long Timescale Molecular Simulation , 2014, Advances in Experimental Medicine and Biology.

[16]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[17]  V. Vemuri,et al.  Artificial neural networks: an introduction , 1988 .

[18]  Clarence W. Rowley,et al.  Variants of Dynamic Mode Decomposition: Boundary Condition, Koopman, and Fourier Analyses , 2012, J. Nonlinear Sci..

[19]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[20]  Ann B. Lee,et al.  Geometric diffusions as a tool for harmonic analysis and structure definition of data: diffusion maps. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  Rustam Z. Khaliullin,et al.  Graphite-diamond phase coexistence study employing a neural-network mapping of the ab initio potential energy surface , 2010 .

[23]  Andrew E. Torda,et al.  Local elevation: A method for improving the searching properties of molecular dynamics simulation , 1994, J. Comput. Aided Mol. Des..

[24]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[25]  Joseph A. Bank,et al.  Supporting Online Material Materials and Methods Figs. S1 to S10 Table S1 References Movies S1 to S3 Atomic-level Characterization of the Structural Dynamics of Proteins , 2022 .

[26]  Michele Parrinello,et al.  Collective Variables from Local Fluctuations. , 2018, The journal of physical chemistry letters.

[27]  Luigi Acerbi,et al.  Advances in Neural Information Processing Systems 27 , 2014 .

[28]  Frank Noé,et al.  Optimal use of data in parallel tempering simulations for the construction of discrete-state Markov models of biomolecular dynamics. , 2011, The Journal of chemical physics.

[29]  Bernhardt L Trout,et al.  Extensions to the likelihood maximization approach for finding reaction coordinates. , 2007, The Journal of chemical physics.

[30]  Grubmüller,et al.  Predicting slow structural transitions in macromolecular systems: Conformational flooding. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[31]  Huajian Gao,et al.  Simulating materials failure by using up to one billion atoms and the world's fastest computer: Work-hardening , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Wei Chen,et al.  High-Resolution Markov State Models for the Dynamics of Trp-Cage Miniprotein Constructed over Slow Folding Modes Identified by State-Free Reversible VAMPnets. , 2019, The journal of physical chemistry. B.

[33]  Hao Wu,et al.  Data-Driven Model Reduction and Transfer Operator Approximation , 2017, J. Nonlinear Sci..

[34]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[35]  F. Noé Beating the millisecond barrier in molecular dynamics simulations. , 2015, Biophysical journal.

[36]  Andrew L. Ferguson,et al.  Rational design of patchy colloids via landscape engineering , 2018 .

[37]  Gary Froyland,et al.  A Computational Method to Extract Macroscopic Variables and Their Dynamics in Multiscale Systems , 2013, SIAM J. Appl. Dyn. Syst..

[38]  Ioannis G Kevrekidis,et al.  Intrinsic map dynamics exploration for uncharted effective free-energy landscapes , 2016, Proceedings of the National Academy of Sciences.

[39]  Jianzhong Wang,et al.  Geometric Structure of High-Dimensional Data and Dimensionality Reduction , 2012 .

[40]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[41]  K. Dill,et al.  The Protein-Folding Problem, 50 Years On , 2012, Science.

[42]  Michele Parrinello,et al.  Metadynamics with Discriminants: A Tool for Understanding Chemistry. , 2018, Journal of chemical theory and computation.

[43]  A. Laio,et al.  Escaping free-energy minima , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Wolfgang Lechner,et al.  The reweighted path ensemble. , 2010, The Journal of chemical physics.

[45]  D. Griffiths,et al.  Introduction to Quantum Mechanics , 1960 .

[46]  Ioannis G. Kevrekidis,et al.  Nonlinear dimensionality reduction in molecular simulation: The diffusion map approach , 2011 .

[47]  Toni Giorgino,et al.  Identification of slow molecular order parameters for Markov model construction. , 2013, The Journal of chemical physics.

[48]  Stefan Klus,et al.  Koopman operator-based model reduction for switched-system control of PDEs , 2017, Autom..

[49]  Ioannis G Kevrekidis,et al.  Integrating diffusion maps with umbrella sampling: application to alanine dipeptide. , 2011, The Journal of chemical physics.

[50]  Cecilia Clementi,et al.  Perspective: Computational chemistry software and its advancement as illustrated through three grand challenge cases for molecular science. , 2018, The Journal of chemical physics.

[51]  Steven L. Brunton,et al.  Multiresolution Dynamic Mode Decomposition , 2015, SIAM J. Appl. Dyn. Syst..

[52]  Pratyush Tiwary,et al.  Reweighted autoencoded variational Bayes for enhanced sampling (RAVE). , 2018, The Journal of chemical physics.

[53]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[54]  Vijay S Pande,et al.  Improvements in Markov State Model Construction Reveal Many Non-Native Interactions in the Folding of NTL9. , 2013, Journal of chemical theory and computation.

[55]  Wei Chen,et al.  Nonlinear Discovery of Slow Molecular Modes using Hierarchical Dynamics Encoders , 2019, The Journal of chemical physics.

[56]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Vijay S. Pande,et al.  Modeling Molecular Kinetics with tICA and the Kernel Trick , 2015, Journal of chemical theory and computation.

[58]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[59]  K. Dill,et al.  The protein folding problem. , 1993, Annual review of biophysics.

[60]  Frank Noé,et al.  Markov state models of biomolecular conformational dynamics. , 2014, Current opinion in structural biology.

[61]  Laurenz Wiskott,et al.  What Is the Relation Between Slow Feature Analysis and Independent Component Analysis? , 2006, Neural Computation.

[62]  Marcus Weber,et al.  Fuzzy spectral clustering by PCCA+: application to Markov state models and data classification , 2013, Advances in Data Analysis and Classification.

[63]  Michele Parrinello,et al.  Simplifying the representation of complex free-energy landscapes using sketch-map , 2011, Proceedings of the National Academy of Sciences.

[64]  Christophe Chipot,et al.  Free Energy Calculations , 2008 .

[65]  J. Andrew McCammon,et al.  Unconstrained enhanced sampling for free energy calculations of biomolecules: a review , 2016, Molecular simulation.

[66]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[67]  Mohammad M. Sultan,et al.  Automated design of collective variables using supervised machine learning. , 2018, The Journal of chemical physics.

[68]  Steven L. Brunton,et al.  Dynamic Mode Decomposition with Control , 2014, SIAM J. Appl. Dyn. Syst..

[69]  Frank Noé,et al.  Markov models of molecular kinetics: generation and validation. , 2011, The Journal of chemical physics.

[70]  Vijay S Pande,et al.  tICA-Metadynamics: Accelerating Metadynamics by Using Kinetically Selected Collective Variables. , 2017, Journal of chemical theory and computation.

[71]  Timothy D. Sauer,et al.  Time-Scale Separation from Diffusion-Mapped Delay Coordinates , 2013, SIAM J. Appl. Dyn. Syst..

[72]  Aaron R Dinner,et al.  Automatic method for identifying reaction coordinates in complex systems. , 2005, The journal of physical chemistry. B.

[73]  J. Preto,et al.  Fast recovery of free energy landscapes via diffusion-map-directed molecular dynamics. , 2014, Physical chemistry chemical physics : PCCP.

[74]  Mohammad M. Sultan,et al.  Variational encoding of complex dynamics. , 2017, Physical review. E.

[75]  Ernesto E. Borrero,et al.  Reaction coordinates and transition pathways of rare events via forward flux sampling. , 2007, The Journal of chemical physics.

[76]  B. Keller,et al.  Girsanov reweighting for metadynamics simulations. , 2018, The Journal of chemical physics.

[77]  Frank Noé,et al.  A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems , 2012, Multiscale Model. Simul..

[78]  Steven L. Brunton,et al.  Dynamic mode decomposition - data-driven modeling of complex systems , 2016 .

[79]  S. Ulam A collection of mathematical problems , 1960 .

[80]  John D Chodera,et al.  On the Use of Experimental Observations to Bias Simulated Ensembles. , 2012, Journal of chemical theory and computation.

[81]  V. Pande,et al.  Markov State Models: From an Art to a Science. , 2018, Journal of the American Chemical Society.

[82]  Nancy Wilkins-Diehr,et al.  NSF’s Inaugural Software Institutes: The Science Gateways Community Institute and the Molecular Sciences Software Institute , 2018, Computing in Science & Engineering.

[83]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[84]  F. Noé,et al.  Commute Maps: Separating Slowly Mixing Molecular Configurations for Kinetic Modeling. , 2016, Journal of chemical theory and computation.

[85]  Ioannis G. Kevrekidis,et al.  Reduced models in chemical kinetics via nonlinear data-mining , 2013, 1307.6849.

[86]  Michael R. Shirts,et al.  Dynamical reweighting: improved estimates of dynamical properties from simulations at multiple temperatures. , 2011, The Journal of chemical physics.

[87]  Wei Chen,et al.  Collective variable discovery and enhanced sampling using autoencoders: Innovations in network architecture and error function design. , 2018, The Journal of chemical physics.

[88]  Cecilia Clementi,et al.  Markov state models from short non-equilibrium simulations—Analysis and correction of estimation bias , 2017, 1701.01665.

[89]  Michele Parrinello,et al.  Demonstrating the Transferability and the Descriptive Power of Sketch-Map. , 2013, Journal of chemical theory and computation.

[90]  García,et al.  Large-amplitude nonlinear motions in proteins. , 1992, Physical review letters.

[91]  Ioannis G Kevrekidis,et al.  Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the Koopman operator. , 2017, Chaos.

[92]  Giovanni Bussi,et al.  Enhanced Sampling in Molecular Dynamics Using Metadynamics, Replica-Exchange, and Temperature-Acceleration , 2013, Entropy.

[93]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[94]  Hythem Sidky,et al.  Learning free energy landscapes using artificial neural networks. , 2017, The Journal of chemical physics.

[95]  Yoshua Bengio,et al.  Object Recognition with Gradient-Based Learning , 1999, Shape, Contour and Grouping in Computer Vision.

[96]  David A. Forsyth,et al.  Shape, Contour and Grouping in Computer Vision , 1999, Lecture Notes in Computer Science.

[97]  R. Dror,et al.  How Fast-Folding Proteins Fold , 2011, Science.

[98]  Frank Noé,et al.  Hierarchical Time-Lagged Independent Component Analysis: Computing Slow Modes and Reaction Coordinates for Large Molecular Systems. , 2016, Journal of chemical theory and computation.

[99]  Ian R. McDonald,et al.  Machine Calculation of Thermodynamic Properties of a Simple Fluid at Supercritical Temperatures , 1967 .

[100]  Vijay S. Pande,et al.  Everything you wanted to know about Markov State Models but were afraid to ask. , 2010, Methods.

[101]  Stefan Klus,et al.  Tensor-based dynamic mode decomposition , 2016, Nonlinearity.

[102]  Frank Noé,et al.  Variational Koopman models: Slow collective variables and molecular kinetics from short off-equilibrium simulations. , 2016, The Journal of chemical physics.

[103]  Schuster,et al.  Separation of a mixture of independent signals using time delayed correlations. , 1994, Physical review letters.

[104]  Zhenwei Li,et al.  Molecular dynamics with on-the-fly machine learning of quantum-mechanical forces. , 2015, Physical review letters.

[105]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[106]  Mohammad M. Sultan,et al.  Transferable Neural Networks for Enhanced Sampling of Protein Dynamics. , 2018, Journal of chemical theory and computation.

[107]  Marino Arroyo,et al.  Charting molecular free-energy landscapes with an atlas of collective variables. , 2016, The Journal of chemical physics.

[108]  Melissa C. Smith,et al.  A generalized deep learning approach for local structure identification in molecular simulations , 2019, Chemical science.

[109]  Cecilia Clementi,et al.  Rapid exploration of configuration space with diffusion-map-directed molecular dynamics. , 2013, The journal of physical chemistry. B.

[110]  Gary Froyland Using Ulam's method to calculate entropy and other dynamical invariants , 1999 .

[111]  Frank Noé,et al.  Machine Learning of Coarse-Grained Molecular Dynamics Force Fields , 2018, ACS central science.

[112]  M. Weber,et al.  An Automatic Adaptive Importance Sampling Algorithm for Molecular Dynamics in Reaction Coordinates , 2018, SIAM J. Sci. Comput..

[113]  Wei Chen,et al.  Molecular enhanced sampling with autoencoders: On‐the‐fly collective variable discovery and accelerated free energy landscape exploration , 2017, J. Comput. Chem..

[114]  Eric Darve,et al.  Adaptive biasing force method for scalar and vector free energy calculations. , 2008, The Journal of chemical physics.

[115]  Klaus Schulten,et al.  Discovery through the computational microscope. , 2009, Structure.

[116]  Igor Mezic,et al.  On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator , 2017, J. Nonlinear Sci..

[117]  B. Alder,et al.  Studies in Molecular Dynamics. I. General Method , 1959 .

[118]  Robert Hecht-Nielsen III.3 – Theory of the Backpropagation Neural Network* , 1992 .

[119]  L Donati,et al.  Girsanov reweighting for path ensembles and Markov state models. , 2017, The Journal of chemical physics.

[120]  B. Roux,et al.  Calculation of absolute protein-ligand binding free energy from computer simulations. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[121]  Clarence W. Rowley,et al.  Dynamic mode decomposition for large and streaming datasets , 2014, 1406.7187.

[122]  Marino Arroyo,et al.  Modeling and enhanced sampling of molecular systems with smooth and nonlinear data-driven collective variables. , 2013, The Journal of chemical physics.

[123]  Yang Li,et al.  PotentialNet for Molecular Property Prediction , 2018, ACS central science.

[124]  Clarence W. Rowley,et al.  De-biasing the dynamic mode decomposition for applied Koopman spectral analysis of noisy datasets , 2015, Theoretical and Computational Fluid Dynamics.

[125]  Hao Wu,et al.  Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning , 2018, Science.

[126]  Michele Parrinello,et al.  A self-learning algorithm for biased molecular dynamics , 2010, Proceedings of the National Academy of Sciences.

[127]  M. Karplus,et al.  Collective motions in proteins: A covariance analysis of atomic fluctuations in molecular dynamics and normal mode simulations , 1991, Proteins.

[128]  E. Santiso,et al.  Molecular modeling studies of peptoid polymers , 2017 .

[129]  Andrew L. Ferguson,et al.  Nonlinear machine learning of patchy colloid self-assembly pathways and mechanisms. , 2014, The journal of physical chemistry. B.

[130]  B. Alder,et al.  Phase Transition for a Hard Sphere System , 1957 .

[131]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[132]  Michele Parrinello,et al.  A variational conformational dynamics approach to the selection of collective variables in metadynamics. , 2017, The Journal of chemical physics.

[133]  Clarence W. Rowley,et al.  Extending Data-Driven Koopman Analysis to Actuated Systems , 2016 .

[134]  Andrew L. Ferguson,et al.  Systematic determination of order parameters for chain dynamics using diffusion maps , 2010, Proceedings of the National Academy of Sciences.

[135]  Hao Wu,et al.  Multiensemble Markov models of molecular thermodynamics and kinetics , 2016, Proceedings of the National Academy of Sciences.

[136]  G. Stiny Shape , 1999 .

[137]  C. Clementi,et al.  Discovering mountain passes via torchlight: methods for the definition of reaction coordinates and pathways in complex macromolecular reactions. , 2013, Annual review of physical chemistry.

[138]  Berend Smit,et al.  Understanding molecular simulation: from algorithms to applications , 1996 .

[139]  Alexander Binder,et al.  Unmasking Clever Hans predictors and assessing what machines really learn , 2019, Nature Communications.

[140]  Daniel W. Davies,et al.  Machine learning for molecular and materials science , 2018, Nature.

[141]  A. Szabó,et al.  Modern quantum chemistry : introduction to advanced electronic structure theory , 1982 .

[142]  B. Trout,et al.  Obtaining reaction coordinates by likelihood maximization. , 2006, The Journal of chemical physics.

[144]  George A. Khoury,et al.  Protein folding and de novo protein design for biotechnological applications. , 2014, Trends in biotechnology.

[145]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[146]  Bernhardt L. Trout,et al.  Design of therapeutic proteins with enhanced stability , 2009, Proceedings of the National Academy of Sciences.

[147]  Juan J de Pablo,et al.  Adaptive enhanced sampling by force-biasing using neural networks. , 2018, The Journal of chemical physics.

[148]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[149]  Rachael A Mansbach,et al.  Machine learning of single molecule free energy surfaces and the impact of chemistry and environment upon structure and dynamics. , 2015, The Journal of chemical physics.

[150]  Carmeline J. Dsilva,et al.  Systematic characterization of protein folding pathways using diffusion maps: application to Trp-cage miniprotein. , 2015, The Journal of chemical physics.

[151]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[152]  Michele Parrinello,et al.  Enhancing Important Fluctuations: Rare Events and Metadynamics from a Conceptual Viewpoint. , 2016, Annual review of physical chemistry.

[153]  Brooke E. Husic,et al.  Deflation reveals dynamical structure in nondominant reaction coordinates , 2019, The Journal of Chemical Physics.

[154]  Wei Chen,et al.  Capabilities and Limitations of Time-lagged Autoencoders for Slow Mode Discovery in Dynamical Systems , 2019, The Journal of Chemical Physics.

[155]  Andrew L. Ferguson,et al.  A Study of the Morphology, Dynamics, and Folding Pathways of Ring Polymers with Supramolecular Topological Constraints Using Molecular Simulation and Nonlinear Manifold Learning , 2017, 1708.00988.

[156]  Andrew L. Ferguson,et al.  BayesWHAM: A Bayesian approach for free energy estimation, reweighting, and uncertainty quantification in the weighted histogram analysis method , 2017, J. Comput. Chem..

[157]  Robert Walkup,et al.  Simulating materials failure by using up to one billion atoms and the world's fastest computer: Brittle fracture , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[158]  Juan J de Pablo,et al.  Density of states-based molecular simulations. , 2012, Annual review of chemical and biomolecular engineering.

[159]  篠原 祝子,et al.  幼稚園教育実習における実習態度 : 平成22年度6月「幼稚園実習」の実習園評価と実習生評価の比較 , 2011 .

[160]  Yuji Sugita,et al.  Neural Network and Nearest Neighbor Algorithms for Enhancing Sampling of Molecular Dynamics. , 2017, Journal of chemical theory and computation.

[161]  Jiang Wang,et al.  Nonlinear machine learning in simulations of soft and biological materials , 2018 .

[162]  I. G. Kevrekidis,et al.  Coarse-grained dynamics of an activity bump in a neural field model , 2007 .

[163]  Pratyush Tiwary,et al.  Toward Achieving Efficient and Accurate Ligand-Protein Unbinding with Deep Learning and Molecular Dynamics through RAVE. , 2018, Journal of chemical theory and computation.

[164]  Andrew L. Ferguson,et al.  Landmark diffusion maps (L-dMaps): Accelerated manifold learning out-of-sample extension , 2017, Applied and Computational Harmonic Analysis.

[165]  Alexander Binder,et al.  On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation , 2015, PloS one.

[166]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[167]  B. Berne,et al.  Spectral gap optimization of order parameters for sampling complex molecular systems , 2015, Proceedings of the National Academy of Sciences.

[168]  G. Torrie,et al.  Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling , 1977 .

[169]  Frank Noé,et al.  Variational Approach to Molecular Kinetics. , 2014, Journal of chemical theory and computation.

[170]  Shang Gao,et al.  Deep clustering of protein folding simulations , 2018, BMC Bioinformatics.

[171]  Frank Noé,et al.  Time-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics , 2017, The Journal of chemical physics.

[172]  Andrew L. Ferguson,et al.  Inverse design of self-assembling colloidal crystals with omnidirectional photonic bandgaps. , 2019, Soft matter.

[173]  Michele Parrinello,et al.  Folding a small protein using harmonic linear discriminant analysis. , 2018, The Journal of chemical physics.

[174]  Andrew G. Glen,et al.  APPL , 2001 .

[175]  Michele Parrinello,et al.  Using sketch-map coordinates to analyze and bias molecular dynamics simulations , 2012, Proceedings of the National Academy of Sciences.

[176]  Jiu Ding,et al.  Finite approximations of Frobenius-Perron operators. A solution of Ulam's conjecture to multi-dimensional transformations , 1996 .