Performance of hybrid methods for large‐scale unconstrained optimization as applied to models of proteins

Energy minimization plays an important role in structure determination and analysis of proteins, peptides, and other organic molecules; therefore, development of efficient minimization algorithms is important. Recently, Morales and Nocedal developed hybrid methods for large‐scale unconstrained optimization that interlace iterations of the limited‐memory BFGS method (L‐BFGS) and the Hessian‐free Newton method (Computat Opt Appl 2002, 21, 143–154). We test the performance of this approach as compared to those of the L‐BFGS algorithm of Liu and Nocedal and the truncated Newton (TN) with automatic preconditioner of Nash, as applied to the protein bovine pancreatic trypsin inhibitor (BPTI) and a loop of the protein ribonuclease A. These systems are described by the all‐atom AMBER force field with a dielectric constant ϵ = 1 and a distance‐dependent dielectric function ϵ = 2r, where r is the distance between two atoms. It is shown that for the optimal parameters the hybrid approach is typically two times more efficient in terms of CPU time and function/gradient calculations than the two other methods. The advantage of the hybrid approach increases as the electrostatic interactions become stronger, that is, in going from ϵ = 2r to ϵ = 1, which leads to a more rugged and probably more nonlinear potential energy surface. However, no general rule that defines the optimal parameters has been found and their determination requires a relatively large number of trial‐and‐error calculations for each problem. © 2003 Wiley Periodicals, Inc. J Comput Chem 24: 1222–1231, 2003

[1]  H. Scheraga,et al.  Monte Carlo-minimization approach to the multiple-minima problem in protein folding. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Tamar Schlick,et al.  TNPACK—A truncated Newton minimization package for large-scale problems: I. Algorithm and usage , 1992, TOMS.

[3]  Zhi Wang,et al.  The Adjoint Newton Algorithm for Large-Scale Unconstrained Optimization in Meteorology Applications , 1998, Comput. Optim. Appl..

[4]  M. Karplus,et al.  Method for estimating the configurational entropy of macromolecules , 1981 .

[5]  E. Meirovitch,et al.  New theoretical methodology for elucidating the solution structure of peptides from NMR data. 1. The relative contribution of low-energy microstates to the partition function , 1995 .

[6]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[7]  Jaroslaw Pillardy,et al.  Conformation-family Monte Carlo: A new method for crystal structure prediction , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Hagai Meirovitch,et al.  Efficiency of the Local Torsional Deformations Method for Identifying the Stable Structures of Cyclic Molecules , 1997 .

[9]  Hagai Meirovitch,et al.  DETERMINATION OF THE STABLE MICROSTATES OF A PEPTIDE FROM NOE DISTANCE CONSTRAINTS AND OPTIMIZATION OF ATOMIC SOLVATION PARAMETERS , 1998 .

[10]  O. Axelsson,et al.  On the eigenvalue distribution of a class of preconditioning methods , 1986 .

[11]  G. Chang,et al.  An internal-coordinate Monte Carlo method for searching conformational space , 1989 .

[12]  C. Tanford Macromolecules , 1994, Nature.

[13]  Zhi Wang,et al.  A truncated Newton optimization algorithm in meteorology applications with analytic Hessian/vector products , 1995, Comput. Optim. Appl..

[14]  Martin Saunders,et al.  Searching for conformers of nine‐ to twelve‐ring hydrocarbons on the MM2 and MM3 energy surfaces: Stochastic search for interconversion pathways , 1991 .

[15]  Adam Liwo,et al.  Recent improvements in prediction of protein structure by global optimization of a potential energy function , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Martin Saunders,et al.  Conformations of cycloheptadecane. A comparison of methods for conformational searching , 1990 .

[17]  Akbar Nayeem,et al.  MSEED: A program for the rapid analytical determination of accessible surface areas and their derivatives , 1992 .

[18]  N. Go,et al.  Ring Closure and Local Conformational Deformations of Chain Molecules , 1970 .

[19]  D. Case Normal mode analysis of protein dynamics , 1994 .

[20]  Tamar Schlick,et al.  Efficient Implementation of the Truncated-Newton Algorithm for Large-Scale Chemistry Applications , 1999, SIAM J. Optim..

[21]  Jorge Nocedal,et al.  Automatic Preconditioning by Limited Memory Quasi-Newton Updating , 1999, SIAM J. Optim..

[22]  François-Xavier Le Dimet,et al.  Numerical Experience with Limited-Memory Quasi-Newton and Truncated Newton Methods , 1993, SIAM J. Optim..

[23]  S. Nash Newton-Type Minimization via the Lanczos Method , 1984 .

[24]  Arnold T. Hagler,et al.  Computer simulation of the conformational properties of oligopeptides. Comparison of theoretical methods and analysis of experimental results , 1979 .

[25]  Ionel Michael Navon,et al.  A combined simulated annealing and quasi-Newton-like conjugate-gradient method for determining the structure of mixed argon-xenon clusters , 1990, Comput. Chem..

[26]  J. J. Moré,et al.  Quasi-Newton Methods, Motivation and Theory , 1974 .

[27]  S. Nash Preconditioning of Truncated-Newton Methods , 1985 .

[28]  Jorge Nocedal,et al.  A Numerical Study of the Limited Memory BFGS Method and the Truncated-Newton Method for Large Scale Optimization , 1991, SIAM J. Optim..

[29]  O. Axelsson,et al.  On the rate of convergence of the preconditioned conjugate gradient method , 1986 .

[30]  Tamar Schlick,et al.  A truncated Newton minimizer adapted for CHARMM and biomolecular applications , 1994, J. Comput. Chem..

[31]  T. Richmond,et al.  Solvent accessible surface area and excluded volume in proteins. Analytical equations for overlapping spheres and implications for the hydrophobic effect. , 1984, Journal of molecular biology.

[32]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[33]  David F. Shanno,et al.  Remark on “Algorithm 500: Minimization of Unconstrained Multivariate Functions [E4]” , 1980, TOMS.

[34]  R. Dembo,et al.  INEXACT NEWTON METHODS , 1982 .

[35]  Tamar Schlick,et al.  TNPACK—a truncated Newton minimization package for large-scale problems: II. Implementation examples , 1992, TOMS.

[36]  Jorge Nocedal,et al.  Algorithm 809: PREQN: Fortran 77 subroutines for preconditioning the conjugate gradient method , 2001, TOMS.

[37]  K. Phua,et al.  Optimization : techniques and applications , 1992 .

[38]  M. L. Connolly Analytical molecular surface calculation , 1983 .

[39]  M. Karplus,et al.  CHARMM: A program for macromolecular energy, minimization, and dynamics calculations , 1983 .

[40]  New optimization method for conformational energy calculations on polypeptides: Conformational space annealing , 1997 .

[41]  P. Kollman,et al.  A Second Generation Force Field for the Simulation of Proteins, Nucleic Acids, and Organic Molecules , 1995 .

[42]  Tamar Schlick,et al.  Remark on Algorithm 702—the updated truncated Newton minimization package , 1999, TOMS.

[43]  Luis Morales,et al.  Algorithm PREQN Fortran Subroutines for Preconditioning the Conjugate Gradient Method , 1999 .

[44]  G. Keserü,et al.  Hessian‐free low‐mode conformational search for large‐scale protein loop optimization: application to c‐jun N‐terminal kinase JNK3 , 2001 .

[45]  Daniel H. Robertson,et al.  Determination of the structure of mixed argon--xenon clusters using a finite-temperature, lattice-based Monte Carlo method , 1989 .

[46]  Ionel Michael Navon,et al.  Performance of efficient minimization algorithms as applied to models of peptides and proteins , 1999 .

[47]  H. Scheraga,et al.  Use of buildup and energy‐minimization procedures to compute low‐energy structures of the backbone of enkephalin , 1985, Biopolymers.

[48]  Jorge Nocedal,et al.  Enriched Methods for Large-Scale Unconstrained Optimization , 2002, Comput. Optim. Appl..

[49]  H. Meirovitch,et al.  Optimization of solvation models for predicting the structure of surface loops in proteins , 2001, Proteins.

[50]  David F. Shanno,et al.  Conjugate Gradient Methods with Inexact Searches , 1978, Math. Oper. Res..