A scaled conjugate gradient method for nonlinear unconstrained optimization

We propose a new optimization problem which combines the good features of the classical conjugate gradient method using some penalty parameter, and then, solve it to introduce a new scaled conjugate gradient method for solving unconstrained problems. The method reduces to the classical conjugate gradient algorithm under common assumptions, and inherits its good properties. We prove the global convergence of the method using suitable conditions. Numerical results show that the new method is efficient and robust.

[1]  Saman Babaie-Kafaki,et al.  Two modified scaled nonlinear conjugate gradient methods , 2014, J. Comput. Appl. Math..

[2]  Zhong Wan,et al.  An Improved Spectral Conjugate Gradient Algorithm for Nonconvex Unconstrained Optimization Problems , 2013, J. Optim. Theory Appl..

[3]  Boris Polyak The conjugate gradient method in extremal problems , 1969 .

[4]  William W. Hager,et al.  A New Conjugate Gradient Method with Guaranteed Descent and an Efficient Line Search , 2005, SIAM J. Optim..

[5]  Weijun Zhou,et al.  Spectral gradient projection method for solving nonlinear monotone equations , 2006 .

[6]  Nezam Mahdavi-Amiri,et al.  Two effective hybrid conjugate gradient algorithms based on modified BFGS updates , 2011, Numerical Algorithms.

[7]  Neculai Andrei,et al.  A scaled nonlinear conjugate gradient algorithm for unconstrained optimization , 2008 .

[8]  David J. Thuente,et al.  Line search algorithms with guaranteed sufficient decrease , 1994, TOMS.

[9]  Jorge Nocedal,et al.  Global Convergence Properties of Conjugate Gradient Methods for Optimization , 1992, SIAM J. Optim..

[10]  Nicholas I. M. Gould,et al.  CUTEr and SifDec: A constrained and unconstrained testing environment, revisited , 2003, TOMS.

[11]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[12]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[13]  I M GouldNicholas,et al.  CUTEr and SifDec , 2003 .

[14]  Masoud Fatemi A new efficient conjugate gradient method for unconstrained optimization , 2016, J. Comput. Appl. Math..

[15]  Saman Babaie-Kafaki,et al.  A modified two-point stepsize gradient algorithm for unconstrained minimization , 2013, Optim. Methods Softw..

[16]  Ya-Xiang Yuan,et al.  A Subspace Study on Conjugate Gradient Algorithms , 1995 .

[17]  David F. Shanno,et al.  Algorithm 500: Minimization of Unconstrained Multivariate Functions [E4] , 1976, TOMS.

[18]  Marcos Raydan,et al.  The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem , 1997, SIAM J. Optim..

[19]  Zhong Wan,et al.  New spectral PRP conjugate gradient method for unconstrained optimization , 2011, Appl. Math. Lett..

[20]  Yu-Hong Dai,et al.  A Nonlinear Conjugate Gradient Algorithm with an Optimal Property and an Improved Wolfe Line Search , 2013, SIAM J. Optim..

[21]  Masoud Fatemi An Optimal Parameter for Dai–Liao Family of Conjugate Gradient Methods , 2016, J. Optim. Theory Appl..

[22]  Yuhong Dai Nonlinear Conjugate Gradient Methods , 2011 .

[23]  William W. Hager,et al.  The Limited Memory Conjugate Gradient Method , 2013, SIAM J. Optim..

[24]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[25]  M. Zibulevsky,et al.  Sequential Subspace Optimization Method for Large-Scale Unconstrained Problems , 2005 .

[26]  W. Hager,et al.  A SURVEY OF NONLINEAR CONJUGATE GRADIENT METHODS , 2005 .

[27]  J. M. Martínez,et al.  A Spectral Conjugate Gradient Method for Unconstrained Optimization , 2001 .

[28]  Neculai Andrei,et al.  Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization , 2007, Optim. Methods Softw..

[29]  C. M. Reeves,et al.  Function minimization by conjugate gradients , 1964, Comput. J..

[30]  L. Liao,et al.  New Conjugacy Conditions and Related Nonlinear Conjugate Gradient Methods , 2001 .

[31]  Neculai Andrei,et al.  Scaled conjugate gradient algorithms for unconstrained optimization , 2007, Comput. Optim. Appl..