Global optimization through a stochastic perturbation of the Polak-Ribière conjugate gradient method

Abstract We develop a new modified Polak–Ribiere conjugate gradient method by considering a random perturbation. Our approach is suitable for solving a large class of optimization problems on a rectangle of R n or unconstrained problems. Theoretical results ensure that the proposed method converges to a global minimizer. Numerical experiments are achieved on some typical test problems, particularly the engineering problem of Lennard-Jones clusters. A comparison with well known methods is carried out to show the performance of our algorithm.

[1]  R. Ellaia,et al.  Global Optimization under nonlinear restrictions by using stochastic perturbations of the projected gradient , 2004 .

[2]  Panos M. Pardalos,et al.  Speeding up continuous GRASP , 2010, Eur. J. Oper. Res..

[3]  Yu-Hong Dai.  Convergence of conjugate gradient methods with constant stepsizes , 2011, Optim. Methods Softw..

[4]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[5]  Yong Li,et al.  A Modified Hestenes and Stiefel Conjugate Gradient Algorithm for Large-Scale Nonsmooth Minimizations and Nonlinear Equations , 2015, Journal of Optimization Theory and Applications.

[6]  Jie Shen,et al.  Convergence of descent method without line search , 2005, Appl. Math. Comput..

[7]  M. N. Vrahatisa,et al.  A class of gradient unconstrained minimization algorithms with adaptive stepsize , 1999 .

[8]  G. W. Greenwood.  Revisiting the Complexity of Finding Globally Minimum Energy Configurations in Atomic Clusters , 1999 .

[9]  Liu Jin kui,et al.  A modified PRP conjugate gradient method , 2012 .

[10]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[11]  Guoyin Li,et al.  A modified Polak-Ribière-Polyak conjugate gradient algorithm for nonsmooth convex programs , 2014, J. Comput. Appl. Math..

[12]  Rafael Martí,et al.  Experimental Testing of Advanced Scatter Search Designs for Global Optimization of Multimodal Functions , 2005, J. Glob. Optim..

[13]  J. Doye,et al.  Global Optimization by Basin-Hopping and the Lowest Energy Structures of Lennard-Jones Clusters Containing up to 110 Atoms , 1997, cond-mat/9803344.

[14]  J. Pintér.  Global optimization : scientific and engineering case studies , 2006 .

[15]  Xiwen Lu,et al.  A conjugate gradient method with descent direction for unconstrained optimization , 2009, J. Comput. Appl. Math..

[16]  Yuhong Dai.  Nonlinear Conjugate Gradient Methods , 2011 .

[17]  Jiapu Zhang,et al.  Global Convergence of Conjugate Gradient Methods without Line Search , 2001, Ann. Oper. Res..

[18]  L. C. W. Dixon.  Conjugate Directions without Linear Searches , 1973 .

[19]  E. Polak,et al.  Note sur la convergence de méthodes de directions conjuguées , 1969 .

[20]  José Eduardo Souza de Cursi,et al.  Global optimization by random perturbation of the gradient method with a fixed parameter , 1994, J. Glob. Optim..

[21]  W. Hager,et al.  A SURVEY OF NONLINEAR CONJUGATE GRADIENT METHODS , 2005 .

[22]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[23]  C. Price,et al.  A CARTOPT METHOD FOR BOUND-CONSTRAINED GLOBAL OPTIMIZATION , 2014 .

[24]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[25]  Radosław Pytlak,et al.  Conjugate Gradient Algorithms in Nonconvex Optimization , 2008 .

[26]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[27]  Mauricio Zambrano-Bigiarini,et al.  Standard Particle Swarm Optimisation 2011 at CEC-2013: A baseline for future PSO improvements , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  William W. Hager,et al.  Algorithm 851: CG_DESCENT, a conjugate gradient method with guaranteed descent , 2006, TOMS.

[29]  Rachid Ellaia,et al.  Continuous global optimization through the generation of parametric curves , 2016, Appl. Math. Comput..

[30]  Maojun Zhang,et al.  A three-terms Polak-Ribière-Polyak conjugate gradient algorithm for large-scale nonlinear equations , 2015, J. Comput. Appl. Math..

[31]  Gonglin Yuan,et al.  Modified nonlinear conjugate gradient methods with sufficient descent property for large-scale optimization problems , 2009, Optim. Lett..

[32]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[33]  Jason Brownlee,et al.  Clever Algorithms: Nature-Inspired Programming Recipes , 2012 .