Generalized Simulated Annealing

Many problems in mathematics, statistics, finance, biology, pharmacology, physics, applied mathematics, economics, and chemistry involve the determination of the global minimum of multidimensional real-valued functions. Simulated annealing methods have been widely used for different global optimization problems. Multiple versions of simulated annealing have been developed, including classical simulated annealing (CSA), fast simulated annealing (FSA), and generalized simulated annealing (GSA). After revisiting the basic idea of GSA using Tsallis statistics, we implemented a modified GSA approach using the R package GenSA. This package was designed to solve complicated nonlinear objective functions with a large number of local minima. In this chapter, we provide a brief introduction to this R package and demonstrate its utility by solving non-convexoptimization problems in different fields: physics, environmental science, and finance. We performed a comprehensive comparison between GenSA and other widely used R packages, including rgenoud and DEoptim. GenSA is useful and can provide a solution that is comparable with or even better than that provided by other widely used R packages for optimization.

[1]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[2]  M. Duran Toksari,et al.  Ant colony optimization for finding the global minimum , 2006, Appl. Math. Comput..

[3]  David Ardia,et al.  DEoptim: An R Package for Global Optimization by Differential Evolution , 2009 .

[4]  D Cvijovicacute,et al.  Taboo search: an approach to the multiple minima problem. , 1995, Science.

[5]  O. Richter,et al.  Guidance Document on Estimating Persistence and Degradation Kinetics from Environmental Fate Studies on Pesticides in EU Registration , 2006 .

[6]  Jorge Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[7]  J. Nash.  Compact Numerical Methods for Computers , 2018 .

[8]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[9]  Maxime Caron,et al.  Designing small multiple-target artificial RNAs , 2010, Nucleic acids research.

[10]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Xiang,et al.  Efficiency of generalized simulated annealing , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[12]  Katharine M. Mullen,et al.  Continuous Global Optimization in R , 2014 .

[13]  Williams,et al.  Method of constrained global optimization. , 1994, Physical review letters.

[14]  C. Tsallis,et al.  Generalized simulated annealing , 1995, cond-mat/9501047.

[15]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[16]  Fred W. Glover,et al.  A user's guide to tabu search , 1993, Ann. Oper. Res..

[17]  M. R. Lemes,et al.  Generalized simulated annealing: Application to silicon clusters , 1997 .

[18]  T. Erber,et al.  Equilibrium configurations of N equal charges on a sphere , 1991 .

[19]  David J. Wales,et al.  Structure and dynamics of spherical crystals characterized for the Thomson problem , 2006 .

[20]  X. Gong,et al.  Generalized simulated annealing algorithm and its application to the Thomson model , 1997 .

[21]  Antonio Pérez-Garrido,et al.  Defect-free global minima in Thomson's problem of charges on a sphere. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Sabre Kais,et al.  Comparison study of pivot methods for global optimization , 1997 .

[23]  H. Szu.  Fast simulated annealing , 1987 .

[24]  D. Draper,et al.  Stochastic Optimization: a Review , 2002 .

[25]  Marcelo A. Moret,et al.  Generalized simulated annealing applied to protein folding studies , 2006, J. Comput. Chem..

[26]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[27]  D. M. Deaven,et al.  Genetic-algorithm energy minimization for point charges on a sphere. , 1996, Physical review. B, Condensed matter.

[28]  Yang Xiang,et al.  Generalized Simulated Annealing for Global Optimization: The GenSA Package , 2013, R J..

[29]  X. Gong,et al.  Generalized Simulated Annealing Studies on Structures and Properties of Nin (n ) 2-55) Clusters , 2000 .

[30]  David J. Wales,et al.  Defect motifs for spherical topologies , 2009 .

[31]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.