Unconstrained real valued optimization based on stochastic differential equations

A new approach of finding optimal variables to continuous, real valued functions is outlined. The technique is simple to implement, and does not require multiple instances of the variables or knowledge of the cost function derivative. The variable update is governed by the numerical solution to a specific stochastic differential equation. A number of parameters can be changed to alter the manner in which the variables are updated. Different parameter choices lead to changes in the rate and manner of convergence to the optimal solution. Test functions are used to establish method performance. Results show that the method is competitive with established approaches.

[1]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[2]  Scott Kirkpatrick,et al.  Optimization by simulated annealing: Quantitative studies , 1984 .

[3]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[4]  Berç Rustem,et al.  Linearly Constrained Global Optimization and Stochastic Differential Equations , 2006, J. Glob. Optim..

[5]  L. Rogers Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[6]  I ScottKirkpatrick Optimization by Simulated Annealing: Quantitative Studies , 1984 .

[7]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[8]  David H. Ackley,et al.  An empirical study of bit vector function optimization , 1987 .

[9]  池田 信行,et al.  Stochastic differential equations and diffusion processes , 1981 .

[10]  Günter Rudolph,et al.  An Evolutionary Algorithm for Integer Programming , 1994, PPSN.

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  A. Griewank Generalized descent for global optimization , 1981 .

[13]  Chang Wook Ahn,et al.  On the practical genetic algorithms , 2005, GECCO '05.

[14]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[15]  F. Aluffi-Pentini,et al.  Global optimization and stochastic differential equations , 1985 .

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[18]  G. Hogg,et al.  UNCONSTRAINED DISCRETE NONLINEAR PROGRAMMING , 1979 .