A Novel Optimization Algorithm: The Forest Algorithm

A new optimization algorithm, namely the Forest Algorithm (FA), is introduced for the first time. This algorithm simulates trees' growth, reproduction and death in a forest to perform optimization. In the algorithm, trees and branches represent a collection of trial solutions and parameters needed to be optimized respectively, and three mechanisms, i.e. Growth, proliferation and death, are employed for improving trees' vitality, which is a factor defined to evaluate the fitness of trial solutions. This algorithm in general execute a global optimization by operating on a group of trial solutions in parallel, but its growth mechanism, which adopts a parameter sweeping method, is a local optimization, so it combines the ability to find global optima of the global optimization and the fast convergence of the local optimization. Several numerical experiments are conducted, in which the performance of the FA in terms of the global optimization capability, accuracy and efficiency is evaluated and compared to that of some widely-used global optimization algorithms such as the Genetic Algorithm (GA) and the Particle Swarm Optimization (PSO). Results shown the FA is able to perform global optimization effectively and with high accuracy.

[1]  Guanzheng Tan,et al.  A Novel Simplex Hybrid Genetic Algorithm , 2008, 2008 The 9th International Conference for Young Computer Scientists.

[2]  John A. Miller,et al.  An evaluation of local improvement operators for genetic algorithms , 1993, IEEE Trans. Syst. Man Cybern..

[3]  Junjun Li,et al.  A Modified Particle Swarm Optimization Algorithm , 2004, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[4]  C. W. Hirt,et al.  Volume of fluid (VOF) method for the dynamics of free boundaries , 1981 .

[5]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[6]  Ali M. S. Zalzala,et al.  Recent developments in evolutionary and genetic algorithms: theory and applications , 1997 .

[7]  Christian Blum,et al.  Ant Colony Optimization: Introduction and Hybridizations , 2007, 7th International Conference on Hybrid Intelligent Systems (HIS 2007).

[8]  J. Clegg,et al.  The use of a genetic algorithm to optimize the functional form of a multi-dimensional polynomial fit to experimental data , 2005, 2005 IEEE Congress on Evolutionary Computation.

[9]  Y. Tan,et al.  Clonal particle swarm optimization and its applications , 2007, 2007 IEEE Congress on Evolutionary Computation.

[10]  Shanlin Yang,et al.  An Ant Colony Model for Dynamic Mining of Users Interest Navigation Patterns , 2007, 2007 IEEE International Conference on Control and Automation.

[11]  M. Zhang,et al.  Particle swarm optimisation for object classification , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[12]  Shi Zhong-ke Application of Particle Swarm Optimization method in function optimization and parameter analysis , 2008 .

[13]  S. Supratid,et al.  Modifying Ant Colony Optimization , 2008, 2008 IEEE Conference on Soft Computing in Industrial Applications.

[14]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[15]  W. Jenkins,et al.  Adaptive filtering via particle swarm optimization , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[16]  Li Qing Improved Ant Colony Algorithm and Simulation for Continuous Function Optimization , 2009 .

[17]  Bo Li,et al.  The Particle Swarm Optimization Algorithm: How to Select the Number of Iteration , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[18]  Meng Wang,et al.  A New Classification Arithmetic for Multi-Image Classification in Genetic Programming , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[19]  B. L. Walcott,et al.  Stability and optimality in genetic algorithm controllers , 1996, Proceedings of the 1996 IEEE International Symposium on Intelligent Control.