Improvement of harmony search algorithm by using statistical analysis

In this article, we suggest a new method to improve the harmony search meta-heuristic algorithm. Several approaches are presented for improving the harmony search algorithm. These approaches consider different values for initial parameters in each optimization problem. Differences between the proposed algorithm and the harmony search algorithm are as follows. First, we add a new step to create a new harmony vector, which increases the accuracy and convergence rate and reduces the impact of the initial parameters in achieving an optimal solution. Second, we set introduce a parameter called bandwidth (bw), which is an important factor with great influence on the convergence rate toward optimal solutions. To prove the efficiency and robustness of the proposed algorithm, we argument about statistical analysis of proposed algorithm and examine it through a variety of optimization problems, including constrained and unconstrained functions, mathematical problems with high dimensions and engineering and reliability problems. In all of these problems, the convergence rate and accuracy of the answer are equal to or better than other methods. In addition, in our proposed method, the effect of initial parameters has been reduced with respect to the optimal solution.

[1]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[2]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[3]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[4]  Dexuan Zou,et al.  A novel global harmony search algorithm for reliability problems , 2010, Comput. Ind. Eng..

[5]  David B. Fogel,et al.  A Comparison of Evolutionary Programming and Genetic Algorithms on Selected Constrained Optimization Problems , 1995, Simul..

[6]  Way Kuo,et al.  Reliability optimization of coherent systems , 2000, IEEE Trans. Reliab..

[7]  K. Lee,et al.  A new metaheuristic algorithm for continuous engineering optimization : harmony search theory and practice , 2005 .

[8]  R. G. Fenton,et al.  A Comparison of Numerical Optimization Methods for Engineering Design , 1974 .

[9]  J. Golinski,et al.  An adaptive optimization system applied to machine synthesis , 1973 .

[10]  Leandro dos Santos Coelho,et al.  An efficient particle swarm approach for mixed-integer programming in reliability-redundancy optimization applications , 2009, Reliab. Eng. Syst. Saf..

[11]  Panos Y. Papalambros,et al.  PRODUCTION SYSTEM FOR USE OF GLOBAL OPTIMIZATION KNOWLEDGE. , 1985 .

[12]  M. Jaberipour,et al.  Two improved harmony search algorithms for solving engineering optimization problems , 2010 .

[13]  A. Dhingra Optimal apportionment of reliability and redundancy in series systems under multiple objectives , 1992 .

[14]  K. M. Ragsdell,et al.  Optimal Design of a Class of Welded Structures Using Geometric Programming , 1976 .

[15]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[16]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[17]  Y. Hsieh,et al.  Genetic algorithms for reliability design problems , 1998 .

[18]  M. Mahdavi,et al.  ARTICLE IN PRESS Available online at www.sciencedirect.com , 2007 .

[19]  Mitsuo Gen,et al.  Soft computing approach for reliability optimization: State-of-the-art survey , 2006, Reliab. Eng. Syst. Saf..

[20]  Mitsuo Gen,et al.  Genetic algorithm for non-linear mixed integer programming problems and its applications , 1996 .

[21]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[22]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[23]  Frank P. Hwang,et al.  A comparative study of nonlinear programming routines on the microcomputer versus the large computer , 1984 .

[24]  Ta-Cheng Chen,et al.  IAs based approach for reliability redundancy allocation problems , 2006, Appl. Math. Comput..

[25]  S. Wu,et al.  GENETIC ALGORITHMS FOR NONLINEAR MIXED DISCRETE-INTEGER OPTIMIZATION PROBLEMS VIA META-GENETIC PARAMETER OPTIMIZATION , 1995 .

[26]  H. Narihisa,et al.  Reliability optimization of systems by a surrogate-constraints algorithm , 1992 .

[27]  Jan Golinski,et al.  Optimal synthesis problems solved by means of nonlinear programming and random methods , 1970 .

[28]  Yin-Fu Huang,et al.  Self-adaptive harmony search algorithm for optimization , 2010, Expert Syst. Appl..

[29]  Mahamed G. H. Omran,et al.  Global-best harmony search , 2008, Appl. Math. Comput..

[30]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[31]  H. Zimmermann Towards global optimization 2: L.C.W. DIXON and G.P. SZEGÖ (eds.) North-Holland, Amsterdam, 1978, viii + 364 pages, US $ 44.50, Dfl. 100,-. , 1979 .

[32]  E. Sandgren,et al.  Nonlinear Integer and Discrete Programming in Mechanical Design Optimization , 1990 .

[33]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[34]  Zong Woo Geem,et al.  Novel derivative of harmony search algorithm for discrete design variables , 2008, Appl. Math. Comput..

[35]  Renata Sotirov,et al.  Towards global optimization of constant rebalanced portfolio , 2012 .