VARIANCE-BASED HARMONY SEARCH ALGORITHM FOR UNIMODAL AND MULTIMODAL OPTIMIZATION PROBLEMS WITH APPLICATION TO CLUSTERING

This article presents a novel variance-based harmony search algorithm (VHS) for solving optimization problems. VHS incorporates the concepts borrowed from the invasive weed optimization technique to improve the performance of the harmony search algorithm (HS). This eliminates the main problem of constant parameter setting in the algorithm proposed recently and named as explorative HS. It uses the variance of a current population as well as presents a solution vector to improvise the harmony memory. In addition, the dynamic pitch adjustment operator is used to avoid solution oscillation. The proposed algorithm is evaluated on 14 standard benchmark functions of various characteristics. The performance of the proposed algorithm is investigated and compared with classical HS, an improved version of HS, the global best HS, self-adaptive HS, explorative HS, and the recently proposed state-of-art gravitational search algorithm. Experimental results reveal that the proposed algorithm outperforms the above-mentioned approaches. The effects of scalability, noise, harmony memory size, and harmony memory consideration rate have also been investigated with the proposed algorithm. The proposed algorithm is then employed for a data clustering problem. Four real-life datasets selected from the UCI machine learning repository have been used. The results indicate that the VHS-based clustering outperforms the existing well-known clustering algorithms.

[1]  Nima Taherinejad,et al.  Highly reliable harmony search algorithm , 2009, 2009 European Conference on Circuit Theory and Design.

[2]  Mahamed G. H. Omran,et al.  Global-best harmony search , 2008, Appl. Math. Comput..

[3]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[4]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[5]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[6]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[7]  Thomas Stützle,et al.  Local search algorithms for combinatorial problems - analysis, improvements, and new applications , 1999, DISKI.

[8]  Zong Woo Geem,et al.  Application of Harmony Search to Vehicle Routing , 2005 .

[9]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[10]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[11]  Hassan Abolhassani,et al.  Harmony K-means algorithm for document clustering , 2009, Data Mining and Knowledge Discovery.

[12]  Liaquat Hossain,et al.  Application of Harmony Search Algorithm on Clustering , 2010 .

[13]  Xin-She Yang Harmony Search as a Metaheuristic Algorithm , 2009 .

[14]  Ali Kattan,et al.  Harmony Search Based Supervised Training of Artificial Neural Networks , 2010, 2010 International Conference on Intelligent Systems, Modelling and Simulation.

[15]  Caro Lucas,et al.  A novel numerical optimization algorithm inspired from weed colonization , 2006, Ecol. Informatics.

[16]  Mandava Rajeswari,et al.  The variants of the harmony search algorithm: an overview , 2011, Artificial Intelligence Review.

[17]  Bijaya K. Panigrahi,et al.  Exploratory Power of the Harmony Search Algorithm: Analysis and Improvements for Global Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Ajith Abraham,et al.  An Improved Harmony Search Algorithm with Differential Mutation Operator , 2009, Fundam. Informaticae.

[19]  Fredric C. Gey,et al.  The Relationship between Recall and Precision , 1994, J. Am. Soc. Inf. Sci..

[20]  Yin-Fu Huang,et al.  Self-adaptive harmony search algorithm for optimization , 2010, Expert Syst. Appl..

[21]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[22]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .