An Enhanced Version of Black Hole Algorithm via Levy Flight for Optimization and Data Clustering Problems

The processes of retrieving useful information from a dataset are an important data mining technique that is commonly applied, known as Data Clustering. Recently, nature-inspired algorithms have been proposed and utilized for solving the optimization problems in general, and data clustering problem in particular. Black Hole (BH) optimization algorithm has been underlined as a solution for data clustering problems, in which it is a population-based metaheuristic that emulates the phenomenon of the black holes in the universe. In this instance, every solution in motion within the search space represents an individual star. The original BH has shown a superior performance when applied on a benchmark dataset, but it lacks exploration capabilities in some datasets. Addressing the exploration issue, this paper introduces the levy flight into BH algorithm to result in a novel data clustering method “Levy Flight Black Hole (LBH)”, which was then presented accordingly. In LBH, the movement of each star depends mainly on the step size generated by the Levy distribution. Therefore, the star explores an area far from the current black hole when the value step size is big, and vice versa. The performance of LBH in terms of finding the best solutions, prevent getting stuck in local optimum, and the convergence rate has been evaluated based on several unimodal and multimodal numerical optimization problems. Additionally, LBH is then tested using six real datasets available from UCI machine learning laboratory. The experimental outcomes obtained indicated the designed algorithm’s suitability for data clustering, displaying effectiveness and robustness.

[1]  Asgarali Bouyer,et al.  An Efficient Hybrid Clustering Method Using an Artificial Bee Colony Algorithm and Mantegna Lévy Distribution , 2016, Int. J. Artif. Intell. Tools.

[2]  Musheer Ahmad,et al.  Sine-Cosine Optimization-Based Bijective Substitution-Boxes Construction Using Enhanced Dynamics of Chaotic Map , 2018, Complex..

[3]  Adam P. Piotrowski,et al.  How novel is the "novel" black hole optimization approach? , 2014, Inf. Sci..

[4]  Mehmet Fatih Tasgetiren,et al.  A particle swarm optimization algorithm for makespan and total flowtime minimization in the permutation flowshop sequencing problem , 2007, Eur. J. Oper. Res..

[5]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[6]  Ibrahim Eksin,et al.  A new optimization method: Big Bang-Big Crunch , 2006, Adv. Eng. Softw..

[7]  V. Mani,et al.  Clustering Using Levy Flight Cuckoo Search , 2012, BIC-TA.

[8]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[9]  Z. Yaseen,et al.  Reference evapotranspiration prediction using hybridized fuzzy model with firefly algorithm: Regional case study in Burkina Faso , 2018, Agricultural Water Management.

[10]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[11]  Salwani Abdullah,et al.  Data Clustering Using Big Bang–Big Crunch Algorithm , 2011 .

[12]  Nadjet Kamel,et al.  A new quantum chaotic cuckoo search algorithm for data clustering , 2018, Expert Syst. Appl..

[13]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[14]  Peter Nielsen,et al.  Metaheuristic algorithms for balancing robotic assembly lines with sequence-dependent robot setup times , 2019, Applied Mathematical Modelling.

[15]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[16]  Omid Sojodishijani,et al.  A new hybrid algorithm based on black hole optimization and bisecting k-means for cluster analysis , 2014, 2014 22nd Iranian Conference on Electrical Engineering (ICEE).

[17]  Zaher Mundher Yaseen,et al.  Estimation the Physical Variables of Rainwater Harvesting System Using Integrated GIS-Based Remote Sensing Approach , 2016, Water Resources Management.

[18]  Varinder Singh,et al.  Krill Herd Clustering Algorithm using DBSCAN Technique , 2013 .

[19]  H. Bouchekara Optimal design of electromagnetic devices using a black-hole-based optimization technique , 2013, IEEE Transactions on Magnetics.

[20]  Tibor Gyires,et al.  LÉvy Flights and Fractal Modeling of Internet Traffic , 2009, IEEE/ACM Transactions on Networking.

[21]  Injong Rhee,et al.  On the levy-walk nature of human mobility , 2011, TNET.

[22]  B. Kulkarni,et al.  An ant colony approach for clustering , 2004 .

[23]  João Paulo Papa,et al.  Black Hole Algorithm for non-technical losses characterization , 2015, 2015 IEEE 6th Latin American Symposium on Circuits & Systems (LASCAS).

[24]  Q. Henry Wu,et al.  MCPSO: A multi-swarm cooperative particle swarm optimizer , 2007, Appl. Math. Comput..

[25]  Govind P. Gupta,et al.  Integrated clustering and routing protocol for wireless sensor networks using Cuckoo and Harmony Search based metaheuristic techniques , 2018, Eng. Appl. Artif. Intell..

[26]  B. Venkateswara Rao,et al.  Multi-Objective Optimal Power Flow Using Metaheuristic Optimization Algorithms With Unified Power Flow Controller to Enhance the Power System Performance , 2018 .

[27]  Charu C. Aggarwal,et al.  Data Clustering: Algorithms and Applications , 2014 .

[28]  Russell C. Eberhart,et al.  Gene clustering using self-organizing maps and particle swarm optimization , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[29]  Thomas A. Runkler Ant colony optimization of clustering models , 2005, Int. J. Intell. Syst..

[30]  Hossein Momeni,et al.  Black Holes Algorithm With Fuzzy Hawking Radiation , 2014 .

[31]  Sinan Q. Salih,et al.  Solving large-scale problems using multi-swarm particle swarm approach , 2018 .

[32]  P. Sopp Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[33]  Nizamettin Aydin,et al.  An application of black hole algorithm and decision tree for medical problem , 2015, 2015 IEEE 15th International Conference on Bioinformatics and Bioengineering (BIBE).

[34]  Dong-Ling Xu,et al.  Integrating meta-heuristics, simulation and exact techniques for production planning of a failure-prone manufacturing system , 2018, Eur. J. Oper. Res..

[35]  Sanjay Kumar Singh,et al.  Black Hole Algorithm and Its Applications , 2015, Computational Intelligence Applications in Modeling and Control.

[36]  Sinan Q. Salih,et al.  Shear strength of SFRCB without stirrups simulation: implementation of hybrid artificial intelligence model , 2018, Engineering with Computers.

[37]  Hossein Nezamabadi-pour,et al.  Black Hole: A New Operator for Gravitational Search Algorithm , 2014, Int. J. Comput. Intell. Syst..

[38]  Jianhua Wang,et al.  Optimal feature selection using distance-based discrete firefly algorithm with mutual information criterion , 2017, Neural Computing and Applications.

[39]  G. Wiselin Jiji,et al.  MBA-IF:A New Data Clustering Method Using Modified Bat Algorithm and Levy Flight , 2015, SOCO 2015.

[40]  Yunbo Chen,et al.  Research and simulation on Levy flight model for DTN , 2010, 2010 3rd International Congress on Image and Signal Processing.

[41]  Ahmad Sharafati,et al.  Development of multivariate adaptive regression spline integrated with differential evolution model for streamflow simulation , 2019, Journal of Hydrology.

[42]  Aida Mustapha,et al.  Bat Algorithm Based Hybrid Filter-Wrapper Approach , 2015, Adv. Oper. Res..

[43]  Mauricio Zambrano-Bigiarini,et al.  Standard Particle Swarm Optimisation 2011 at CEC-2013: A baseline for future PSO improvements , 2013, 2013 IEEE Congress on Evolutionary Computation.

[44]  R. Jensi,et al.  An improved krill herd algorithm with global exploration capability for solving numerical function optimization problems and its application to data clustering , 2016, Appl. Soft Comput..

[45]  Xin-She Yang,et al.  Engineering Optimizations via Nature-Inspired Virtual Bee Algorithms , 2005, IWINAC.

[46]  Salwani Abdullah,et al.  Kidney-inspired algorithm for optimization problems , 2017, Commun. Nonlinear Sci. Numer. Simul..

[47]  Xin-She Yang,et al.  Multiobjective cuckoo search for design optimization , 2013, Comput. Oper. Res..

[48]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[49]  Taher Niknam,et al.  Short-term scheduling of thermal power systems using hybrid gradient based modified teaching–learning optimizer with black hole algorithm , 2014 .

[50]  Musheer Ahmad,et al.  A novel efficient substitution-box design based on firefly algorithm and discrete chaotic map , 2018, Neural Computing and Applications.

[51]  Vijay Kumar,et al.  Grey Wolf Algorithm-Based Clustering Technique , 2017, J. Intell. Syst..

[52]  Xin-She Yang,et al.  Firefly Algorithm, Lévy Flights and Global Optimization , 2010, SGAI Conf..

[53]  Marko Sarstedt,et al.  Introduction to Market Research , 2018, Springer Texts in Business and Economics.

[54]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[55]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[56]  Salwani Abdullah,et al.  Application of Gravitational Search Algorithm on Data Clustering , 2011, RSKT.

[57]  K. Premalatha,et al.  A nature inspired swarm based stellar-mass black hole for engineering optimization , 2015, 2015 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT).

[58]  Abdolreza Hatamlou,et al.  An efficient hybrid clustering method based on improved cuckoo optimization and modified particle swarm optimization algorithms , 2018, Appl. Soft Comput..

[59]  P. A. Prince,et al.  Lévy flight search patterns of wandering albatrosses , 1996, Nature.

[60]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[61]  Sinan Q. Salih,et al.  Novel Multi-swarm Approach for Balancing Exploration and Exploitation in Particle Swarm Optimization , 2018, Advances in Intelligent Systems and Computing.

[62]  Babak Nasiri,et al.  A Novel History-driven Artificial Bee Colony Algorithm for Data Clustering , 2018, Appl. Soft Comput..

[63]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[64]  Inderveer Chana,et al.  A survey of clustering techniques for big data analysis , 2014, 2014 5th International Conference - Confluence The Next Generation Information Technology Summit (Confluence).

[65]  Hossein Nezamabadi-pour,et al.  GGSA: A Grouping Gravitational Search Algorithm for data clustering , 2014, Eng. Appl. Artif. Intell..

[66]  H. R. E. H. Bouchekara,et al.  Optimal power flow using black-hole-based optimization approach , 2014, Appl. Soft Comput..

[67]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[68]  Aida Mustapha,et al.  Natural extensions: Bat algorithm with memory , 2015 .

[69]  Vincent Kanade,et al.  Clustering Algorithms , 2021, Wireless RF Energy Transfer in the Massive IoT Era.

[70]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[71]  Hadj Batatia,et al.  A levy flight model for ultrasound in skin tissues , 2010, 2010 IEEE International Ultrasonics Symposium.

[72]  J. Klafter,et al.  Introduction to the Theory of Lévy Flights , 2008 .

[73]  Hamed Mojallali,et al.  Image gray-level enhancement using Black Hole algorithm , 2015, 2015 2nd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[74]  Jeng-Shyang Pan,et al.  Cat swarm optimization , 2006 .

[75]  Nizamettin Aydin,et al.  Binary black hole algorithm for feature selection and classification on biological data , 2017, Appl. Soft Comput..