A clustering algorithm applied to the binarization of Swarm intelligence continuous metaheuristics

Abstract The binarization of Swarm intelligence continuous metaheuristics is an area of great interest in operations research. This interest is mainly due to the application of binarized metaheuristics to combinatorial problems. In this article we propose a general binarization algorithm called K-means Transition Algorithm (KMTA). KMTA uses K-means clustering technique as learning strategy to perform the binarization process. In particular we apply this mechanism to Cuckoo Search and Black Hole metaheuristics to solve the Set Covering Problem (SCP). A methodology is developed to perform the tuning of parameters. We provide necessary experiments to investigate the role of key ingredients of the algorithm. In addition, with the intention of evaluating the behavior of the binarizations while the algorithms are executed, we use the Page's trend test. Finally to demonstrate the efficiency of our proposal, Set Covering benchmark instances of the literature show that KMTA competes clearly with the state-of-the-art algorithms.

[1]  Zhijing Yang,et al.  Binary artificial algae algorithm for multidimensional knapsack problems , 2016, Appl. Soft Comput..

[2]  Mohammad Reza Akbarzadeh Totonchi,et al.  Magnetic Optimization Algorithms, a New Synthesis , 2008 .

[3]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[4]  Jui-Sheng Chou,et al.  Shear Strength Prediction in Reinforced Concrete Deep Beams Using Nature-Inspired Metaheuristic Support Vector Regression , 2016, J. Comput. Civ. Eng..

[5]  Sheizaf Rafaeli,et al.  Off the Radar: Comparative Evaluation of Radial Visualization Solutions for Composite Indicators , 2016, IEEE Transactions on Visualization and Computer Graphics.

[6]  Glaydston Mattos Ribeiro,et al.  A mathematical model and a Clustering Search metaheuristic for planning the helicopter transportation of employees to the production platforms of oil and gas , 2016, Comput. Ind. Eng..

[7]  Anita Schöbel,et al.  An eigenmodel for iterative line planning, timetabling and vehicle scheduling in public transportation , 2017 .

[8]  Broderick Crawford,et al.  Solving the non-unicost set covering problem by using cuckoo search and black hole optimization , 2017, Natural Computing.

[9]  Marjan Mernik,et al.  Parameter tuning with Chess Rating System (CRS-Tuning) for meta-heuristic algorithms , 2016, Inf. Sci..

[10]  Yunong Zhang,et al.  Discrete quantum-behaved particle swarm optimization based on estimation of distribution for combinatorial optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  Andreas Zell,et al.  A Clustering Based Niching Method for Evolutionary Algorithms , 2003, GECCO.

[13]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[14]  Marek Chrobak,et al.  Probe selection algorithms with applications in the analysis of microbial communities , 2001, ISMB.

[15]  Gexiang Zhang,et al.  Quantum-inspired evolutionary algorithms: a survey and empirical study , 2011, J. Heuristics.

[16]  Jui-Sheng Chou,et al.  Forward Forecast of Stock Price Using Sliding-Window Metaheuristic-Optimized Machine-Learning Regression , 2018, IEEE Transactions on Industrial Informatics.

[17]  Abdesslem Layeb,et al.  A Novel Quantum Inspired Cuckoo Search Algorithm for Bin Packing Problem , 2012 .

[18]  T. Yalcinoz,et al.  Power economic dispatch using a hybrid genetic algorithm , 2001 .

[19]  Athanasios V. Vasilakos,et al.  Accelerated PSO Swarm Search Feature Selection for Data Stream Mining Big Data , 2016, IEEE Transactions on Services Computing.

[20]  José García,et al.  A Percentile Transition Ranking Algorithm Applied to Binarization of Continuous Swarm Intelligence Metaheuristics , 2018, SCDM.

[21]  Mohamed Haouari,et al.  Solving a large-scale integrated fleet assignment and crew pairing problem , 2017, Ann. Oper. Res..

[22]  M. Carmen Garrido,et al.  Using machine learning in a cooperative hybrid parallel strategy of metaheuristics , 2009, Inf. Sci..

[23]  J. Beasley An algorithm for set covering problem , 1987 .

[24]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[25]  Kenneth de Jong Parameter Setting in EAs: a 30 Year Perspective , 2007 .

[26]  Li Xiao,et al.  An Optimizing Method Based on Autonomous Animats: Fish-swarm Algorithm , 2002 .

[27]  E. B. Page Ordered Hypotheses for Multiple Treatments: A Significance Test for Linear Ranks , 1963 .

[28]  José García,et al.  A k-means binarization framework applied to multidimensional knapsack problem , 2018, Applied Intelligence.

[29]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[30]  Toshihide Ibaraki,et al.  Logical analysis of numerical data , 1997, Math. Program..

[31]  Yun Lu,et al.  An OR Practitioner's Solution Approach for the Set Covering Problem , 2015, Int. J. Appl. Metaheuristic Comput..

[32]  Andrew Lewis,et al.  How important is a transfer function in discrete heuristic algorithms , 2015, Neural Computing and Applications.

[33]  Broderick Crawford,et al.  A Percentile Transition Ranking Algorithm Applied to Knapsack Problem , 2017 .

[34]  Broderick Crawford,et al.  A Binary Cat Swarm Optimization Algorithm for the Non-Unicost Set Covering Problem , 2015 .

[35]  Broderick Crawford,et al.  Analyzing the effects of binarization techniques when solving the set covering problem through swarm optimization , 2017, Expert Syst. Appl..

[36]  João Paulo Papa,et al.  Fine-tuning enhanced probabilistic neural networks using metaheuristic-driven optimization , 2016 .

[37]  Jui-Sheng Chou,et al.  Metaheuristic optimization within machine learning-based classification system for early warnings related to geotechnical problems , 2016 .

[38]  D.G. Robinson Reliability analysis of bulk power systems using swarm intelligence , 2005, Annual Reliability and Maintainability Symposium, 2005. Proceedings..

[39]  Azah Mohamed,et al.  An effective power quality monitor placement method utilizing quantum-inspired particle swarm optimization , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[40]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[41]  J. Beasley A lagrangian heuristic for set‐covering problems , 1990 .

[42]  Shuyuan Yang,et al.  A quantum particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[43]  Broderick Crawford,et al.  A Binary Cuckoo Search Algorithm for Solving the Set Covering Problem , 2015, IWINAC.

[44]  Jin-Hua Zheng,et al.  Heuristic Evolutionary Approach for Weighted Circles Layout , 2010, ISIA.

[45]  Francisco Herrera,et al.  Analyzing convergence performance of evolutionary algorithms: A statistical approach , 2014, Inf. Sci..

[46]  Ender Özcan,et al.  A tensor based hyper-heuristic for nurse rostering , 2016, Knowl. Based Syst..

[47]  Andries Petrus Engelbrecht,et al.  Critical considerations on angle modulated particle swarm optimisers , 2015, Swarm Intelligence.

[48]  Angel A. Juan,et al.  A multi-agent based cooperative approach to scheduling and routing , 2016, Eur. J. Oper. Res..

[49]  Abdolreza Hatamlou,et al.  Black hole: A new heuristic optimization approach for data clustering , 2013, Inf. Sci..

[50]  E. Balas,et al.  Set Partitioning: A survey , 1976 .

[51]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[52]  Hande Öztop,et al.  A Bus Crew Scheduling Problem with Eligibility Constraints and Time Limitations , 2017 .

[53]  G. Pamparà,et al.  Angle modulated population based algorithms to solve binary problems , 2012 .

[54]  Wen-Tsao Pan,et al.  A new Fruit Fly Optimization Algorithm: Taking the financial distress model as an example , 2012, Knowl. Based Syst..

[55]  Athanasios V. Vasilakos,et al.  Multi-user detection in multi-carrier CDMA wireless broadband system using a binary adaptive differential evolution algorithm , 2013, GECCO '13.

[56]  Ulrich Wilhelm Thonemann,et al.  Optimizing railway crew schedules with fairness preferences , 2016, Journal of Scheduling.

[57]  Egon Balas,et al.  A Dynamic Subgradient-Based Branch-and-Bound Procedure for Set Covering , 1992, Oper. Res..

[58]  Udo Buscher,et al.  Solving Practical Railway Crew Scheduling Problems with Attendance Rates , 2017, Bus. Inf. Syst. Eng..

[59]  R. J. Kuo,et al.  Application of metaheuristics-based clustering algorithm to item assignment in a synchronized zone order picking system , 2016, Appl. Soft Comput..

[60]  Kate Smith-Miles,et al.  Towards objective measures of algorithm performance across instance space , 2014, Comput. Oper. Res..

[61]  Matteo Fischetti,et al.  A Heuristic Method for the Set Covering Problem , 1999, Oper. Res..

[62]  Pedro Augusto Munari,et al.  An exact hybrid method for the vehicle routing problem with time windows and multiple deliverymen , 2017, Comput. Oper. Res..

[63]  Ender Özcan,et al.  Improving performance of a hyper-heuristic using a multilayer perceptron for vehicle routing , 2015 .

[64]  Michael J. Brusco,et al.  A morphing procedure to supplement a simulated annealing heuristic for cost‐ andcoverage‐correlated set‐covering problems , 1999, Ann. Oper. Res..

[65]  Thomas Stützle,et al.  The Ant Colony Optimization Metaheuristic: Algorithms, Applications, and Advances , 2003 .

[66]  Lúcia Maria de A. Drummond,et al.  Combining an evolutionary algorithm with data mining to solve a single-vehicle routing problem , 2006, Neurocomputing.

[67]  Palvinder Singh Mann,et al.  Energy efficient clustering protocol based on improved metaheuristic in wireless sensor networks , 2017, J. Netw. Comput. Appl..

[68]  Patrick Beullens,et al.  A semi-automated design of instance-based fuzzy parameter tuning for metaheuristics based on decision tree induction , 2015, J. Oper. Res. Soc..

[69]  S. Balaji,et al.  A new approach for solving set covering problem using jumping particle swarm optimization method , 2015, Natural Computing.

[70]  M. M. Abdel Aziz,et al.  A Binary Particle Swarm Optimization for Optimal Placement and Sizing of Capacitor Banks in Radial Distribution Feeders with Distorted Substation Voltages , 2006 .

[71]  Xiyu Liu,et al.  In search of the essential binary discrete particle swarm , 2011, Appl. Soft Comput..

[72]  Jui-Sheng Chou,et al.  Nature-inspired metaheuristic optimization in least squares support vector regression for obtaining bridge scour information , 2017, Inf. Sci..

[73]  José García,et al.  A Multi Dynamic Binary Black Hole Algorithm Applied to Set Covering Problem , 2017, ICHSA.

[74]  Sumaiya Iqbal,et al.  Solving the multi-objective Vehicle Routing Problem with Soft Time Windows with the help of bees , 2015, Swarm Evol. Comput..

[75]  Amer Draa,et al.  Binary Bat Algorithm: On The Efficiency of Mapping Functions When Handling Binary Problems Using Continuous-variable-based Metaheuristics , 2015, CIIA.

[76]  Rajesh Kumar,et al.  An efficient two-level swarm intelligence approach for RNA secondary structure prediction with bi-objective minimum free energy scores , 2016, Swarm Evol. Comput..

[77]  J. Beasley,et al.  A genetic algorithm for the set covering problem , 1996 .

[78]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[79]  Lars Kotthoff,et al.  Algorithm Selection for Combinatorial Search Problems: A Survey , 2012, AI Mag..

[80]  Adam P. Piotrowski,et al.  Searching for structural bias in particle swarm optimization and differential evolution algorithms , 2016, Swarm Intelligence.

[81]  Jason A. D. Atkin,et al.  A Population-Based Incremental Learning Method for Constrained Portfolio Optimisation , 2014, 2014 16th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[82]  Broderick Crawford,et al.  A 2-level Metaheuristic for the Set Covering Problem , 2014, Int. J. Comput. Commun. Control.

[83]  Abdesslem Layeb,et al.  A novel quantum inspired cuckoo search for knapsack problems , 2011, Int. J. Bio Inspired Comput..

[84]  Malay Kule,et al.  A cryptanalytic attack on the knapsack cryptosystem using binary Firefly algorithm , 2011, 2011 2nd International Conference on Computer and Communication Technology (ICCCT-2011).

[85]  Yi Mao,et al.  The unit commitment problem based on an improved firefly and particle swarm optimization hybrid algorithm , 2013, 2013 Chinese Automation Congress.

[86]  Jing Zhao,et al.  A Binary Quantum-behaved Particle Swarm Optimization Algorithm with Cooperative Approach , 2013 .

[87]  K. Chandrasekaran,et al.  Network and reliability constrained unit commitment problem using binary real coded firefly algorithm , 2012 .

[88]  Jaya Sil,et al.  Selection of appropriate metaheuristic algorithms for protein structure prediction in AB off-lattice model: a perspective from fitness landscape analysis , 2017, Inf. Sci..

[89]  Mohd Ridzwan Yaakub,et al.  Metaheuristic algorithms for feature selection in sentiment analysis , 2015, 2015 Science and Information Conference (SAI).

[90]  Rong Su,et al.  Jaya, harmony search and water cycle algorithms for solving large-scale real-life urban traffic light scheduling problem , 2017, Swarm Evol. Comput..

[91]  Ankit Pat,et al.  An adaptive quantum-inspired differential evolution algorithm for 0–1 knapsack problem , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[92]  Min Chen,et al.  Metaheuristic Algorithms for Healthcare: Open Issues and Challenges , 2016, Comput. Electr. Eng..

[93]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[94]  Belén Melián-Batista,et al.  A Machine Learning-based system for berth scheduling at bulk terminals , 2017, Expert Syst. Appl..

[95]  Gilbert Laporte,et al.  An adaptive neighborhood search metaheuristic for the integrated railway rapid transit network design and line planning problem , 2017, Comput. Oper. Res..

[96]  Wenxin Liu,et al.  Angle Modulated Particle Swarm Optimization Based Defensive Islanding of Large Scale Power Systems , 2007, 2007 IEEE Power Engineering Society Conference and Exposition in Africa - PowerAfrica.

[97]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[98]  Abdesslem Layeb,et al.  A hybrid quantum inspired harmony search algorithm for 0-1 optimization problems , 2013, J. Comput. Appl. Math..

[99]  Xin Chen,et al.  An improved monkey algorithm for a 0-1 knapsack problem , 2016, Appl. Soft Comput..

[100]  José García,et al.  Putting Continuous Metaheuristics to Work in Binary Search Spaces , 2017, Complex..

[101]  Ferani E. Zulvia,et al.  An application of a metaheuristic algorithm-based clustering ensemble method to APP customer segmentation , 2016, Neurocomputing.

[102]  Robertas Damasevicius,et al.  State Flipping Based Hyper-Heuristic for Hybridization of Nature Inspired Algorithms , 2017, ICAISC.

[103]  Ujjwal Maulik,et al.  New quantum inspired meta-heuristic techniques for multi-level colour image thresholding , 2016, Appl. Soft Comput..