Using machine learning in a cooperative hybrid parallel strategy of metaheuristics

This paper proposes the construction of a centralized hybrid metaheuristic cooperative strategy to solve optimization problems. Knowledge (intelligence) is incorporated into the coordinator to improve performance. This knowledge is incorporated through a set of rules and models obtained from a knowledge extraction process applied to the records of the results returned by individual metaheuristics. The effectiveness of the approach is tested in several computational experiments in which we compare the results obtained by the individual metaheuristics, by several non-cooperative and cooperative strategies and by the strategy proposed in this paper.

[1]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[2]  Peter I. Cowling,et al.  Mining the data from a hyperheuristic approach using associative classification , 2008, Expert Syst. Appl..

[3]  José Marcos Moreno Vega,et al.  Metaheuristicas: Una visión global , 2003, Inteligencia Artif..

[4]  Cheng-Fa Tsai,et al.  A new hybrid heuristic approach for solving large traveling salesman problem , 2004, Inf. Sci..

[5]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[6]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[7]  Haipeng Guo.  A Bayesian Approach for Automatic Algorithm Selection , 2003 .

[8]  José L. Verdegay,et al.  A Fuzzy Valuation-Based Local Search Framework for Combinatorial Problems , 2002, Fuzzy Optim. Decis. Mak..

[9]  John R. Rice,et al.  The Algorithm Selection Problem , 1976, Adv. Comput..

[10]  Sanja Petrovic,et al.  Knowledge Discovery in a Hyper-heuristic for Course Timetabling Using Case-Based Reasoning , 2002, PATAT.

[11]  Teodor Gabriel Crainic,et al.  Fleet management and logistics , 1998 .

[12]  Belén Melián-Batista,et al.  Metaheuristicas: Una visión global , 2003, Inteligencia Artif..

[13]  El-Ghazali Talbi,et al.  A Taxonomy of Hybrid Metaheuristics , 2002, J. Heuristics.

[14]  Griffin Caprio,et al.  Parallel Metaheuristics , 2008, IEEE Distributed Systems Online.

[15]  Teodor Gabriel Crainic,et al.  Parallel Strategies for Meta-Heuristics , 2003, Handbook of Metaheuristics.

[16]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[17]  Jun He,et al.  A hybrid artificial immune system and Self Organising Map for network intrusion detection , 2008, Inf. Sci..

[18]  William H. Hsu,et al.  A machine learning approach to algorithm selection for $\mathcal{NP}$ -hard optimization problems: a case study on the MPE problem , 2007, Ann. Oper. Res..

[19]  Carlos Cruz Corona,et al.  Using memory and fuzzy rules in a co-operative multi-thread strategy for optimization , 2006, Inf. Sci..

[20]  S. Martello,et al.  Dynamic Programming and Strong Bounds for the 0-1 Knapsack Problem , 1999 .

[21]  Lotfi A. Zadeh,et al.  Is there a need for fuzzy logic? , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[22]  David Pisinger,et al.  Where are the hard knapsack problems? , 2005, Comput. Oper. Res..

[23]  Piero P. Bonissone,et al.  On heuristics as a fundamental constituent of soft computing , 2008, Fuzzy Sets Syst..

[24]  T. Crainic,et al.  Parallel Meta-Heuristics , 2010 .

[25]  Pedro S. de Souza,et al.  Asynchronous organizations for multi-algorithm problems , 1993, SAC '93.

[26]  Kwang Mong Sim,et al.  Collaborative assignment using belief-desire-intention agent modeling and negotiation with speedup strategies , 2008, Inf. Sci..

[27]  Pierre Hansen,et al.  Cooperative Parallel Variable Neighborhood Search for the p-Median , 2004, J. Heuristics.

[28]  Berthold Vöcking,et al.  An Experimental Study of Random Knapsack Problems , 2004, ESA.

[29]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[30]  David A. Cohn,et al.  Improving generalization with active learning , 1994, Machine Learning.

[31]  Teodor Gabriel Crainic,et al.  A cooperative parallel meta-heuristic for the vehicle routing problem with time windows , 2005, Comput. Oper. Res..

[32]  Cezary Z. Janikow,et al.  Fuzzy decision trees: issues and methods , 1998, IEEE Trans. Syst. Man Cybern. Part B.