A Learning Automata-Based Multiobjective Hyper-Heuristic

Metaheuristics, being tailored to each particular domain by experts, have been successfully applied to many computationally hard optimization problems. However, once implemented, their application to a new problem domain or a slight change in the problem description would often require additional expert intervention. There is a growing number of studies on reusable cross-domain search methodologies, such as selection hyper-heuristics, which are applicable to problem instances from various domains, requiring minimal expert intervention or even none. This paper introduces a new learning automata-based selection hyper-heuristic controlling a set of multiobjective metaheuristics. The approach operates above three well-known multiobjective evolutionary algorithms and mixes them, exploiting the strengths of each algorithm. The performance and behavior of two variants of the proposed selection hyper-heuristic, each utilizing a different initialization scheme are investigated across a range of unconstrained multiobjective mathematical benchmark functions from two different sets and the real-world problem of vehicle crashworthiness. The empirical results illustrate the effectiveness of our approach for cross-domain search, regardless of the initialization scheme, on those problems when compared to each individual multiobjective algorithm. Moreover, both variants perform significantly better than some previously proposed selection hyper-heuristics for multiobjective optimization, thus significantly enhancing the opportunities for improved multiobjective optimization.

[1]  Lamjed Ben Said,et al.  Many-objective Optimization Using Evolutionary Algorithms: A Survey , 2017, Recent Advances in Evolutionary Multi-objective Optimization.

[2]  Michael O'Neill,et al.  Grammatical Evolution: Evolving Programs for an Arbitrary Language , 1998, EuroGP.

[3]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[4]  A CharanKumari,et al.  Scheduling and Inspection Planning in Software Development Projects Using Multi-Objective Hyper-Heuristic Evolutionary Algorithm , 2013 .

[5]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[6]  Gian Mauricio Fritsche,et al.  A Hyper-Heuristic for the Multi-Objective Integration and Test Order Problem , 2015, GECCO.

[7]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. I. A unified formulation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Gang Chen,et al.  Many-objective genetic programming for job-shop scheduling , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[9]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[10]  Gabriela Ochoa,et al.  A benchmark set extension and comparative study for the HyFlex framework , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[11]  Sanja Petrovic,et al.  A mixture experiments multi-objective hyper-heuristic , 2013, J. Oper. Res. Soc..

[12]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[13]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[14]  Pramod K. Varshney,et al.  A Multiobjective Optimization Approach to Obtain Decision Thresholds for Distributed Detection in Wireless Sensor Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Graham Kendall,et al.  An experimental study of hyper-heuristic selection and acceptance mechanism for combinatorial t-way test suite generation , 2017, Inf. Sci..

[16]  Patrick De Causmaecker,et al.  Boosting Metaheuristic Search Using Reinforcement Learning , 2013, Hybrid Metaheuristics.

[17]  Abdul Razak Hamdan,et al.  Taguchi-Based Parameter Designing of Genetic Algorithm for Artificial Neural Network Training , 2013, 2013 International Conference on Informatics and Creative Multimedia.

[18]  Bilal Alatas,et al.  MODENAR: Multi-objective differential evolution algorithm for mining numeric association rules , 2008, Appl. Soft Comput..

[19]  B. John Oommen,et al.  Graph Partitioning Using Learning Automata , 1996, IEEE Trans. Computers.

[20]  Alexander Nareyek,et al.  Choosing search heuristics by non-stationary reinforcement learning , 2004 .

[21]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[22]  Qingfu Zhang,et al.  Combining Model-based and Genetics-based Offspring Generation for Multi-objective Optimization Using a Convergence Criterion , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  Jasper A Vrugt,et al.  Improved evolutionary optimization from genetically adaptive multimethod search , 2007, Proceedings of the National Academy of Sciences.

[24]  A. Charan Kumari,et al.  Hyper-heuristic approach for multi-objective software module clustering , 2016, J. Syst. Softw..

[25]  Tong Heng Lee,et al.  Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[26]  Mark Johnston,et al.  Automatic Design of Scheduling Policies for Dynamic Multi-objective Job Shop Scheduling via Cooperative Coevolution Genetic Programming , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[28]  Aurora Trinidad Ramirez Pozo,et al.  Grammatical Evolution for the Multi-Objective Integration and Test Order Problem , 2016, GECCO.

[29]  Vili Podgorelec,et al.  Evolving decision-tree induction algorithms with a multi-objective hyper-heuristic , 2015, SAC.

[30]  Ed Keedwell,et al.  A Sequence-based Selection Hyper-heuristic Utilising a Hidden Markov Model , 2015, GECCO.

[31]  Michèle Sebag,et al.  Analyzing bandit-based adaptive operator selection mechanisms , 2010, Annals of Mathematics and Artificial Intelligence.

[32]  Aurora Trinidad Ramirez Pozo,et al.  A multi-objective optimization approach for the integration and test order problem , 2014, Inf. Sci..

[33]  Michael Freitag,et al.  Automatic design of scheduling rules for complex manufacturing systems by multi-objective simulation-based optimization , 2016 .

[34]  Gang Chen,et al.  Parallel Multi-objective Job Shop Scheduling Using Genetic Programming , 2016, ACALCI.

[35]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[36]  Ender Özcan,et al.  An Experimental Study on Hyper-heuristics and Exam Timetabling , 2006, PATAT.

[37]  Tobias Friedrich,et al.  The maximum hypervolume set yields near-optimal approximation , 2010, GECCO '10.

[38]  M. L. Tsetlin On the Behavior of Finite Automata in Random Media , 1961 .

[39]  Edmund K. Burke,et al.  A modified choice function hyper-heuristic controlling unary and binary operators , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[40]  Ender Özcan,et al.  A comprehensive analysis of hyper-heuristics , 2008, Intell. Data Anal..

[41]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[42]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[43]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[44]  Tobias Friedrich,et al.  Tight Bounds for the Approximation Ratio of the Hypervolume Indicator , 2010, PPSN.

[45]  P. S. Nagendra Rao,et al.  A reinforcement learning approach to automatic generation control , 2002 .

[46]  Ender Özcan,et al.  A tensor-based selection hyper-heuristic for cross-domain heuristic search , 2015, Inf. Sci..

[47]  T. B. Khalil,et al.  Vehicle Crashworthiness and Occupant Protection in Frontal Impact by FE Analysis — An Integrated Approach , 1997 .

[48]  Graham Kendall,et al.  A Hyperheuristic Approach to Scheduling a Sales Summit , 2000, PATAT.

[49]  Mohammad Saadatseresht,et al.  Evacuation planning using multiobjective evolutionary optimization approach , 2009, Eur. J. Oper. Res..

[50]  Ender Özcan,et al.  An iterated multi-stage selection hyper-heuristic , 2016, Eur. J. Oper. Res..

[51]  Lothar Thiele,et al.  A Tutorial on the Performance Assessment of Stochastic Multiobjective Optimizers , 2006 .

[52]  Gang Chen,et al.  A PSO-Based Reference Point Adaption Method for Genetic Programming Hyper-Heuristic in Many-Objective Job Shop Scheduling , 2017, ACALCI.

[53]  Markus Wagner,et al.  Efficient optimization of many objectives by approximation-guided evolution , 2015, Eur. J. Oper. Res..

[54]  Ender Özcan,et al.  A tensor based hyper-heuristic for nurse rostering , 2016, Knowl. Based Syst..

[55]  Dirk Thierens,et al.  Adaptive Strategies for Operator Allocation , 2007, Parameter Setting in Evolutionary Algorithms.

[56]  P. S. Sastry,et al.  Adaptive Stochastic Algorithms for Pattern Classification , 2001 .

[57]  Graham Kendall,et al.  A multi-objective hyper-heuristic based on choice function , 2014, Expert Syst. Appl..

[58]  Ren-Jye Yang,et al.  Metamodeling development for vehicle frontal impact simulation , 2001, DAC 2001.

[59]  Qing Li,et al.  Multiobjective optimization for crash safety design of vehicles using stepwise regression model , 2008 .

[60]  Daniel Selva,et al.  A Hyperheuristic Approach to Leveraging Domain Knowledge in Multi-Objective Evolutionary Algorithms , 2016, DAC 2016.

[61]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .

[62]  Graham Kendall,et al.  A Classification of Hyper-heuristic Approaches , 2010 .

[63]  Carolina P. de Almeida,et al.  MOEA/D-HH: A Hyper-Heuristic for Multi-objective Problems , 2015, EMO.

[64]  R. Roy A Primer on the Taguchi Method , 1990 .

[65]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[66]  Luca Di Gaspero,et al.  Evaluation of a Family of Reinforcement Learning Cross-Domain Optimization Heuristics , 2012, LION.

[67]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[68]  Markus Wagner,et al.  A modified indicator-based evolutionary algorithm (mIBEA) , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[69]  Ender Özcan,et al.  An investigation of tuning a memetic algorithm for cross-domain search , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[70]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[71]  Patrick De Causmaecker,et al.  A new hyper-heuristic implementation in HyFlex: a study on generality , 2011 .

[72]  Steve Caplin,et al.  Principles Of Design , 2011 .

[73]  Lih-Yuan Deng,et al.  Orthogonal Arrays: Theory and Applications , 1999, Technometrics.

[74]  Graham Kendall,et al.  Choice function based hyper-heuristics for multi-objective optimization , 2015, Appl. Soft Comput..

[75]  Thomas Hanne,et al.  A multiobjective evolutionary algorithm for scheduling and inspection planning in software development projects , 2005, Eur. J. Oper. Res..

[76]  Tea Tusar,et al.  Differential Evolution versus Genetic Algorithms in Multiobjective Optimization , 2007, EMO.