Monte Carlo hyper-heuristics for examination timetabling

Automating the neighbourhood selection process in an iterative approach that uses multiple heuristics is not a trivial task. Hyper-heuristics are search methodologies that not only aim to provide a general framework for solving problem instances at different difficulty levels in a given domain, but a key goal is also to extend the level of generality so that different problems from different domains can also be solved. Indeed, a major challenge is to explore how the heuristic design process might be automated. Almost all existing iterative selection hyper-heuristics performing single point search contain two successive stages; heuristic selection and move acceptance. Different operators can be used in either of the stages. Recent studies explore ways of introducing learning mechanisms into the search process for improving the performance of hyper-heuristics. In this study, a broad empirical analysis is performed comparing Monte Carlo based hyper-heuristics for solving capacitated examination timetabling problems. One of these hyper-heuristics is an approach that overlaps two stages and presents them in a single algorithmic body. A learning heuristic selection method (L) operates in harmony with a simulated annealing move acceptance method using reheating (SA) based on some shared variables. Yet, the heuristic selection and move acceptance methods can be separated as the proposed approach respects the common selection hyper-heuristic framework. The experimental results show that simulated annealing with reheating as a hyper-heuristic move acceptance method has significant potential. On the other hand, the learning hyper-heuristic using simulated annealing with reheating move acceptance (L–SA) performs poorly due to certain weaknesses, such as the choice of rewarding mechanism and the evaluation of utility values for heuristic selection as compared to some other hyper-heuristics in examination timetabling. Trials with other heuristic selection methods confirm that the best alternative for the simulated annealing with reheating move acceptance for examination timetabling is a previously proposed strategy known as the choice function.

[1]  Edmund K. Burke,et al.  Practice and Theory of Automated Timetabling V, 5th International Conference, PATAT 2004, Pittsburgh, PA, USA, August 18-20, 2004, Revised Selected Papers , 2005, PATAT.

[2]  Edmund K. Burke,et al.  A Memetic Algorithm for University Exam Timetabling , 1995, PATAT.

[3]  Peter J. Stuckey,et al.  A Hybrid Algorithm for the Examination Timetabling Problem , 2002, PATAT.

[4]  A. J. Cole,et al.  The preparation of examination time-tables using a small-store computer , 1964, Comput. J..

[5]  Edmund K. Burke,et al.  Selected papers from the First International Conference on Practice and Theory of Automated Timetabling , 1995 .

[6]  Graham Kendall,et al.  A Monte Carlo Hyper-Heuristic To Optimise Component Placement Sequencing For Multi Head Placement Machine , 2003 .

[7]  Giuseppe F. Italiano,et al.  Novel Local-Search-Based Approaches to University Examination Timetabling , 2008, INFORMS J. Comput..

[8]  Edmund K. Burke,et al.  Examination Timetabling in British Universities: A Survey , 1995, PATAT.

[9]  Graham Kendall,et al.  A simulated annealing hyper-heuristic methodology for flexible decision support , 2012, 4OR.

[10]  Sanja Petrovic,et al.  Examination Timetabling with Fuzzy Constraints , 2004, PATAT.

[11]  Peter Ross,et al.  Fast Practical Evolutionary Timetabling , 1994, Evolutionary Computing, AISB Workshop.

[12]  Gilbert Laporte,et al.  Examination Timetabling: Algorithmic Strategies and Applications , 1994 .

[13]  Natalio Krasnogor,et al.  A Study on the use of ``self-generation'' in memetic algorithms , 2004, Natural Computing.

[14]  Graham Kendall,et al.  Evolving Bin Packing Heuristics with Genetic Programming , 2006, PPSN.

[15]  Edmund K. Burke,et al.  The practice and theory of automated timetabling , 2014, Ann. Oper. Res..

[16]  Graham Kendall,et al.  An Investigation of Automated Planograms Using a Simulated Annealing Based Hyper-Heuristic , 2005 .

[17]  Moshe Dror,et al.  A tabu-based large neighbourhood search methodology for the capacitated examination timetabling problem , 2007, J. Oper. Res. Soc..

[18]  Giuseppe F. Italiano,et al.  New Algorithms for Examination Timetabling , 2000, WAE.

[19]  Alistair I. Mees,et al.  Convergence of an annealing algorithm , 1986, Math. Program..

[20]  Graham Kendall,et al.  Automatic heuristic generation with genetic programming: evolving a jack-of-all-trades or a master of one , 2007, GECCO '07.

[21]  Hishammuddin Asmuni,et al.  Fuzzy Multiple Ordering Criteria for Examination Timetabling , 2004 .

[22]  Edmund K. Burke,et al.  A multistage evolutionary algorithm for the timetable problem , 1999, IEEE Trans. Evol. Comput..

[23]  Barry McCollum,et al.  University Timetabling: Bridging the Gap between Research and Practice , 2006 .

[24]  Ender Özcan,et al.  A Memetic Algorithm for Solving a Timetabling Problem: An Incremental Strategy , 2007 .

[25]  Luca Di Gaspero,et al.  Measurability and Reproducibility in Timetabling Research: State-of-the-Art and Discussion , 2006 .

[26]  Michael Eley,et al.  Ant Algorithms for the Exam Timetabling Problem , 2006, PATAT.

[27]  Jorge Pinho de Sousa,et al.  Metaheuristics: Computer Decision-Making , 2010 .

[28]  Efthymios Housos,et al.  An improved multi-staged algorithmic process for the solution of the examination timetabling problem , 2012, Ann. Oper. Res..

[29]  Graham Kendall,et al.  A Tabu Search Hyper-heuristic Approach to the Examination Timetabling Problem at the MARA University of Technology , 2004, PATAT.

[30]  Sol Broder,et al.  Final examination scheduling , 1964, Commun. ACM.

[31]  Ender Özcan,et al.  An Experimental Study on Hyper-heuristics and Exam Timetabling , 2006, PATAT.

[32]  Luca Di Gaspero,et al.  Tabu Search Techniques for Examination Timetabling , 2000, PATAT.

[33]  P. Cowling,et al.  A Parameter-Free Hyperheuristic for Scheduling a Sales Summit , 2002 .

[34]  Edmund K. Burke,et al.  A survey of search methodologies and automated system development for examination timetabling , 2009, J. Sched..

[35]  Ender Özcan,et al.  A comprehensive analysis of hyper-heuristics , 2008, Intell. Data Anal..

[36]  Sanja Petrovic,et al.  A graph-based hyper-heuristic for educational timetabling problems , 2007, Eur. J. Oper. Res..

[37]  Ender Özcan,et al.  Final exam scheduler - FES , 2005, 2005 IEEE Congress on Evolutionary Computation.

[38]  Edmund K. Burke,et al.  Solving Examination Timetabling Problems through Adaption of Heuristic Orderings , 2004, Ann. Oper. Res..

[39]  Tom ITC2007 Solver Description: A Hybrid Approach , 2007 .

[40]  T. Wong,et al.  Final exam timetabling: a practical approach , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[41]  Alexander Nareyek,et al.  Choosing search heuristics by non-stationary reinforcement learning , 2004 .

[42]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[43]  Lamberto Cesari,et al.  Optimization-Theory And Applications , 1983 .

[44]  Hishammuddin Asmuni,et al.  Fuzzy Multiple Heuristic Orderings for Examination Timetabling , 2004, PATAT.

[45]  A. Alkan,et al.  Memetic algorithms for timetabling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[46]  S. Dreyfus,et al.  Thermodynamical Approach to the Traveling Salesman Problem : An Efficient Simulation Algorithm , 2004 .

[47]  Carlos M. Fonseca,et al.  A Study of Examination Timetabling with Multiobjective Evolutionary Algorithms , 2001 .

[48]  Ender Özcan,et al.  Hill Climbers and Mutational Heuristics in Hyperheuristics , 2006, PPSN.

[49]  Ayhan Ergül,et al.  GA-Based Examination Scheduling Experience at Middle East Technical University , 1995, PATAT.

[50]  Gilbert Laporte,et al.  Recent Developments in Practical Examination Timetabling , 1995, PATAT.

[51]  Peter Ross,et al.  Improving Evolutionary Timetabling with Delta Evaluation and Directed Mutation , 1994, PPSN.

[52]  Zahra Naji Azimi,et al.  Hybrid heuristics for Examination Timetabling problem , 2005, Appl. Math. Comput..

[53]  Kathryn A. Dowsland,et al.  Ant colony optimization for the examination scheduling problem , 2005, J. Oper. Res. Soc..

[54]  Sanja Petrovic,et al.  Recent research directions in automated timetabling , 2002, Eur. J. Oper. Res..

[55]  Barry McCollum,et al.  A New Neural Network Based Construction Heuristic for the Examination Timetabling Problem , 2006, PPSN.

[56]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[57]  Edmund K. Burke,et al.  A simulated annealing based hyperheuristic for determining shipper sizes for storage and transportation , 2007, Eur. J. Oper. Res..

[58]  Graham Kendall,et al.  A Hyperheuristic Approach to Scheduling a Sales Summit , 2000, PATAT.

[59]  Ben Paechter,et al.  Setting the Research Agenda in Automated Timetabling: The Second International Timetabling Competition , 2010, INFORMS J. Comput..

[60]  Sanja Petrovic,et al.  Case-based selection of initialisation heuristics for metaheuristic examination timetabling , 2007, Expert Syst. Appl..

[61]  Alon Itai,et al.  On the Complexity of Timetable and Multicommodity Flow Problems , 1976, SIAM J. Comput..

[62]  Michael W. Carter,et al.  OR Practice - A Survey of Practical Applications of Examination Timetabling Algorithms , 1986, Oper. Res..

[63]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[64]  Graham Kendall,et al.  Hyperheuristics: A Tool for Rapid Prototyping in Scheduling and Optimisation , 2002, EvoWorkshops.

[65]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[66]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[67]  Vahid Lotfi,et al.  A graph coloring algorithm for large scale scheduling problems , 1986, Comput. Oper. Res..

[68]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[69]  Andrea Schaerf,et al.  A Survey of Automated Timetabling , 1999, Artificial Intelligence Review.

[70]  Ersan Ersoy,et al.  Memetic Algorithms and Hyperhill-climbers , 2008 .