A survey of search methodologies and automated system development for examination timetabling

Examination timetabling is one of the most important administrative activities that takes place in all academic institutions. In this paper, we present a critical discussion of the research on exam timetabling which has taken place in the last decade or so. This last ten years has seen a significantly increased level of research attention for this important area. There has been a range of insightful contributions to the scientific literature both in terms of theoretical issues and practical aspects. The main aim of this survey is to highlight the new trends and key research achievements that have been carried out in the last decade. We also aim to outline a range of relevant important research issues and challenges that have been generated by this body of work.We first define the problem and discuss previous survey papers. Within our presentation of the state-of-the-art methodologies, we highlight recent research trends including hybridisations of search methodologies and the development of techniques which are motivated by raising the level of generality at which search methodologies can operate. Summarising tables are presented to provide an overall view of these techniques. We also present and discuss some important issues which have come to light concerning the public benchmark exam timetabling data. Different versions of problem datasets with the same name have been circulating in the scientific community for the last ten years and this has generated a significant amount of confusion. We clarify the situation and present a re-naming of the widely studied datasets to avoid future confusion. We also highlight which research papers have dealt with which dataset. Finally, we draw upon our discussion of the literature to present a (non-exhaustive) range of potential future research directions and open issues in exam timetabling research.

[1]  D. de Werra,et al.  Complexity of some special types of timetabling problems Journal of Scheduling , 2002 .

[2]  Rupert F. Weare Automated examination timetabling , 1995 .

[3]  Moshe Dror,et al.  A tabu-based large neighbourhood search methodology for the capacitated examination timetabling problem , 2007, J. Oper. Res. Soc..

[4]  Hishammuddin Asmuni,et al.  A Novel Fuzzy Approach to Evaluate the Quality of Examination Timetabling , 2006, PATAT.

[5]  Pascal Van Hentenryck Constraint satisfaction in logic programming , 1989, Logic programming.

[6]  Raymond S. K. Kwan Bus and Train Driver Scheduling , 2004, Handbook of Scheduling.

[7]  Graham Kendall,et al.  Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques , 2013 .

[8]  A. Armstrong.,et al.  Lessons from Experience , 1985 .

[9]  Yuri Bykov,et al.  Time-predefined and trajectory-based search : single and multiobjective approaches to exam timetabling , 2003 .

[10]  Giuseppe F. Italiano,et al.  New Algorithms for Examination Timetabling , 2000, WAE.

[11]  Panagiotis Miliotis,et al.  Implementation of a university course and examination timetabling system , 2001, Eur. J. Oper. Res..

[12]  Sanja Petrovic,et al.  A Multicriteria Approach to Examination Timetabling , 2000, PATAT.

[13]  Michael Pilegaard Hansen,et al.  Planning of high school examinations in Denmark , 1995 .

[14]  Gilbert Laporte,et al.  Metaheuristics: A bibliography , 1996, Ann. Oper. Res..

[15]  Zahra Naji Azimi,et al.  Hybrid heuristics for Examination Timetabling problem , 2005, Appl. Math. Comput..

[16]  Luís Paquete,et al.  Empirical Analysis of Tabu Search for the Lexicographic Optimization of the Examination Timetabling Problem , 2002 .

[17]  Peter J. Stuckey,et al.  A Hybrid Algorithm for the Examination Timetabling Problem , 2002, PATAT.

[18]  Gunther Schmidt,et al.  Timetable Construction - An Annotated Bibliography , 1980, Comput. J..

[19]  Robert Sabourin,et al.  A Hybrid Multi-objective Evolutionary Algorithm for the Uncapacitated Exam Proximity Problem , 2004, PATAT.

[20]  Sanja Petrovic,et al.  A graph-based hyper-heuristic for educational timetabling problems , 2007, Eur. J. Oper. Res..

[21]  Pierre Hansen,et al.  Variable neighborhood search: Principles and applications , 1998, Eur. J. Oper. Res..

[22]  Bernd Bullnheimer,et al.  An Examination Scheduling Model to Maximize Students' Study Time , 1997, PATAT.

[23]  Sanja Petrovic,et al.  A Multiobjective Optimisation Technique for Exam Timetabling Based on Trajectories , 2002, PATAT.

[24]  Edmund K. Burke,et al.  A multistage evolutionary algorithm for the timetable problem , 1999, IEEE Trans. Evol. Comput..

[25]  Edmund K. Burke,et al.  Automated University Timetabling: The State of the Art , 1997, Comput. J..

[26]  D. de Werra,et al.  An introduction to timetabling , 1985 .

[27]  Kathryn A. Dowsland,et al.  Ant colony optimization for the examination scheduling problem , 2005, J. Oper. Res. Soc..

[28]  Ehl Emile Aarts,et al.  Simulated annealing and Boltzmann machines , 2003 .

[29]  Edmund K. Burke,et al.  Adaptive Decomposition and Construction for Examination Timetabling Problems , 2007 .

[30]  Rong Qu,et al.  CASE-BASED REASONING FOR COURSE TIMETABLING PROBLEMS , 2002 .

[31]  Hishammuddin Asmuni,et al.  Fuzzy Multiple Ordering Criteria for Examination Timetabling , 2004 .

[32]  Joseph Y.-T. Leung,et al.  Handbook of Scheduling: Algorithms, Models, and Performance Analysis , 2004 .

[33]  Pierre Hansen,et al.  Variable Neighbourhood Search , 2003 .

[34]  Edmund K. Burke,et al.  Applications to timetabling , 2004 .

[35]  Pablo Moscato,et al.  A Gentle Introduction to Memetic Algorithms , 2003, Handbook of Metaheuristics.

[36]  Victor A. Bardadym Computer-Aided School and University Timetabling: The New Wave , 1995, PATAT.

[37]  Victor J. Rayward-Smith,et al.  Modern Heuristic Search Methods , 1996 .

[38]  Helmut Simonis,et al.  The CHIP System and Its Applications , 1995, CP.

[39]  L vanRijswijk Bridging the gap between research and practice. , 2004 .

[40]  Ramgopal Agarwala,et al.  Lessons of Experience , 2000 .

[41]  N. K. Mehta,et al.  Computer-Based Examination Management System , 1982 .

[42]  Andrea Schaerf,et al.  A Survey of Automated Timetabling , 1999, Artificial Intelligence Review.

[43]  Samad Ahmadi,et al.  An Extensible Modelling Framework for Timetabling Problems , 2006, PATAT.

[44]  Ersan Ersoy,et al.  Memetic Algorithms and Hyperhill-climbers , 2008 .

[45]  Celso C. Ribeiro,et al.  Greedy Randomized Adaptive Search Procedures , 2003, Handbook of Metaheuristics.

[46]  Philippe David A Constraint-Based Approach for Examination Timetabling Using Local Repair Techniques , 1997, PATAT.

[47]  Michael W. Carter,et al.  Extended clique initialisation in examination timetabling , 2001, J. Oper. Res. Soc..

[48]  Gilbert Laporte,et al.  A General Examination Scheduling System , 1992 .

[49]  Ender Özcan,et al.  Linear Linkage Encoding in Grouping Problems: Applications on Graph Coloring and Timetabling , 2006, PATAT.

[50]  Dushyant Sharma,et al.  Multi-exchange neighborhood structures for the capacitated minimum spanning tree problem , 2001, Math. Program..

[51]  Peter Rossmanith,et al.  Simulated Annealing , 2008, Taschenbuch der Algorithmen.

[52]  Enn Tyugu,et al.  Constraint Programming , 1994, NATO ASI Series.

[53]  Luca Di Gaspero,et al.  Measurability and Reproducibility in Timetabling Research: State-of-the-Art and Discussion , 2006 .

[54]  Michael Eley,et al.  Ant Algorithms for the Exam Timetabling Problem , 2006, PATAT.

[55]  E. Burke,et al.  Hybrid Graph Heuristics within a Hyper-Heuristic Approach to Exam Timetabling Problems , 2005 .

[56]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[57]  F. Glover,et al.  In Modern Heuristic Techniques for Combinatorial Problems , 1993 .

[58]  Edmund K. Burke,et al.  Hybridizations within a graph-based hyper-heuristic framework for university timetabling problems , 2009, J. Oper. Res. Soc..

[59]  Mauricio G. C. Resende,et al.  Greedy Randomized Adaptive Search Procedures , 1995, J. Glob. Optim..

[60]  R. Sabourin,et al.  Application of a hybrid multi-objective evolutionary algorithm to the uncapacitated exam proximity problem , 2004 .

[61]  Edmund K. Burke,et al.  Examination Timetabling in British Universities: A Survey , 1995, PATAT.

[62]  Barry McCollum,et al.  A Perspective on Bridging the Gap Between Theory and Practice in University Timetabling , 2006, PATAT.

[63]  James Smith,et al.  A tutorial for competent memetic algorithms: model, taxonomy, and design issues , 2005, IEEE Transactions on Evolutionary Computation.

[64]  R. Qu,et al.  Analysing Similarity in Examination Timetabling , 2005 .

[65]  Bernardo Prida Romero,et al.  Examination Scheduling in a Large Engineering School: A Computer-Assisted Participative Procedure , 1982 .

[66]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[67]  Dominique de Werra,et al.  Restricted coloring models for timetabling , 1997, Discret. Math..

[68]  Moshe Dror,et al.  Investigating Ahuja–Orlin’s large neighbourhood search approach for examination timetabling , 2007, OR Spectr..

[69]  Adli Mustafa,et al.  Artificial Immune Algorithms for University Timetabling , 2006 .

[70]  Hendrik Van Landeghem,et al.  The State of the Art of Nurse Rostering , 2004, J. Sched..

[71]  Peter Ross,et al.  The Phase-Transition Niche for Evolutionary Algorithms in Timetabling , 1995, PATAT.

[72]  P. Cowling,et al.  Perturbation based variable neighbourhood search in heuristic space for examination timetabling problem. , 2003 .

[73]  Andrew Lim,et al.  A Campus-Wide University Examination Timetabling Application , 2000, AAAI/IAAI.

[74]  Edmund K. Burke,et al.  Selected papers from the First International Conference on Practice and Theory of Automated Timetabling , 1995 .

[75]  Giuseppe F. Italiano,et al.  Novel Local-Search-Based Approaches to University Examination Timetabling , 2008, INFORMS J. Comput..

[76]  Wilhelm Erben,et al.  A Grouping Genetic Algorithm for Graph Colouring and Exam Timetabling , 2000, PATAT.

[77]  Edmund K. Burke,et al.  PATAT 2006: Proceedings of the 6th International Conference onthe Practice and Theory of Automated Timetabling , 2006 .

[78]  Jacques Carlier,et al.  Handbook of Scheduling - Algorithms, Models, and Performance Analysis , 2004 .

[79]  Kathryn A. Dowsland,et al.  A robust simulated annealing based examination timetabling system , 1998, Comput. Oper. Res..

[80]  Edmund K. Burke,et al.  A Standard Data Format for Timetabling Instances , 1997, PATAT.

[81]  M. Valenzuela-Rendon,et al.  Application of the hardness theory when solving the timetabling problem with genetic algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[82]  K. Sheibani An Evolutionary Approach For The Examination Timetabling Problems , 2002 .

[83]  Thomas Stützle,et al.  An Experimental Investigation of Iterated Local Search for Coloring Graphs , 2002, EvoWorkshops.

[84]  Edmund K. Burke,et al.  Initialization Strategies and Diversity in Evolutionary Timetabling , 1998, Evolutionary Computation.

[85]  James P. Newall Hybrid methods for automated timetabling , 1999 .

[86]  Gilbert Laporte,et al.  Recent Developments in Practical Examination Timetabling , 1995, PATAT.

[87]  Liam T. G. Merlot Techniques for academic timetabling , 2005 .

[88]  G. Dueck New optimization heuristics , 1993 .

[89]  Jeffrey H. Kingston Modelling Timetabling Problems with STTL , 2000, PATAT.

[90]  Andrew Lim,et al.  Maximizing paper spread in examination timetabling using a vehicle routing method , 2001, Proceedings 13th IEEE International Conference on Tools with Artificial Intelligence. ICTAI 2001.

[91]  George M. White,et al.  Using tabu search with longer-term memory and relaxation to create examination timetables , 2004, Eur. J. Oper. Res..

[92]  Edmund K. Burke,et al.  The Design of Memetic Algorithms for Scheduling and Timetabling Problems , 2005 .

[93]  Edmund K. Burke,et al.  Practice and Theory of Automated Timetabling II , 1997, Lecture Notes in Computer Science.

[94]  Sanja Petrovic,et al.  Recent research directions in automated timetabling , 2002, Eur. J. Oper. Res..

[95]  Shigeyoshi Tsutsui,et al.  Advances in evolutionary computing: theory and applications , 2003 .

[96]  Kathryn A. Dowsland,et al.  Variants of simulated annealing for the examination timetabling problem , 1996, Ann. Oper. Res..

[97]  Hana Rudová,et al.  Constraint Satisfaction with Preferences , 2001 .

[98]  David Corne,et al.  Evolutionary Timetabling: Practice, Prospects and Work in Progress , 1994 .

[99]  Milan Zelany,et al.  A concept of compromise solutions and the method of the displaced ideal , 1974, Comput. Oper. Res..

[100]  Comparison of metaheuristic algorithms for Examination Timetabling Problem , 2004 .

[101]  RJ Roy Willemen,et al.  School timetable construction : algorithms and complexity , 2002 .

[102]  R. Wallace Is this a practical approach? , 2001, Journal of the American College of Surgeons.

[103]  Edmund K. Burke,et al.  Practice and Theory of Automated Timetabling V, 5th International Conference, PATAT 2004, Pittsburgh, PA, USA, August 18-20, 2004, Revised Selected Papers , 2005, PATAT.

[104]  Edmund K. Burke,et al.  A Memetic Algorithm for University Exam Timetabling , 1995, PATAT.

[105]  G. K. Winter,et al.  The Impact of Automated Timetabling on Universities — A Case Study , 1986 .

[106]  Marco Dorigo,et al.  Ant colony optimization theory: A survey , 2005, Theor. Comput. Sci..

[107]  Elena Marchiori,et al.  Applications of Evolutionary Computing: Evoworkshops 2003 , 2003 .

[108]  Laurent Péridy,et al.  Constraint Logic Programming for Examination Timetabling , 1996, J. Log. Program..

[109]  Christophe Labreuche,et al.  MCS—A new algorithm for multicriteria optimisation in constraint programming , 2006, Ann. Oper. Res..

[110]  Sol Broder,et al.  Final examination scheduling , 1964, Commun. ACM.

[111]  Michael Sampels,et al.  Ant Algorithms for the University Course Timetabling Problem with Regard to the State-of-the-Art , 2003, EvoWorkshops.

[112]  Edmund K. Burke,et al.  Investigating Ahuja-Orlin''s Large Neighbourhood Search for Examination Timetabling , 2004 .

[113]  Ender Özcan,et al.  An Experimental Study on Hyper-heuristics and Exam Timetabling , 2006, PATAT.

[114]  Sanja Petrovic,et al.  Hybrid variable neighbourhood approaches to university exam timetabling , 2010, Eur. J. Oper. Res..

[115]  T. Wong,et al.  Final exam timetabling: a practical approach , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[116]  Peter Ross,et al.  Some Observations about GA-Based Exam Timetabling , 1997, PATAT.

[117]  Chris N. Potts,et al.  Constraint satisfaction problems: Algorithms and applications , 1999, Eur. J. Oper. Res..

[118]  Hishammuddin Asmuni,et al.  Fuzzy Multiple Heuristic Orderings for Examination Timetabling , 2004, PATAT.

[119]  Alain Hertz,et al.  Ants can colour graphs , 1997 .

[120]  Edmund K. Burke,et al.  A Genetic Algorithm for University Timetabling , 1994 .

[121]  M. Pirlot General local search methods , 1996 .

[122]  Scott Robert Ladd,et al.  Genetic algorithms in C , 1995 .

[123]  Anthony Wren,et al.  Scheduling, Timetabling and Rostering - A Special Relationship? , 1995, PATAT.

[124]  Edmund K. Burke,et al.  Enhancing Timetable Solutions with Local Search Methods , 2002, PATAT.

[125]  David C. Wood A system for computing university examination timetables , 1968, Comput. J..

[126]  Michael W. Carter,et al.  OR Practice - A Survey of Practical Applications of Examination Timetabling Algorithms , 1986, Oper. Res..

[127]  Gilbert Laporte,et al.  Examination Timetabling: Algorithmic Strategies and Applications , 1994 .

[128]  Nirbhay K. Mehta The Application of a Graph Coloring Method to an Examination Scheduling Problem , 1981 .

[129]  Luca Di Gaspero,et al.  EASYLOCAL++: an object‐oriented framework for the flexible design of local‐search algorithms , 2003, Softw. Pract. Exp..

[130]  Jonathan M. Thompson,et al.  GRASPing the Examination Scheduling Problem , 2002, PATAT.

[131]  B. MacCarthyb,et al.  Structured Cases in CBR – Re-using and Adapting Cases for Time- tabling Problems , 2005 .

[132]  Patrick De Causmaecker,et al.  Using Web Standards for Timetabling , 2002 .

[133]  H. Terashima-Marín,et al.  Evolution of Constraint Satisfaction strategies in examination timetabling , 1999 .

[134]  H. Terashima,et al.  Combinations of GAS and CSP strategies for solving examination timetabling problems , 1998 .

[135]  Michela Milano,et al.  Constraint and Integer Programming: Toward a Unified Methodology (Operations Research/Computer Science Interfaces, 27) , 2003 .

[136]  Edmund K. Burke,et al.  Practice and Theory of Automated Timetabling V: 5th International Conference, PATAT 2004, Pittsburgh, PA, USA, August 18-20, 2004, Revised Selected Papers (Lecture Notes in Computer Science) , 2006 .

[137]  D. J. A. Welsh,et al.  An upper bound for the chromatic number of a graph and its application to timetabling problems , 1967, Comput. J..

[138]  Sanja Petrovic,et al.  Case-based heuristic selection for timetabling problems , 2006, J. Sched..

[139]  Graham Kendall,et al.  A Tabu Search Hyper-heuristic Approach to the Examination Timetabling Problem at the MARA University of Technology , 2004, PATAT.

[140]  Jeffrey H. Kingston,et al.  The Complexity of Timetable Construction Problems , 1995, PATAT.

[141]  Sanja Petrovic,et al.  Structured cases in case-based reasoning - re-using and adapting cases for time-tabling problems , 2000, Knowl. Based Syst..

[142]  Edward Tsang,et al.  A Computer Aided Constraint Programming System , 2001 .

[143]  C. Reeves Modern heuristic techniques for combinatorial problems , 1993 .

[144]  Graham Kendall,et al.  An Investigation of a Tabu-Search-Based Hyper-Heuristic for Examination Timetabling , 2005 .

[145]  Edmund K. Burke,et al.  Solving Examination Timetabling Problems through Adaption of Heuristic Orderings , 2004, Ann. Oper. Res..

[146]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[147]  Sanja Petrovic,et al.  A Novel Similarity Measure for Heuristic Selection in Examination Timetabling , 2004, PATAT.

[148]  Pablo Moscato A memetic approach for the travelling salesman problem implementation of a computational ecology for , 1992 .

[149]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[150]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[151]  Hsiao-Lan Fang,et al.  Genetic algorithms in timetabling and scheduling , 1995 .

[152]  Helena Ramalhinho Dias Lourenço,et al.  Iterated Local Search , 2001, Handbook of Metaheuristics.

[153]  Daniel Brélaz,et al.  New methods to color the vertices of a graph , 1979, CACM.

[154]  Sanja Petrovic,et al.  An Introduction to Multiobjective Metaheuristics for Scheduling and Timetabling , 2004, Metaheuristics for Multiobjective Optimisation.

[155]  Tuan-Anh Duong,et al.  Combining Constraint Programming and Simulated Annealing on University Exam Timetabling , 2004, RIVF.

[156]  Hans-Joachim Goltz,et al.  University Timetabling Using Constraint Logic Programming , 1999, PADL.

[157]  Eero Hyvönen,et al.  Interval Constraint Programming in C++ , 1993, NATO ASI CP.

[158]  David Leake,et al.  Case-Based Reasoning: Experiences, Lessons and Future Directions , 1996 .

[159]  Edmund K. Burke,et al.  A simple heuristically guided search for the timetabling problem , 1998 .

[160]  Zbigniew Michalewicz,et al.  Evolutionary algorithms , 1997, Emerging Evolutionary Algorithms for Antennas and Wireless Communications.

[161]  Pierre Hansen,et al.  Variable Neighborhood Search , 2018, Handbook of Heuristics.

[162]  Luís Paulo Reis,et al.  A Language for Specifying Complete Timetabling Problems , 2000, PATAT.

[163]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[164]  Luca Di Gaspero,et al.  Measurability and Reproducibility in University Timetabling Research: Discussion and Proposals , 2006, PATAT.

[165]  Luca Di Gaspero,et al.  Tabu Search Techniques for Examination Timetabling , 2000, PATAT.

[166]  David B. Fogel,et al.  An introduction to simulated evolutionary optimization , 1994, IEEE Trans. Neural Networks.

[167]  Sanja Petrovic,et al.  A time-predefined local search approach to exam timetabling problems , 2004 .

[168]  Farid Ajili,et al.  HYBRID PROBLEM SOLVING IN ECLiPSe , 2004 .

[169]  H. Terashima-Marín,et al.  Clique-based crossover for solving the timetabling problem with GAs , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[170]  Edmund K. Burke,et al.  The practice and theory of automated timetabling , 2014, Annals of Operations Research.

[171]  Pascal Van Hentenryck The OPL optimization programming language , 1999 .

[172]  George M. White,et al.  Examination Timetables and Tabu Search with Longer-Term Memory , 2000, PATAT.

[173]  Peter John Graham,et al.  The new wave , 1968 .

[174]  Barry McCollum,et al.  A New Neural Network Based Construction Heuristic for the Examination Timetabling Problem , 2006, PPSN.

[175]  Peter Ross,et al.  Genetic algorithms and timetabling , 2003 .

[176]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[177]  Peter Ross,et al.  Hyper-heuristics applied to class and exam timetabling problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[178]  Rhyd Lewis,et al.  A survey of metaheuristic-based techniques for University Timetabling problems , 2007, OR Spectr..

[179]  Roger Miles,et al.  Computer Timetabling: A Bibliography. , 1975 .