Lookahead Policy and Genetic Algorithm for Solving Nurse Rostering Problems

Previous research has shown that value function approximation in dynamic programming does not perform too well when tackling difficult combinatorial optimisation problems such as multi-stage nurse rostering. This is because the large action space that needs to be explored. This paper proposes to replace the value function approximation with a genetic algorithm in order to generate solutions for the dynamic programming stages. Then, the paper proposes a hybrid approach that generates sets of weekly rosters with a genetic algorithm for consideration by the lookahead procedure that assembles a solution for the whole planning horizon of several weeks. Results indicate that this hybrid between a genetic algorithm and the lookahead policy mechanism from dynamic programming exhibits a more competitive performance than the value function approximation dynamic programming investigated before. Results also show that the proposed algorithm ranks well in respect of several other algorithms applied to the same set of problem instances. The intended contribution of this paper is towards a better understanding of how to successfully apply dynamic programming mechanisms to tackle difficult combinatorial optimisation problems.

[1]  Hendrik Van Landeghem,et al.  The State of the Art of Nurse Rostering , 2004, J. Sched..

[2]  Peng Shi,et al.  Approximate Dynamic Programming with Combined Policy Functions for Solving Multi-stage Nurse Rostering Problem , 2017, MOD.

[3]  Mutsunori Yagiura,et al.  The use of dynamic programming in genetic algorithms for permutation problems , 1996 .

[4]  Mario Vanhoucke,et al.  NSPLib: a Nurse Scheduling Problem Library: a tool to evaluate (meta-)heuristic procedures , 2007 .

[5]  Sara Ceschia,et al.  Second International Nurse Rostering Competition (INRC-II) - Problem Description and Rules - , 2015, ArXiv.

[6]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[7]  Samuel G. Davis,et al.  A dynamic programming approach to work force scheduling with time-dependent performance measures , 1981 .

[8]  Mohammad Mohammadi,et al.  A hybrid method based on genetic algorithm and dynamic programming for solving a bi-objective cell formation problem considering alternative process routings and machine duplication , 2017, Appl. Soft Comput..

[9]  Erik Demeulemeester,et al.  Personnel scheduling: A literature review , 2013, Eur. J. Oper. Res..

[10]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[11]  Peng Shi,et al.  Dynamic Programming with Approximation Function for Nurse Scheduling , 2016, MOD.

[12]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.