A simulation-based neighbourhood search algorithm to schedule multi-category patients at a multi-facility health care diagnostic centre

Abstract A key operational decision faced by a multi-facility health care diagnostic centre serving different patient categories (for example: Health Check-up Patient (HCP), Out-Patient (OP), Emergency Patient (EP), or In-Patient) is whom to serve next at a particular facility. In this paper, we model random arrival of these patients belonging to different categories and priorities at multiple diagnostic facilities over a finite planning horizon. We formulate a mathematical model for sequential decision-making under uncertainty using Markov Decision Process (MDP) with the objective of maximising net revenue and use dynamic programming (DP) to solve it. To address dimensionality and scalability issue of MDP, we provide a decentralised MDP (D_MDP) formulation. We develop simulation-based neighbourhood search algorithm to improve DP solution for D_MDP. We compare these solutions with three other rule-based heuristics using simulation.

[1]  Ben Wang,et al.  Managing Patient Service in a Diagnostic Medical Facility , 2006, Oper. Res..

[2]  Zrinka Lukac,et al.  Use of VNS heuristics for scheduling of patients in hospital , 2011, J. Oper. Res. Soc..

[3]  Archis Ghate,et al.  A Markov decision process approach to multi-category patient scheduling in a diagnostic facility , 2011, Artif. Intell. Medicine.

[4]  Ching-Chin Chern,et al.  A heuristic algorithm for the hospital health examination scheduling problem , 2008, Eur. J. Oper. Res..

[5]  Rainer Kolisch,et al.  Approximate Dynamic Programming for Capacity Allocation in the Service Industry , 2010, Eur. J. Oper. Res..

[6]  Rainer Kolisch,et al.  Providing radiology health care services to stochastic demand of different customer classes , 2008, OR Spectr..

[7]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[8]  Martin L. Puterman,et al.  Dynamic multi-appointment patient scheduling for radiation therapy , 2012, European Journal of Operational Research.

[9]  Diwakar Gupta,et al.  Appointment scheduling in health care: Challenges and opportunities , 2008 .

[10]  Jesse Hoey,et al.  A Coordinated MDP Approach to Multi-Agent Planning for Resource Allocation, with Applications to Healthcare , 2014, ArXiv.

[11]  Maurice Queyranne,et al.  Dynamic Multipriority Patient Scheduling for a Diagnostic Resource , 2008, Oper. Res..

[12]  Sander M. Bohte,et al.  Adaptive resource allocation for efficient patient scheduling , 2009, Artif. Intell. Medicine.

[13]  Abdur Rais,et al.  Operations Research in Healthcare: a survey , 2011, Int. Trans. Oper. Res..

[14]  Jonathan Patrick,et al.  A Markov decision model for determining optimal outpatient scheduling , 2011, Health Care Management Science.

[15]  Peter J. H. Hulshof,et al.  Taxonomic classification of planning decisions in health care: a structured review of the state of the art in OR/MS , 2012 .

[16]  Neil Immerman,et al.  The Complexity of Decentralized Control of Markov Decision Processes , 2000, UAI.