Dynamic scheduling with due dates and time windows: an application to chemotherapy patient appointment booking

We study a scheduling problem in which arriving patients require appointments at specific future days within a treatment specific time window. This research is motivated by a study of chemotherapy scheduling practices at the British Columbia Cancer Agency (Canada). We formulate this problem as a Markov Decision Process (MDP). Since the resulting MDPs are intractable to exact methods, we employ linear-programming-based Approximate Dynamic Programming (ADP) to obtain approximate solutions. Using simulation, we compare the performance of the resulting ADP policies to practical and easy-to-use heuristic decision rules under diverse scenarios. The results indicate that ADP is promising in several scenarios, and that a specific easy-to-use heuristic performs well in the idealized chemotherapy scheduling setting we study.

[1]  D. V. Lindley,et al.  The theory of queues with a single server , 1952, Mathematical Proceedings of the Cambridge Philosophical Society.

[2]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[3]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[4]  Jonathan Patrick,et al.  A Markov decision model for determining optimal outpatient scheduling , 2011, Health Care Management Science.

[5]  Maurice Queyranne,et al.  Dynamic Multipriority Patient Scheduling for a Diagnostic Resource , 2008, Oper. Res..

[6]  Brant E. Fries,et al.  Determination of Optimal Variable-Sized Multiple-Block Appointment Systems , 1981, Oper. Res..

[7]  Warren B. Powell,et al.  Approximate dynamic programming: Lessons from the field , 2008, 2008 Winter Simulation Conference.

[8]  M. I. Henig,et al.  Reservation planning for elective surgery under uncertain demand for emergency surgery , 1996 .

[9]  Archis Ghate,et al.  A Markov decision process approach to multi-category patient scheduling in a diagnostic facility , 2011, Artif. Intell. Medicine.

[10]  M Langhorn,et al.  Redesigning processes in ambulatory chemotherapy: creating a patient appointment scheduling system: Part II. , 2001, Canadian oncology nursing journal = Revue canadienne de nursing oncologique.

[11]  Mark Lawley,et al.  Chemotherapy operations planning and scheduling , 2012 .

[12]  Susana V. Mondschein,et al.  APPOINTMENT POLICIES IN SERVICE OPERATIONS: A CRITICAL ANALYSIS OF THE ECONOMIC FRAMEWORK , 2003 .

[13]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[14]  Archis Ghate,et al.  Lagrangian relaxation and constraint generation for allocation and advanced scheduling , 2012, Comput. Oper. Res..

[15]  Rainer Kolisch,et al.  Providing radiology health care services to stochastic demand of different customer classes , 2008, OR Spectr..

[16]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[17]  Emre A. Veral,et al.  OUTPATIENT SCHEDULING IN HEALTH CARE: A REVIEW OF LITERATURE , 2003 .

[18]  Martin L. Puterman,et al.  Dynamic multi-appointment patient scheduling for radiation therapy , 2012, European Journal of Operational Research.

[19]  N. Bailey.  A Study of Queues and Appointment Systems in Hospital Out‐Patient Departments, with Special Reference to Waiting‐Times , 1952 .

[20]  Diego Klabjan,et al.  Computing Near-Optimal Policies in Generalized Joint Replenishment , 2012, INFORMS J. Comput..

[21]  Ben Wang,et al.  Managing Patient Service in a Diagnostic Medical Facility , 2006, Oper. Res..

[22]  Anton J. Kleywegt,et al.  The Dynamic and Stochastic Knapsack Problem , 1998, Oper. Res..

[23]  T. Rohleder,et al.  Outpatient appointment scheduling with urgent clients in a dynamic, multi‐period environment , 2004 .

[24]  Nan Liu,et al.  Dynamic Scheduling of Outpatient Appointments Under Patient No-Shows and Cancellations , 2010, Manuf. Serv. Oper. Manag..

[25]  Yuehwern Yih,et al.  An elective surgery scheduling problem considering patient priority , 2010, Comput. Oper. Res..

[26]  Erika Hawley,et al.  An Acuity Rating System for Infusion Center Nurse Staffing , 2009 .

[27]  Martin L Puterman,et al.  Operations research methods improve chemotherapy patient appointment scheduling. , 2012, Joint Commission journal on quality and patient safety.

[28]  Xiaolan Xie,et al.  A stochastic model for operating room planning with elective and emergency demand for surgery , 2008, Eur. J. Oper. Res..