Tactical Planning in Healthcare using Approximate Dynamic Programming

Tactical planning of resources in hospitals concerns elective patient admission planning and the intermediate term allocation of resource capacities. Its main objectives are to achieve equitable access for patients, to serve the strategically agreed number of patients, and to use resources efficiently. We propose a method to develop a tactical resource allocation and patient admission plan that takes stochastic elements into consideration, thereby providing robust plans. Our method is developed in an Approximate Dynamic Programming (ADP) framework and copes with multiple resources, multiple time periods and multiple patient groups with various uncertain treatment paths through the hospital and an uncertain number of arrivals in each time period, thereby integrating decision making for a chain of hospital resources. Computational results indicate that the ADP approach provides an accurate approximation of the value functions, and that it is suitable for large problem instances at hospitals, in which the ADP approach performs significantly better than two other heuristic approaches. Our ADP algorithm is generic, as various cost functions and basis functions can be used in various settings of tactical hospital management.

[1]  Gabriel M Leung,et al.  Waiting time and doctor shopping in a mixed medical economy. , 2004, Health economics.

[2]  Elizabeth Olmsted Teisberg,et al.  How physicians can change the future of health care. , 2007, JAMA.

[3]  Maurice Queyranne,et al.  Dynamic Multipriority Patient Scheduling for a Diagnostic Resource , 2008, Oper. Res..

[4]  Erwin W Hans,et al.  Tactical resource allocation and elective patient admission planning in care processes , 2013, Health care management science.

[5]  Warren B. Powell,et al.  Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley Series in Probability and Statistics) , 2007 .

[6]  Solon Venâncio de Carvalho,et al.  Markov decision process applied to the control of hospital elective admissions , 2009, Artif. Intell. Medicine.

[7]  Richard J. Boucherie,et al.  Product forms for queueing networks with state-dependent multiple job transitions , 1991, Advances in Applied Probability.

[8]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[9]  R. Hall,et al.  Patient flow : reducing delay in healthcare delivery , 2006 .

[10]  Peter J. H. Hulshof,et al.  A Framework for Healthcare Planning and Control , 2012 .

[11]  Stephen C. Graves,et al.  A Tactical Planning Model for a Job Shop , 1986, Oper. Res..

[12]  Rainer Kolisch,et al.  Approximate Dynamic Programming for Capacity Allocation in the Service Industry , 2010, Eur. J. Oper. Res..

[13]  Huseyin Topaloglu,et al.  Approximate dynamic programming for dynamic capacity allocation with multiple priority levels , 2010 .

[14]  C. Cannon,et al.  Critical pathways : a review. Committee on Acute Cardiac Care, Council on Clinical Cardiology, American Heart Association. , 2000, Circulation.

[15]  Sally McClean,et al.  A non-homogeneous discrete time Markov model for admission scheduling and resource planning in a cost or capacity constrained healthcare system , 2010, Health care management science.

[16]  Erik Demeulemeester,et al.  Capacity of Clinical Pathways—A Strategic Multi-level Evaluation Tool , 2008, Journal of Medical Systems.

[17]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[18]  Warren B. Powell,et al.  Approximate dynamic programming for management of high‐value spare parts , 2009, Journal of Manufacturing Technology Management.

[19]  Verena Schmid,et al.  Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming , 2012, Eur. J. Oper. Res..

[20]  Matthew S. Maxwell,et al.  Approximate Dynamic Programming for Ambulance Redeployment , 2010, INFORMS J. Comput..

[21]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[22]  Asha Seth Kapadia,et al.  Predicting course of treatment in a rehabilitation hospital: A Markovian model , 1985, Comput. Oper. Res..

[23]  Warren B. Powell,et al.  Dynamic-Programming Approximations for Stochastic Time-Staged Integer Multicommodity-Flow Problems , 2006, INFORMS J. Comput..