Dynamic Allocation of Scarce Resources Under Supply Uncertainty

We present a model of dynamic resource allocation in a setting where continuity of service is important and future resource availability is uncertain. The paper is inspired by the challenges faced by HIV clinics in resource-limited settings in the allocation of scarce HIV treatment among a large pool of eligible patients. Many clinics receive insufficient supply to treat all patients and the supply they do receive is highly uncertain. This supply uncertainty, combined with the clinical importance of an uninterrupted treatment throughout patients’ life, requires the clinics to make a trade-off between providing access to treatment for new patients and ensuring continuity of treatment for current patients. Setting aside other aspects of the treatment rationing problem, we model the decisions of a clinic facing this trade-off using stochastic dynamic programming. We derive sufficient conditions under which the optimal policy coincides with the clinically preferred policy of prioritizing previously enrolled patients. We use numerical examples to investigate the impact of supply uncertainty on the performance of enrollment policies used in practice. We also discuss how our model applies to other intertemporal resource allocation decisions such as that faced by non-profit organizations where continuity of service is crucial to meeting the organization’s social objective, or that faced by an entrepreneur who wants to attract new customers without reducing service quality to existing customers.

[1]  M. Brandeau,et al.  Resource allocation for control of infectious diseases in multiple independent populations: beyond cost-effectiveness analysis. , 2003, Journal of health economics.

[2]  S. Deo Three essays in healthcare operations management , 2007 .

[3]  Richard V. Evans Sales and Restocking Policies in a Single Item Inventory System , 1968 .

[4]  B. L. Miller Optimal Consumption with a Stochastic Income Stream , 1974 .

[5]  Richard V. Evans Inventory control of a multiproduct system with a limited production resource , 1967 .

[6]  Michael W. Carter,et al.  Multi-level resource allocation for HIV prevention: A model for developing countries , 2007, Eur. J. Oper. Res..

[7]  Anthony D Harries,et al.  Ensuring uninterrupted supplies of antiretroviral drugs in resource-poor settings: an example from Malawi. , 2007, Bulletin of the World Health Organization.

[8]  D. Mcintyre,et al.  The cost-effectiveness of Antiretroviral Treatment in Khayelitsha, South Africa – a primary data analysis , 2006, Cost effectiveness and resource allocation : C/E.

[9]  P. Kissinger,et al.  Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. , 1998, The New England journal of medicine.

[10]  B. Deuermeyer,et al.  A By-Product Production System with an Alternative , 1978 .

[11]  D R Holtgrave,et al.  Updates of cost of illness and quality of life estimates for use in economic evaluations of HIV prevention programs. , 1997, Journal of acquired immune deficiency syndromes and human retrovirology : official publication of the International Retrovirology Association.

[12]  J. Jelsma,et al.  An investigation into the health-related quality of life of individuals living with HIV who are receiving HAART , 2005, AIDS care.

[13]  Lawrence M. Wein,et al.  Dynamic Allocation of Kidneys to Candidates on the Transplant Waiting List , 2000, Oper. Res..

[14]  B. Thiers,et al.  CD4+ Count–Guided Interruption of Antiretroviral Treatment , 2007 .

[15]  R. Macklin ETHICS AND EQUITY IN ACCESS TO HIV TREATMENT — 3 BY 5 INITIATIVE , 2004 .

[16]  Uday S. Karmarkar,et al.  Infinite Horizon Investment—Consumption Policies , 1979 .

[17]  O. Laeyendecker,et al.  Treatment interruptions predict resistance in HIV-positive individuals purchasing fixed-dose combination antiretroviral therapy in Kampala, Uganda , 2007, AIDS.

[18]  J Jaap Wessels,et al.  Note---A Note on Dynamic Programming with Unbounded Rewards , 1975 .

[19]  Sara Bennett,et al.  Approaches to rationing antiretroviral treatment: ethical and equity implications. , 2005, Bulletin of the World Health Organization.

[20]  Albert Y. Ha Stock-rationing policy for a make-to-stock production system with two priority classes and backordering , 1997 .

[21]  T. Quinn,et al.  Which patients first? Setting priorities for antiretroviral therapy where resources are limited. , 2005, American journal of public health.

[22]  Izak Duenyas,et al.  Optimal Policies for Inventory Systems with Priority Demand Classes , 2003, Oper. Res..

[23]  Karen Donohue,et al.  A Threshold Inventory Rationing Policy for Service - Differentiated Demand Classes , 2003, Manag. Sci..

[24]  J. V. van Oosterhout,et al.  Evaluation of antiretroviral therapy results in a resource‐poor setting in Blantyre, Malawi , 2005, Tropical medicine & international health : TM & IH.

[25]  D K Owens,et al.  An Analysis of Optimal Resource Allocation for Prevention of Infection with Human Immunodeficiency Virus (HIV) in Injection Drug Users and Non-Users , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  J. Simon,et al.  Hard choices: rationing antiretroviral therapy for HIV/AIDS in Africa , 2005, The Lancet.

[27]  Vincent P. Simpson Optimum Solution Structure for a Repairable Inventory Problem , 1978, Oper. Res..

[28]  Edward H. Kaplan,et al.  Allocating HIV prevention resources , 1998 .

[29]  Albert Y. Ha Inventory rationing in a make-to-stock production system with several demand classes and lost sales , 1997 .

[30]  Kelley Oj Agency for International Development. , 1973 .

[31]  Nancy L. Stokey,et al.  Recursive methods in economic dynamics , 1989 .

[32]  S. Knobler,et al.  Scaling up treatment for the global AIDS pandemic : challenges and opportunities , 2005 .

[33]  Yves Dallery,et al.  Optimal Stock Allocation for a Capacitated Supply System , 2002, Manag. Sci..

[34]  Steven Nahmias,et al.  Operating Characteristics of an Inventory System with Rationing , 1981 .

[35]  Ian Sanne,et al.  Rationing Antiretroviral Therapy for HIV/AIDS in Africa: Choices and Consequences , 2005, PLoS medicine.

[36]  Michael Drummond,et al.  Principles of economic appraisal in health care , 1980 .

[37]  M L Brandeau,et al.  Optimal Investment in a Portfolio of HIV Prevention Programs , 2001, Medical decision making : an international journal of the Society for Medical Decision Making.

[38]  S. Lippman Semi-Markov Decision Processes with Unbounded Rewards , 1973 .

[39]  Uday S. Karmarkar,et al.  The Multiperiod Multilocation Inventory Problem , 1981, Oper. Res..

[40]  E. Denardo CONTRACTION MAPPINGS IN THE THEORY UNDERLYING DYNAMIC PROGRAMMING , 1967 .

[41]  Jeffrey L. Bradach,et al.  Should nonprofits seek profits? , 2005, Harvard business review.

[42]  Katherine Scott Funding Matters: The Impact of Canada’s New Funding Regime on Nonprofit and Voluntary Organizations , 2005 .

[43]  Y. Hasenfeld Human Services as Complex Organizations , 2009 .

[44]  Rachel Q. Zhang,et al.  Inventory Policies for Systems with Stochastic and Deterministic Demand , 2001, Oper. Res..

[45]  Francis de Véricourt,et al.  Resource and Revenue Management in Nonprofit Operations , 2009, Oper. Res..

[46]  D. M. Topkis OPTIMAL ORDERING AND RATIONING POLICIES IN A NONSTATIONARY DYNAMIC INVENTORY MODEL WITH n DEMAND CLASSES , 1968 .

[47]  Michael Drummond,et al.  Studies in economic appraisal in health care , 1981 .

[48]  A. Wagstaff QALYs and the equity-efficiency trade-off. , 1991, Journal of health economics.

[49]  J. Dees Enterprising nonprofits. , 1998, Harvard business review.

[50]  M S Thompson,et al.  First principles of cost-effectiveness analysis in health. , 1979, Public health reports.