A stochastic model of acute-care decisions based on patient and provider heterogeneity

The primary cause of preventable death in many hospitals is the failure to recognize and/or rescue patients from acute physiologic deterioration (APD). APD affects all hospitalized patients, potentially causing cardiac arrest and death. Identifying APD is difficult, and response timing is critical - delays in response represent a significant and modifiable patient safety issue. Hospitals have instituted rapid response systems or teams (RRT) to provide timely critical care for APD, with thresholds that trigger the involvement of critical care expertise. The National Early Warning Score (NEWS) was developed to define these thresholds. However, current triggers are inconsistent and ignore patient-specific factors. Further, acute care is delivered by providers with different clinical experience, resulting in quality-of-care variation. This article documents a semi-Markov decision process model of APD that incorporates patient and provider heterogeneity. The model allows for stochastically changing health states, while determining patient subpopulation-specific RRT-activation thresholds. The objective function minimizes the total time associated with patient deterioration and stabilization; and the relative values of nursing and RRT times can be modified. A case study from January 2011 to December 2012 identified six subpopulations. RRT activation was optimal for patients in “slightly concerning” health states (NEWS > 0) for all subpopulations, except surgical patients with low risk of deterioration for whom RRT was activated in “concerning” states (NEWS > 4). Clustering methods identified provider clusters considering RRT-activation preferences and estimation of stabilization-related resource needs. Providers with conservative resource estimates preferred waiting over activating RRT. This study provides simple practical rules for personalized acute care delivery.

[1]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[2]  Craig Boutilier,et al.  Robust Online Optimization of Reward-Uncertain MDPs , 2011, IJCAI.

[3]  D. Bell,et al.  Early warning systems in the UK: variation in content and implementation strategy has implications for a NHS early warning system. , 2011, Clinical medicine.

[4]  G. Romanin-Jacur,et al.  Application of semi-Markov processes to health care planning: a model to study the flow of patients following the dialysis-transplantation plan , 1986 .

[5]  K. Thomas,et al.  Rapid response team: challenges, solutions, benefits. , 2007, Critical care nurse.

[6]  Ann M Mayo,et al.  Rapid response teams: qualitative analysis of their effectiveness. , 2013, American journal of critical care : an official publication, American Association of Critical-Care Nurses.

[7]  Daniel Kuhn,et al.  Robust Markov Decision Processes , 2013, Math. Oper. Res..

[8]  T. W. Anderson,et al.  Statistical Inference about Markov Chains , 1957 .

[9]  E N Weiss,et al.  An iterative estimation and validation procedure for specification of semi-Markov models with application to hospital patient flow. , 1982, Operations research.

[10]  J C Hershey,et al.  Analysis of capacity decisions for progressive patient care hospital facilities. , 1980, Health services research.

[11]  Chelsea C. White,et al.  Procedures for the Solution of a Finite-Horizon, Partially Observed, Semi-Markov Optimization Problem , 1976, Oper. Res..

[12]  M. Gold Cost-effectiveness in health and medicine , 2016 .

[13]  L. Infante,et al.  Hierarchical Clustering , 2020, International Encyclopedia of Statistical Science.

[14]  Patricia C. Dykes,et al.  The adequacy of ICNP version 1.0 as a representational model for electronic nursing assessment documentation. , 2009, Journal of the American Medical Informatics Association : JAMIA.

[15]  Daryl A Jones,et al.  Effectiveness of the Medical Emergency Team: the importance of dose , 2009, Critical care.

[16]  J R Beck,et al.  Markov Models in Medical Decision Making , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  Andrew J. Schaefer,et al.  The Optimal Time to Initiate HIV Therapy Under Ordered Health States , 2008, Oper. Res..

[18]  Daryl A Jones,et al.  Long term effect of a medical emergency team on cardiac arrests in a teaching hospital , 2005, Critical care.

[19]  Marvin Zelen,et al.  A SEMI-MARKOV MODEL FOR CLINICAL TRIALS , 1965 .

[20]  Michael J. Rothman,et al.  Development and validation of a continuous measure of patient condition using the Electronic Medical Record , 2013, J. Biomed. Informatics.

[21]  Andrew J. Schaefer,et al.  The Optimal Timing of Living-Donor Liver Transplantation , 2004, Manag. Sci..

[22]  M. Devita,et al.  Use of medical emergency team responses to reduce hospital cardiopulmonary arrests , 2004, Quality and Safety in Health Care.

[23]  Julie S. Ivy,et al.  Individualizing and optimizing the use of early warning scores in acute medical care for deteriorating hospitalized patients. , 2015, Resuscitation.

[24]  C. Subbe,et al.  Validation of a modified Early Warning Score in medical admissions. , 2001, QJM : monthly journal of the Association of Physicians.

[25]  Gary B. Smith,et al.  Hospital-wide physiological surveillance-a new approach to the early identification and management of the sick patient. , 2006, Resuscitation.

[26]  U. Kyriacos,et al.  Monitoring vital signs using early warning scoring systems: a review of the literature. , 2011, Journal of nursing management.

[27]  Comilla Sasson,et al.  Rapid Response Teams: A Systematic Review and Meta-analysis. , 2010, Archives of internal medicine.

[28]  Garud Iyengar,et al.  Robust Dynamic Programming , 2005, Math. Oper. Res..

[29]  Shie Mannor,et al.  Distributionally Robust Markov Decision Processes , 2010, Math. Oper. Res..

[30]  E P Kao,et al.  A semi-Markov model to predict recovery progress of coronary patients. , 1972, Health services research.

[31]  T. Hodgetts,et al.  Evaluation of a medical emergency team one year after implementation. , 2004, Resuscitation.

[32]  Elizabeth A. Hunt,et al.  Rapid response systems: A systematic review* , 2007, Critical care medicine.

[33]  Laurent El Ghaoui,et al.  Robust Control of Markov Decision Processes with Uncertain Transition Matrices , 2005, Oper. Res..

[34]  K. Hillman,et al.  Introduction of the medical emergency team (MET) system: a cluster-randomised controlled trial , 2005, The Lancet.

[35]  C. Manthous Rapid-response teams. , 2011, The New England journal of medicine.