Approximate Bayesian Computation for an Explicit-Duration Hidden Markov Model of COVID-19 Hospital Trajectories

We address the problem of modeling constrained hospital resources in the midst of the COVID-19 pandemic in order to inform decision-makers of future demand and assess the societal value of possible interventions. For broad applicability, we focus on the common yet challenging scenario where patient-level data for a region of interest are not available. Instead, given daily admissions counts, we model aggregated counts of observed resource use, such as the number of patients in the general ward, in the intensive care unit, or on a ventilator. In order to explain how individual patient trajectories produce these counts, we propose an aggregate count explicit-duration hidden Markov model, nicknamed the ACED-HMM, with an interpretable, compact parameterization. We develop an Approximate Bayesian Computation approach1 that draws samples from the posterior distribution over the model’s transition and duration parameters given aggregate counts from a specific location, thus adapting the model to a region or individual hospital site of interest. Samples from this posterior can then be used to produce future forecasts of any counts of interest. Using data from the United States and the United Kingdom, we show our mechanistic approach provides competitive probabilistic forecasts for the future even as the dynamics of the pandemic shift. Furthermore, we show how our model provides insight about recovery probabilities or length of stay distributions, and we suggest its potential to answer challenging what-if questions about the societal value of possible interventions.

[1]  Viet Chi Tran,et al.  HIV with contact tracing: a case study in approximate Bayesian computation. , 2008, Biostatistics.

[2]  Christopher Joseph Pal,et al.  Unimodal Probability Distributions for Deep Ordinal Classification , 2017, ICML.

[3]  Martin A. Tanner,et al.  Forecasting for COVID-19 has failed , 2020, International Journal of Forecasting.

[4]  D. Skovronsky,et al.  SARS-CoV-2 Neutralizing Antibody LY-CoV555 in Outpatients with Covid-19 , 2020, The New England journal of medicine.

[5]  E. Gakidou,et al.  Predictive performance of international COVID-19 mortality forecasting models , 2020, medRxiv.

[6]  John Salvatier,et al.  Probabilistic programming in Python using PyMC3 , 2016, PeerJ Comput. Sci..

[7]  Dustin Tran,et al.  Automatic Differentiation Variational Inference , 2016, J. Mach. Learn. Res..

[8]  Gilles Louppe,et al.  The frontier of simulation-based inference , 2020, Proceedings of the National Academy of Sciences.

[9]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[10]  David D. Kim,et al.  Consideration Of Value-Based Pricing For Treatments And Vaccines Is Important, Even In The COVID-19 Pandemic. , 2020, Health affairs.

[11]  Nicholas P Jewell,et al.  Predictive Mathematical Models of the COVID-19 Pandemic: Underlying Principles and Value of Projections. , 2020, JAMA.

[12]  Marcello Colozzo Predictive Mathematical Models of the Covid–19 Pandemic in Ode/sde Framework , 2020 .

[13]  Ihme COVID-19 Forecasting Team Modeling COVID-19 scenarios for the United States , 2020, Nature medicine.

[14]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[15]  I JordanMichael,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008 .

[16]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[17]  R. Epstein,et al.  A Predictive Model for Patient Census and Ventilator Requirements at Individual Hospitals During the Coronavirus Disease 2019 (COVID-19) Pandemic: A Preliminary Technical Report , 2020, Cureus.

[18]  J. Pulliam,et al.  Cost-effectiveness of remdesivir and dexamethasone for COVID-19 treatment in South Africa , 2020, medRxiv.

[19]  L. Wang,et al.  Epidemic Model Guided Machine Learning for COVID-19 Forecasts in the United States , 2020, medRxiv.

[20]  Jean-Michel Marin,et al.  Approximate Bayesian computational methods , 2011, Statistics and Computing.

[21]  Leah H. Jamieson,et al.  Modeling duration in a hidden Markov model with the exponential family , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Robert Leenders,et al.  Hamiltonian ABC , 2015, UAI.

[23]  Gary E. Weissman,et al.  Locally Informed Simulation to Predict Hospital Capacity Needs During the COVID-19 Pandemic , 2020, Annals of Internal Medicine.

[24]  S. Bhatt,et al.  Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe , 2020, Nature.

[25]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[26]  C. Murray Forecasting the impact of the first wave of the COVID-19 pandemic on hospital demand and deaths for the USA and European Economic Area countries , 2020, medRxiv.

[27]  John B. Wong,et al.  Forecasting COVID-19 Counts At A Single Hospital: A Hierarchical Bayesian Approach , 2021, ArXiv.

[28]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[29]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[30]  A. Gandjour How Many Intensive Care Beds are Justifiable for Hospital Pandemic Preparedness? A Cost-effectiveness Analysis for COVID-19 in Germany , 2021, Applied Health Economics and Health Policy.

[31]  F. Clement,et al.  Treatment of moderate to severe respiratory COVID-19: a cost-utility analysis , 2020, Scientific Reports.

[32]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[33]  R. Baker,et al.  Mechanistic models versus machine learning, a fight worth fighting for the biological community? , 2018, Biology Letters.

[34]  M. Saquib,et al.  Primed for global coronavirus pandemic: Emerging research and clinical outcome , 2020, European Journal of Medicinal Chemistry.

[35]  L. Dodd,et al.  Remdesivir for the Treatment of Covid-19 — Final Report , 2020, The New England journal of medicine.

[36]  R. Plevin,et al.  Approximate Bayesian Computation in Evolution and Ecology , 2011 .

[37]  M. Pareek,et al.  Awake prone positioning in COVID-19 , 2020, Thorax.

[38]  Mihaela van der Schaar,et al.  CPAS: the UK’s national machine learning-based hospital capacity planning system for COVID-19 , 2020, Machine-mediated learning.

[39]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[40]  Uri Shalit,et al.  Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study , 2021, J. Am. Medical Informatics Assoc..