Applying optimal control theory to complex epidemiological models to inform real-world disease management

Mathematical models provide a rational basis to inform how, where and when to control disease. Assuming an accurate spatially-explicit simulation model can be fitted to spread data, it is straightforward to use it to test the performance of a range of management strategies. However, the typical complexity of simulation models and the vast set of possible controls mean that only a small subset of all possible strategies can ever be tested. An alternative approach – optimal control theory – allows the very best control to be identified unambiguously. However, the complexity of the underpinning mathematics means that disease models used to identify this optimum must be very simple. We highlight two frameworks for bridging the gap between detailed epidemic simulations and optimal control theory: open-loop and model predictive control. Both these frameworks approximate a simulation model with a simpler model more amenable to mathematical analysis. Using an illustrative example model we show the benefits of using feedback control, in which the approximation and control are updated as the epidemic progresses. Our work illustrates a new methodology to allow the insights of optimal control theory to inform practical disease management strategies, with the potential for application to diseases of plants, animals and humans.

[1]  Jay H. Lee,et al.  Model predictive control: Review of the three decades of development , 2011 .

[2]  C. Gilligan,et al.  Thirteen challenges in modelling plant diseases. , 2015, Epidemics.

[3]  C. Gilligan,et al.  Balancing Detection and Eradication for Control of Epidemics: Sudden Oak Death in Mixed-Species Stands , 2010, PloS one.

[4]  Christopher A. Gilligan,et al.  Optimal control of epidemics in metapopulations , 2009, Journal of The Royal Society Interface.

[5]  Christopher A. Gilligan,et al.  Optimising and Communicating Options for the Control of Invasive Plant Disease When There Is Epidemiological Uncertainty , 2015, PLoS Comput. Biol..

[6]  Péter L. Simon,et al.  Dynamic Control of Modern, Network-Based Epidemic Models , 2014, SIAM J. Appl. Dyn. Syst..

[7]  Ryan Zurakowski,et al.  A model predictive control based scheduling method for HIV therapy. , 2006, Journal of theoretical biology.

[8]  R. Neilan,et al.  Optimal vaccine distribution in a spatiotemporal epidemic model with an application to rabies and raccoons , 2011 .

[9]  David L Smith,et al.  Predicting the spatial dynamics of rabies epidemics on heterogeneous landscapes , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[10]  V. Isham,et al.  Modeling infectious disease dynamics in the complex landscape of global health , 2015, Science.

[11]  Harvey Thomas Banks,et al.  Receding Horizon Control of HIV , 2011 .

[12]  James Clarke,et al.  Approximating Optimal Controls for Networks when There Are Combinations of Population-Level and Targeted Measures Available: Chlamydia Infection as a Case-Study , 2013, Bulletin of mathematical biology.

[13]  R. Epanchin‐Niell Economics of invasive species policy and management , 2017, Biological Invasions.

[14]  R. Hovorka,et al.  Nonlinear model predictive control of glucose concentration in subjects with type 1 diabetes. , 2004, Physiological measurement.

[15]  C. Hollier,et al.  Crop losses due to diseases and their implications for global food production losses and food security , 2012, Food Security.

[16]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[17]  Daniel L. K. Yamins,et al.  Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition , 2014, PLoS Comput. Biol..

[18]  S. J. Whitehead,et al.  Health outcomes in economic evaluation: the QALY and utilities. , 2010, British medical bulletin.

[19]  R M May,et al.  A preliminary study of the transmission dynamics of the human immunodeficiency virus (HIV), the causative agent of AIDS. , 1986, IMA journal of mathematics applied in medicine and biology.

[20]  V.L. Brown,et al.  The role of optimal control in assessing the most cost-effective implementation of a vaccination programme: HPV as a case study. , 2011, Mathematical biosciences.

[21]  H. Behncke Optimal control of deterministic epidemics , 2000 .

[22]  M. Keeling,et al.  Modeling Infectious Diseases in Humans and Animals , 2007 .

[23]  Richard O. J. H. Stutt,et al.  Risk‐based management of invading plant disease , 2017, The New phytologist.

[24]  S. Sethi,et al.  Optimal Control of Some Simple Deterministic Epidemic Models , 1978 .

[25]  Alessandro Vespignani,et al.  Opinion: Mathematical models: A key tool for outbreak response , 2014, Proceedings of the National Academy of Sciences.

[26]  Gerardo Chowell,et al.  Merging Economics and Epidemiology to Improve the Prediction and Management of Infectious Disease , 2014, EcoHealth.

[27]  John T. Workman,et al.  Optimal Control Applied to Biological Models , 2007 .

[28]  Christopher A. Gilligan,et al.  Cost-Effective Control of Plant Disease When Epidemiological Knowledge Is Incomplete: Modelling Bahia Bark Scaling of Citrus , 2014, PLoS Comput. Biol..

[29]  M. Jit,et al.  Transmission dynamic modelling of the impact of human papillomavirus vaccination in the United Kingdom. , 2010, Vaccine.

[30]  Nik J Cunniffe,et al.  Modeling when, where, and how to manage a forest epidemic, motivated by sudden oak death in California , 2016, Proceedings of the National Academy of Sciences.

[31]  Mark Jit,et al.  Economic evaluation of human papillomavirus vaccination in the United Kingdom , 2008, BMJ : British Medical Journal.

[32]  Six challenges in modelling for public health policy. , 2015, Epidemics.

[33]  Anne Nagel,et al.  Model Predictive Control In The Process Industry , 2016 .

[34]  Christopher A. Gilligan,et al.  Control fast or control smart: When should invading pathogens be controlled? , 2018, PLoS Comput. Biol..

[35]  M. Keeling Models of foot-and-mouth disease , 2005, Proceedings of the Royal Society B: Biological Sciences.

[36]  I. Boyd,et al.  The Consequence of Tree Pests and Diseases for Ecosystem Services , 2013, Science.

[37]  R. May,et al.  Modelling vaccination strategies against foot-and-mouth disease , 2003, Nature.

[38]  E. Boersma,et al.  Prevention of Catheter-Related Bacteremia with a Daily Ethanol Lock in Patients with Tunnelled Catheters: A Randomized, Placebo-Controlled Trial , 2010, PloS one.

[39]  Christopher A Gilligan,et al.  Optimizing the control of disease infestations at the landscape scale , 2007, Proceedings of the National Academy of Sciences.

[40]  George Streftaris,et al.  Evidence-based controls for epidemics using spatio-temporal stochastic models in a Bayesian framework , 2017, Journal of The Royal Society Interface.

[41]  R Laubenbacher,et al.  Optimization and Control of Agent-Based Models in Biology: A Perspective , 2016, Bulletin of mathematical biology.

[42]  Rob Deardon,et al.  Optimal reactive vaccination strategies for a foot-and-mouth outbreak in the UK , 2006, Nature.

[43]  Christopher A. Gilligan,et al.  Resource Allocation for Epidemic Control in Metapopulations , 2011, PloS one.

[44]  R. Bellman Dynamic programming. , 1957, Science.

[45]  S. Cornell,et al.  Dynamics of the 2001 UK Foot and Mouth Epidemic: Stochastic Dispersal in a Heterogeneous Landscape , 2001, Science.