Designing combination therapies using multiple optimal controls

Strategic management of populations of interacting biological species routinely requires interventions combining multiple treatments or therapies. This is important in key research areas such as ecology, epidemiology, wound healing and oncology. Despite the well developed theory and techniques for determining single optimal controls, there is limited practical guidance supporting implementation of combination therapies. In this work we use optimal control theory to calculate optimal strategies for applying combination therapies to a model of acute myeloid leukaemia. We consider various combinations of continuous and bang-bang (discrete) controls, and we investigate how the control dynamics interact and respond to changes in the weighting and form of the pay-off characterising optimality. We demonstrate that the optimal controls respond non-linearly to treatment strength and control parameters, due to the interactions between species. We discuss challenges in appropriately characterising optimality in a multiple control setting and provide practical guidance for applying multiple optimal controls. Code used in this work to implement multiple optimal controls is available on GitHub.

[1]  F Castiglione,et al.  Cancer immunotherapy, mathematical modeling and optimal control. , 2007, Journal of theoretical biology.

[2]  P. N. Paraskevopoulos,et al.  Modern Control Engineering , 2001 .

[3]  Kevin Burrage,et al.  Optimal control of acute myeloid leukaemia. , 2019, Journal of theoretical biology.

[4]  Gerardo Chowell,et al.  Exploring optimal control strategies in seasonally varying flu-like epidemics. , 2017, Journal of theoretical biology.

[5]  Helen Moore,et al.  How to mathematically optimize drug regimens using optimal control , 2018, Journal of Pharmacokinetics and Pharmacodynamics.

[6]  Mario Castro,et al.  Mathematics in modern immunology , 2016, Interface Focus.

[7]  Asim Khwaja,et al.  Acute myeloid leukaemia , 2016, Nature Reviews Disease Primers.

[8]  Akin Savas Toklu,et al.  Is combined therapy more effective than growth hormone or hyperbaric oxygen alone in the healing of left ischemic and non-ischemic colonic anastomoses? , 2013, Clinics.

[9]  Ben Zion Shklyar,et al.  Optimization of Combined Leukemia Therapy by Finite-Dimensional Optimal Control Modeling , 2017, J. Optim. Theory Appl..

[10]  Sarah Filippi,et al.  The ecology in the hematopoietic stem cell niche determines the clinical outcome in chronic myeloid leukemia , 2014, Proceedings of the National Academy of Sciences.

[11]  D. Pollyea,et al.  Therapeutic targeting of acute myeloid leukemia stem cells. , 2017, Blood.

[12]  George M. Siouris,et al.  Applied Optimal Control: Optimization, Estimation, and Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Katriona Shea,et al.  Beyond dose: Pulsed antibiotic treatment schedules can maintain individual benefit while reducing resistance , 2018, Scientific Reports.

[14]  Adam L. Maclean,et al.  Population dynamics of normal and leukaemia stem cells in the haematopoietic stem cell niche show distinct regimes where leukaemia will be controlled , 2013, Journal of The Royal Society Interface.

[15]  Urszula Ledzewicz,et al.  Optimal control for combination therapy in cancer , 2008, 2008 47th IEEE Conference on Decision and Control.

[16]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[17]  Suzanne Lenhart,et al.  Optimal control of treatment in a mathematical model of chronic myelogenous leukemia. , 2007, Mathematical biosciences.

[18]  Emanuel Todorov,et al.  Iterative Linear Quadratic Regulator Design for Nonlinear Biological Movement Systems , 2004, ICINCO.

[19]  A. J. Lotka,et al.  Elements of Physical Biology. , 1925, Nature.

[20]  Urszula Ledzewicz,et al.  Optimal Control for Mathematical Models of Cancer Therapies: An Application of Geometric Methods , 2015 .

[21]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[22]  B. Goh.  Necessary Conditions for Singular Extremals Involving Multiple Control Variables , 1966 .

[23]  Agnès Sulem,et al.  Dynamic Optimization of Long‐Term Growth Rate for a Portfolio with Transaction Costs and Logarithmic Utility , 2001 .

[24]  S. Lenhart,et al.  Modeling Optimal Intervention Strategies for Cholera , 2010, Bulletin of mathematical biology.

[25]  Matthias Waltert,et al.  Spatio-temporal niche partitioning between the African lion (Panthera leo leo) and spotted hyena (Crocuta crocuta) in western African savannas , 2018, European Journal of Wildlife Research.

[26]  Shimon Whiteson,et al.  Multi-Objective Decision Making , 2017, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[27]  Denise E Kirschner,et al.  Mathematical and computational approaches can complement experimental studies of host-pathogen interactions. , 2009, Cellular microbiology.

[28]  D. Hanahan,et al.  Hallmarks of Cancer: The Next Generation , 2011, Cell.

[29]  Torsten Haferlach,et al.  Relapse kinetics in acute myeloid leukaemias with MLL translocations or partial tandem duplications within the MLL gene , 2014, British journal of haematology.

[30]  David B. Lindenmayer,et al.  Unintended Consequences of Invasive Predator Control in an Australian Forest: Overabundant Wallabies and Vegetation Change , 2013, PloS one.

[31]  Maxwell Noton,et al.  Modern control engineering , 1972 .

[32]  D. Janzen.  COEVOLUTION OF MUTUALISM BETWEEN ANTS AND ACACIAS IN CENTRAL AMERICA , 1966, Evolution; international journal of organic evolution.

[33]  P. Ferreras,et al.  Can widespread generalist predators affect keystone prey? A case study with red foxes and European rabbits in their native range , 2015, Population Ecology.

[34]  Michael Bode,et al.  Spatial control of invasive species in conservation landscapes , 2013, Computational Management Science.

[35]  R. S. G. Holdrinet,et al.  Proliferation patterns in acute myeloid leukemia: leukemic clonogenic growth and in vivo cell cycle kinetics , 1993, Annals of Hematology.

[36]  Xunbin Wei,et al.  In vivo imaging of specialized bone marrow endothelial microdomains for tumour engraftment , 2005, Nature.

[37]  Urszula Ledzewicz,et al.  Bang-bang and singular controls in a mathematical model for combined anti-angiogenic and chemotherapy treatments , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[38]  Katarzyna A. Rejniak,et al.  Systems Biology of Tumor Microenvironment , 2016, Advances in Experimental Medicine and Biology.

[39]  C. Kumar,et al.  Genetic abnormalities and challenges in the treatment of acute myeloid leukemia. , 2011, Genes & cancer.

[40]  Peter S. Kim,et al.  Optimisation of anti-cancer peptide vaccines to preferentially elicit high-avidity T cells. , 2019, Journal of theoretical biology.

[41]  Farida Chamchod,et al.  Modeling the spread of capripoxvirus among livestock and optimal vaccination strategies. , 2018, Journal of theoretical biology.

[42]  John Carl Panetta,et al.  Optimal Control Applied to Cell-Cycle-Specific Cancer Chemotherapy , 2000, SIAM J. Appl. Math..

[43]  Thomas Stiehl,et al.  Cell division patterns in acute myeloid leukemia stem-like cells determine clinical course: a model to predict patient survival. , 2015, Cancer research.

[44]  Willi Jäger,et al.  Modeling of asymmetric cell division in hematopoietic stem cells--regulation of self-renewal is essential for efficient repopulation. , 2009, Stem cells and development.

[45]  Mudassar Imran,et al.  Optimal control with multiple human papillomavirus vaccines. , 2016, Journal of theoretical biology.

[46]  Moshe Yeshurun,et al.  Autologous hematopoietic cell transplantation for AML in first remission - An abandoned practice or promising approach? , 2019, Seminars in hematology.

[47]  Satoshi Tanaka,et al.  Chemotherapy-resistant human AML stem cells home to and engraft within the bone-marrow endosteal region , 2007, Nature Biotechnology.

[48]  Yoichi Kuwana,et al.  CERTAINTY EQUIVALENCE AND LOGARITHMIC UTILITIES IN CONSUMPTION/INVESTMENT PROBLEMS , 1995 .

[49]  Adam L. MacLean,et al.  Feedback mechanisms control coexistence in a stem cell model of acute myeloid leukaemia , 2016, Journal of theoretical biology.

[50]  R. Bast,et al.  Holland-Frei Cancer Medicine , 2016 .

[51]  Keith Wheatley,et al.  Randomised comparison of addition of autologous bone-marrow transplantation to intensive chemotherapy for acute myeloid leukaemia in first remission: results of MRC AML 10 trial , 1998, The Lancet.

[52]  Donald E. Kirk,et al.  Optimal control theory : an introduction , 1970 .

[53]  M. Andreeff,et al.  Targeted therapy of acute myeloid leukemia , 2015 .

[54]  H. Byrne.  Dissecting cancer through mathematics: from the cell to the animal model , 2010, Nature Reviews Cancer.

[55]  C. Bennett,et al.  The value of innovation: the economics of targeted drugs for cancer , 2007, Targeted Oncology.

[56]  G. Fraser-Andrews,et al.  Finding candidate singular optimal controls: A state of the art survey , 1989 .

[57]  Stephen P. Banks,et al.  Optimal control of drug therapy in cancer treatment , 2009 .

[58]  D. Yardley,et al.  Drug Resistance and the Role of Combination Chemotherapy in Improving Patient Outcomes , 2013, International journal of breast cancer.

[59]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[60]  L. Mayer,et al.  Optimizing combination chemotherapy by controlling drug ratios. , 2007, Molecular interventions.

[61]  E. Blum,et al.  The Mathematical Theory of Optimal Processes. , 1963 .

[62]  Michael Boeckh,et al.  Reduced mortality after allogeneic hematopoietic-cell transplantation. , 2010, The New England journal of medicine.

[63]  Ivar Østby,et al.  A mathematical model for reconstitution of granulopoiesis after high dose chemotherapy with autologous stem cell transplantation , 2003, Journal of mathematical biology.

[64]  S. Kahne,et al.  Optimal control: An introduction to the theory and ITs applications , 1967, IEEE Transactions on Automatic Control.

[65]  Sabena Mughal.  Understanding Leukemias, Lymphomas and Myelomas, Second Edition , 2009 .

[66]  A. J. Lotka.  Elements of Physical Biology. , 1925, Nature.

[67]  Eve McDonald-Madden,et al.  A novel approach to assessing the ecosystem-wide impacts of reintroductions. , 2018, Ecological applications : a publication of the Ecological Society of America.

[68]  Suzanne Lenhart,et al.  Optimal control of treatments in a two-strain tuberculosis model , 2002 .

[69]  H. Kwon,et al.  Optimal control of an influenza model with seasonal forcing and age-dependent transmission rates. , 2013, Journal of theoretical biology.

[70]  Alan A. Berryman,et al.  The Orgins and Evolution of Predator‐Prey Theory , 1992 .

[71]  John T. Workman,et al.  Optimal Control Applied to Biological Models , 2007 .

[72]  Rakesh K. Jain,et al.  Normalizing tumor vasculature with anti-angiogenic therapy: A new paradigm for combination therapy , 2001, Nature Medicine.

[73]  Hua Yu,et al.  Revisiting STAT3 signalling in cancer: new and unexpected biological functions , 2014, Nature Reviews Cancer.

[74]  Franziska Michor,et al.  Dynamics of chronic myeloid leukemia response to long-term targeted therapy reveal treatment effects on leukemic stem cells. , 2011, Blood.

[75]  B. Anderson,et al.  Optimal control: linear quadratic methods , 1990 .

[76]  D. Harrison,et al.  The JAK/STAT signaling pathway , 2004, Journal of Cell Science.

[77]  K. Abdella.  Numerical Solution of two-point boundary value problems using Sinc interpolation , 2012 .

[78]  Urszula Ledzewicz,et al.  Optimizing Chemotherapeutic Anti-cancer Treatment and the Tumor Microenvironment: An Analysis of Mathematical Models. , 2016, Advances in experimental medicine and biology.

[79]  Jongeun Choi,et al.  Solutions to the Inverse LQR Problem With Application to Biological Systems Analysis , 2015, IEEE Transactions on Control Systems Technology.

[80]  Radu Precup,et al.  A Hypothetical-Mathematical Model of Acute Myeloid Leukaemia Pathogenesis , 2010, Comput. Math. Methods Medicine.

[81]  Christopher M. Baker,et al.  Handling overheads: optimal multi-method invasive species control , 2017, Theoretical Ecology.