How to mathematically optimize drug regimens using optimal control

This article gives an overview of a technique called optimal control, which is used to optimize real-world quantities represented by mathematical models. I include background information about the historical development of the technique and applications in a variety of fields. The main focus here is the application to diseases and therapies, particularly the optimization of combination therapies, and I highlight several such examples. I also describe the basic theory of optimal control, and illustrate each of the steps with an example that optimizes the doses in a combination regimen for leukemia. References are provided for more complex cases. The article is aimed at modelers working in drug development, who have not used optimal control previously. My goal is to make this technique more accessible in the biopharma community.

[1]  John T. Workman,et al.  Optimal Control Applied to Biological Models , 2007 .

[2]  N. Komarova.  Mathematical modeling of cyclic treatments of chronic myeloid leukemia. , 2011, Mathematical biosciences and engineering : MBE.

[3]  M. Petit.  Dynamic optimization. The calculus of variations and optimal control in economics and management : by Morton I. Kamien and Nancy L. Schwartz. Second Edition. North-Holland (Advanced Textbooks in Economics), Amsterdam and New York, 1991. Pp. xvii+377. ISBN0-444- 01609-0 , 1994 .

[4]  J. Janssen,et al.  Deterministic and Stochastic Optimal Control , 2013 .

[5]  Ravi Iyengar,et al.  Quantitative and Systems Pharmacology in the Post-genomic Era : New Approaches to Discovering Drugs and Understanding Therapeutic , 2011 .

[6]  R. Vidal.  Dynamic optimization: The calculus of variations and optimal control in economics and management: Morton I. KAMIEN and Nancy L. SCHWARTZ Volume 4 in: Dynamic Economics: Theory and Applications, North-Holland, New York, 1981, xi + 331 pages, Dfl.90.00 , 1982 .

[7]  R. Gelber,et al.  Adjuvant chemoendocrine therapy in postmenopausal breast cancer: cyclophosphamide, methotrexate, and fluorouracil dose and schedule may make a difference. International Breast Cancer Study Group. , 1998, Journal of Clinical Oncology.

[8]  G. Lyman,et al.  Systematic review of efficacy of dose-dense versus non-dose-dense chemotherapy in breast cancer, non-Hodgkin lymphoma, and non-small cell lung cancer. , 2012, Critical reviews in oncology/hematology.

[9]  Kok Lay Teo,et al.  Optimal Control of Drug Administration in Cancer Chemotherapy , 1993 .

[10]  R. Day,et al.  Treatment sequencing, asymmetry, and uncertainty: protocol strategies for combination chemotherapy. , 1986, Cancer research.

[11]  Goldie Jh,et al.  Application of theoretical models to chemotherapy protocol design. , 1986 .

[12]  M. Hestenes.  A GENERAL PROBLEM IN THE CALCULUS OF VARIATIONS WITH APPLICATIONS TO PATHS OF LEAST TIME , 1950 .

[13]  Helen Moore,et al.  A mathematical model for treatment-resistant mutations of hiv. , 2005, Mathematical biosciences and engineering : MBE.

[14]  U. Ledzewicz,et al.  Dynamical Systems Properties of a Mathematical Model for the Treatment of CML , 2016 .

[15]  F. Black,et al.  The Pricing of Options and Corporate Liabilities , 1973, Journal of Political Economy.

[16]  R Bellman,et al.  On the Theory of Dynamic Programming. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Mette S Olufsen,et al.  A practical approach to parameter estimation applied to model predicting heart rate regulation , 2013, Journal of mathematical biology.

[18]  George Leitmann,et al.  The Calculus of Variations and Optimal Control , 1982 .

[19]  D. Kirschner,et al.  Optimal control of the chemotherapy of HIV , 1997, Journal of mathematical biology.

[20]  Marcel J. Sidi,et al.  Design of Robust Control Systems: From Classical to Modern Practical Approaches , 2001 .

[21]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[22]  Eamonn A Gaffney,et al.  Modelling chemotherapy resistance in palliation and failed cure. , 2009, Journal of theoretical biology.

[23]  V. G. Boltyanskiy.  The Maximum Principle in the Theory of Optimal Processes. , 1961 .

[24]  Urszula Ledzewicz,et al.  Optimization of combination therapy for chronic myeloid leukemia with dosing constraints , 2018, Journal of Mathematical Biology.

[25]  M. Birtwistle,et al.  A General Network Pharmacodynamic Model–Based Design Pipeline for Customized Cancer Therapy Applied to the VEGFR Pathway , 2014, CPT: pharmacometrics & systems pharmacology.

[26]  R. Gamkrelidze.  Discovery of the Maximum Principle in Optimal Control , 2003 .

[27]  F. Muggia.  Relevance of chemotherapy dose and schedule to outcomes in ovarian cancer. , 2004, Seminars in oncology.

[28]  Sheldon S. L. Chang.  General Theory of Optimal Processes , 1966 .

[29]  A. Perelson,et al.  Modeling HCV kinetics under therapy using PK and PD information , 2009, Expert opinion on drug metabolism & toxicology.

[30]  R. C. Merton,et al.  Theory of Rational Option Pricing , 2015, World Scientific Reference on Contingent Claims Analysis in Corporate Finance.

[31]  MC Peterson,et al.  FDA Advisory Meeting Clinical Pharmacology Review Utilizes a Quantitative Systems Pharmacology (QSP) Model: A Watershed Moment? , 2015, CPT: pharmacometrics & systems pharmacology.

[32]  R. Gelber,et al.  Timing of Radiation Therapy and Chemotherapy After Breast-Conserving Surgery for Node-Positive Breast Cancer: Long-Term Results From International Breast Cancer Study Group Trials VI and VII. , 2016, International journal of radiation oncology, biology, physics.

[33]  L. Leibovici,et al.  Dose-Dense Chemotherapy in Nonmetastatic Breast Cancer: A Systematic Review and Meta-analysis of Randomized Controlled Trials , 2010, Journal of the National Cancer Institute.

[34]  Ronald A. Howard,et al.  The Foundations of Decision Analysis , 1968, IEEE Trans. Syst. Sci. Cybern..

[35]  Suzanne Lenhart,et al.  Optimal control of treatment in a mathematical model of chronic myelogenous leukemia. , 2007, Mathematical biosciences.

[36]  D. MacKenzie.  An Engine, Not a Camera: How Financial Models Shape Markets , 2006 .

[37]  I. Mahmood.  Pharmacokinetic allometric scaling of antibodies: application to the first-in-human dose estimation. , 2009, Journal of pharmaceutical sciences.

[38]  Hans Josef Pesch,et al.  The Maximum Principle of optimal control: A history of ingenious ideas and missed opportunities , 2009 .

[39]  C. T. Kelley,et al.  Estimation and identification of parameters in a lumped cerebrovascular model. , 2008, Mathematical biosciences and engineering : MBE.

[40]  R. V. Gamkrelidze,et al.  Theory of Optimal Processes , 1961 .

[41]  U. Ledzewicz,et al.  Optimal control applied to a generalized Michaelis-Menten model of CML therapy , 2017 .

[42]  Dominique Barbolosi,et al.  Optimizing Drug Regimens in Cancer Chemotherapy by an Efficacy-Toxicity Mathematical Model , 2000, Comput. Biomed. Res..

[43]  R Bellman,et al.  DYNAMIC PROGRAMMING AND A NEW FORMALISM IN THE CALCULUS OF VARIATIONS. , 1954, Proceedings of the National Academy of Sciences of the United States of America.

[44]  R. W. Hansen,et al.  Journal of Health Economics , 2016 .

[45]  E A Gaffney,et al.  The application of mathematical modelling to aspects of adjuvant chemotherapy scheduling , 2004, Journal of mathematical biology.

[46]  R. V. Gamkrelidze,et al.  THE THEORY OF OPTIMAL PROCESSES. I. THE MAXIMUM PRINCIPLE , 1960 .

[47]  J. Tou,et al.  On the general theory of optimal processes , 1969 .

[48]  B. Leimkuhler,et al.  Optimal control for mathematical models of cancer therapies : an application of geometric methods , 2015 .

[49]  T. Vincent,et al.  Optimal control analysis in the chemotherapy of IgG multiple myeloma. , 1977, Bulletin of mathematical biology.

[50]  Helen Moore,et al.  A mathematical model for chronic myelogenous leukemia (CML) and T cell interaction. , 2004, Journal of theoretical biology.

[51]  R. V. Gamkrelidze.  Optimal Control Processes , 2019 .

[52]  George W. Swan,et al.  Applications of Optimal Control Theory in Biomedicine , 1984 .

[53]  J. W. Humberston.  Classical mechanics , 1980, Nature.