Bayesian combination of mechanistic modeling and machine learning (BaM3): improving clinical tumor growth predictions

Biomedical problems are highly complex and multidimensional. Commonly, only a small subset of the relevant variables can be modeled by virtue of mathematical modeling due to lack of knowledge of the involved phenomena. Although these models are effective in analyzing the approximate dynamics of the system, their predictive accuracy is generally limited. On the other hand, statistical learning methods are well-suited for quantitative reproduction of data, but they do not provide mechanistic understanding of the investigated problem. Herein, we propose a novel method, based on the Bayesian coupling of mathematical modeling and machine learning (BaM3). We evaluate the proposed BaM3 method on a synthetic dataset for brain tumor growth as a proof of concept and analyze its performance in predicting two major clinical outputs, namely tumor burden and infiltration. Combining these two approaches results in improved predictions in almost all simulated patients, especially for those with a late clinical presentation. In addition, we test the proposed methodology on a set of patients suffering from Chronic Lymphocytic Leukemia (CLL) and show excellent agreement with reported data.

[1]  H. Greenspan Models for the Growth of a Solid Tumor by Diffusion , 1972 .

[2]  George E. Karniadakis,et al.  Hidden physics models: Machine learning of nonlinear partial differential equations , 2017, J. Comput. Phys..

[3]  Triantafyllos Stylianopoulos,et al.  Causes, consequences, and remedies for growth-induced solid stress in murine and human tumors , 2012, Proceedings of the National Academy of Sciences.

[4]  Philip K. Maini,et al.  A general reaction–diffusion model of acidity in cancer invasion , 2013, Journal of Mathematical Biology.

[5]  Daniel Smilkov,et al.  Similar image search for histopathology: SMILY , 2019, npj Digital Medicine.

[6]  S. Coons,et al.  Dichotomy of astrocytoma migration and proliferation , 1996, International journal of cancer.

[7]  O. François,et al.  Approximate Bayesian Computation (ABC) in practice. , 2010, Trends in ecology & evolution.

[8]  R. Baker,et al.  Mechanistic models versus machine learning, a fight worth fighting for the biological community? , 2018, Biology Letters.

[9]  Kristin R. Swanson,et al.  The Evolution of Mathematical Modeling of Glioma Proliferation and Invasion , 2007, Journal of neuropathology and experimental neurology.

[10]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[11]  Lena Mamykina,et al.  Mechanistic machine learning: how data assimilation leverages physiologic knowledge using Bayesian inference to forecast the future, infer the present, and phenotype , 2018, J. Am. Medical Informatics Assoc..

[12]  Chih-Wen Cheng,et al.  Multiscale Integration of -Omic, Imaging, and Clinical Data in Biomedical Informatics , 2012, IEEE Reviews in Biomedical Engineering.

[13]  Bo Wang,et al.  Machine Learning for Integrating Data in Biology and Medicine: Principles, Practice, and Opportunities , 2018, Inf. Fusion.

[14]  M. Westphal,et al.  Cost of migration: invasion of malignant gliomas and implications for treatment. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[15]  K. Swanson,et al.  Modeling Tumor-Associated Edema in Gliomas during Anti-Angiogenic Therapy and Its Impact on Imageable Tumor , 2013, Front. Oncol..

[16]  Bruce Alberts,et al.  Essential Cell Biology , 1983 .

[17]  E. T. Gawlinski,et al.  A reaction-diffusion model of cancer invasion. , 1996, Cancer research.

[18]  Philipp M. Altrock,et al.  The mathematics of cancer: integrating quantitative models , 2015, Nature Reviews Cancer.

[19]  Marc K Hellerstein,et al.  In vivo measurements document the dynamic cellular kinetics of chronic lymphocytic leukemia B cells. , 2005, The Journal of clinical investigation.

[20]  Efstratios N. Pistikopoulos,et al.  A Personalized Framework for Dynamic Modeling of Disease Trajectories in Chronic Lymphocytic Leukemia , 2016, IEEE Transactions on Biomedical Engineering.

[21]  Alexander R A Anderson,et al.  Quantifying the Role of Angiogenesis in Malignant Progression of Gliomas: in Silico Modeling Integrates Imaging and Histology Nih Public Access Author Manuscript Introduction , 2011 .

[22]  Yen-Chi Chen Modal regression using kernel density estimation: A review , 2017, 1710.07004.

[23]  K. Akashi,et al.  Self-renewing hematopoietic stem cell is the primary target in pathogenesis of human chronic lymphocytic leukemia. , 2011, Cancer cell.

[24]  Artur Gramacki,et al.  Nonparametric Kernel Density Estimation and Its Computational Aspects , 2017 .

[25]  Carlos López-Otín,et al.  The evolutionary biography of chronic lymphocytic leukemia , 2013, Nature Genetics.

[26]  S. De,et al.  Integrating machine learning and multiscale modeling—perspectives, challenges, and opportunities in the biological, biomedical, and behavioral sciences , 2019, npj Digital Medicine.

[27]  A. Raftery,et al.  Inference for Deterministic Simulation Models: The Bayesian Melding Approach , 2000 .

[28]  D. Peter,et al.  Kernel estimation of a distribution function , 1985 .

[29]  Thomas M. Cover,et al.  Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) , 2006 .

[30]  Luigi Preziosi,et al.  Cancer Modelling and Simulation , 2003 .

[31]  J. Alfonso,et al.  On the impact of chemo-mechanically induced phenotypic transitions in gliomas , 2018 .

[32]  K. Swanson,et al.  The biology and mathematical modelling of glioma invasion: a review , 2017, Journal of The Royal Society Interface.

[33]  Shayn M. Peirce,et al.  Multiscale computational models of cancer , 2019, Current Opinion in Biomedical Engineering.

[34]  H. Hatzikirou,et al.  On the Impact of Chemo-Mechanically Induced Phenotypic Transitions in Gliomas , 2018, bioRxiv.

[35]  Shulin Wang,et al.  Feature selection in machine learning: A new perspective , 2018, Neurocomputing.

[36]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[37]  R. McLendon,et al.  The hypoxic microenvironment maintains glioblastoma stem cells and promotes reprogramming towards a cancer stem cell phenotype , 2009, Cell cycle.

[38]  Dinggang Shen,et al.  Machine Learning in Medical Imaging , 2012, Lecture Notes in Computer Science.

[39]  Jeremy E. Oakley,et al.  Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda , 2015, PLoS Comput. Biol..

[40]  J. Gribben,et al.  Chronic lymphocytic leukaemia , 2015, Radiopaedia.org.

[41]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[42]  Igor Kononenko,et al.  Machine learning for medical diagnosis: history, state of the art and perspective , 2001, Artif. Intell. Medicine.

[43]  K. Schaller,et al.  'Go or grow': the key to the emergence of invasion in tumour progression? , 2012, Mathematical medicine and biology : a journal of the IMA.

[44]  Olivier Saut,et al.  Machine Learning and Mechanistic Modeling for Prediction of Metastatic Relapse in Early-Stage Breast Cancer. , 2020, JCO clinical cancer informatics.

[45]  F. Feuerhake,et al.  Why one-size-fits-all vaso-modulatory interventions fail to control glioma invasion: in silico insights , 2016, Scientific Reports.

[46]  J. Murray,et al.  Virtual brain tumours (gliomas) enhance the reality of medical imaging and highlight inadequacies of current therapy , 2002, British Journal of Cancer.

[47]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[48]  T. Shanafelt,et al.  Chronic lymphocytic leukaemia , 2018, The Lancet.

[49]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[50]  H. Byrne Dissecting cancer through mathematics: from the cell to the animal model , 2010, Nature Reviews Cancer.

[51]  H. Läuter,et al.  Silverman, B. W.: Density Estimation for Statistics and Data Analysis. Chapman & Hall, London – New York 1986, 175 pp., £12.— , 1988 .

[52]  Yongyi Yang,et al.  Machine Learning in Medical Imaging , 2010, IEEE Signal Processing Magazine.

[53]  Pallavi Sontakke,et al.  Hypoxia enhances migration and invasion in glioblastoma by promoting a mesenchymal shift mediated by the HIF1α-ZEB1 axis. , 2015, Cancer letters.

[54]  Claudia Biermann,et al.  Mathematical Methods Of Statistics , 2016 .

[55]  Matija Snuderl,et al.  Coevolution of solid stress and interstitial fluid pressure in tumors during progression: implications for vascular collapse. , 2013, Cancer research.

[56]  N. Chiorazzi,et al.  mechanisms of disease Chronic Lymphocytic Leukemia , 2010 .

[57]  D L S McElwain,et al.  A history of the study of solid tumour growth: The contribution of mathematical modelling , 2004, Bulletin of mathematical biology.

[58]  R. Gill,et al.  Applications of the van Trees inequality : a Bayesian Cramr-Rao bound , 1995 .

[59]  P. Kleihues,et al.  Epidemiology and etiology of gliomas , 2005, Acta Neuropathologica.