Deep learning reveals cancer metastasis and therapeutic antibody targeting in whole body

Reliable detection of disseminated tumor cells and of the biodistribution of tumor-targeting therapeutic antibodies within the entire body has long been needed to better understand and treat cancer metastasis. Here, we developed an integrated pipeline for automated quantification of cancer metastases and therapeutic antibody targeting, named DeepMACT. First, we enhanced the fluorescent signal of tumor cells more than 100-fold by applying the vDISCO method to image single cancer cells in intact transparent mice. Second, we developed deep learning algorithms for automated quantification of metastases with an accuracy matching human expert manual annotation. Deep learning-based quantifications in a model of spontaneous metastasis using human breast cancer cells allowed us to systematically analyze clinically relevant features such as size, shape, spatial distribution, and the degree to which metastases are targeted by a therapeutic monoclonal antibody in whole mice. DeepMACT can thus considerably improve the discovery of effective therapeutic strategies for metastatic cancer. Graphical Abstract Supplementary Movies and deep learning algorithms of DeepMACT are available at http://discotechnologies.org/DeepMACT/

[1]  Sanjiv S Gambhir,et al.  Integrating noninvasive molecular imaging into molecular medicine: an evolving paradigm. , 2007, Trends in molecular medicine.

[2]  W. Hiddemann,et al.  An Advanced Preclinical Mouse Model for Acute Myeloid Leukemia Using Patients' Cells of Various Genetic Subgroups and In Vivo Bioluminescence Imaging , 2015, PloS one.

[3]  D. Ribnikar,et al.  Metastatic breast cancer. , 2014, Current opinion in oncology.

[4]  Kohei Miyazono,et al.  Whole-Body Profiling of Cancer Metastasis with Single-Cell Resolution. , 2017, Cell reports.

[5]  M. Tabrizi,et al.  Biodistribution Mechanisms of Therapeutic Monoclonal Antibodies in Health and Disease , 2010, The AAPS Journal.

[6]  Hans Clevers,et al.  Mining the Wnt pathway for cancer therapeutics , 2006, Nature Reviews Drug Discovery.

[7]  Min-Ying Su,et al.  A multi-resolution approach for spinal metastasis detection using deep Siamese neural networks , 2017, Comput. Biol. Medicine.

[8]  Ali Ertürk,et al.  An inhibitory antibody targeting carbonic anhydrase XII abrogates chemoresistance and significantly reduces lung metastases in an orthotopic breast cancer model in vivo , 2018, International journal of cancer.

[9]  A. Ozcan,et al.  Deep learning enables cross-modality super-resolution in fluorescence microscopy , 2018, Nature Methods.

[10]  E. Kremmer,et al.  Generation and characterization of the first inhibitory antibody targeting tumour-associated carbonic anhydrase XII , 2011, Cancer Immunology, Immunotherapy.

[11]  David B. A. Epstein,et al.  MIMO-Net: A multi-input multi-output convolutional neural network for cell segmentation in fluorescence microscopy images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[12]  Rajan P Kulkarni,et al.  Single-Cell Phenotyping within Transparent Intact Tissue through Whole-Body Clearing , 2014, Cell.

[13]  D. Mahadevan,et al.  Monoclonal antibodies as therapeutics in human malignancies. , 2014, Future oncology.

[14]  Siddharth Bhatia,et al.  Lung Cancer Detection: A Deep Learning Approach , 2018, SocProS.

[15]  Ralph Weissleder,et al.  In vivo imaging in cancer. , 2010, Cold Spring Harbor perspectives in biology.

[16]  Elizabeth Iorns,et al.  A New Mouse Model for the Study of Human Breast Cancer Metastasis , 2012, PloS one.

[17]  L. Norton,et al.  Metastatic breast cancer. Length and quality of life. , 1991, The New England journal of medicine.

[18]  Markus Rempfler,et al.  Panoptic imaging of transparent mice reveals whole-body neuronal projections and skull-meninges connections , 2018, Nature Neuroscience.

[19]  W. Webb,et al.  Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[20]  E. Kremmer,et al.  Antitumor efficacy of a monoclonal antibody that inhibits the activity of cancer-associated carbonic anhydrase XII. , 2013, Cancer research.

[21]  George E. Dahl,et al.  Artificial Intelligence-Based Breast Cancer Nodal Metastasis Detection: Insights Into the Black Box for Pathologists. , 2018, Archives of pathology & laboratory medicine.

[22]  Dinggang Shen,et al.  Densely Deep Supervised Networks with Threshold Loss for Cancer Detection in Automated Breast Ultrasound , 2018, MICCAI.

[23]  Diogo M. Camacho,et al.  Next-Generation Machine Learning for Biological Networks , 2018, Cell.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  P. V. van Diest,et al.  Relevant impact of central pathology review on nodal classification in individual breast cancer patients. , 2012, Annals of oncology : official journal of the European Society for Medical Oncology.

[26]  Dimitri Perrin,et al.  Whole-Body Imaging with Single-Cell Resolution by Tissue Decolorization , 2014, Cell.

[27]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[28]  Samuel J. Yang,et al.  In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images , 2018, Cell.

[29]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[30]  Michael L. Waskom,et al.  Seaborn: Statistical Data Visualization , 2021, J. Open Source Softw..

[31]  V. Tuchin ’ s Introduction : Optical Methods for Biomedical Diagnosis , 2016 .

[32]  Casper F Winsnes,et al.  Deep learning is combined with massive-scale citizen science to improve large-scale image classification , 2018, Nature Biotechnology.

[33]  Steve Feng,et al.  A Mathematical Framework for Combining Decisions of Multiple Experts toward Accurate and Remote Diagnosis of Malaria Using Tele-Microscopy , 2012, PloS one.

[34]  Thomas Brox,et al.  U-Net: deep learning for cell counting, detection, and morphometry , 2018, Nature Methods.

[35]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[36]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[37]  N. Plesnila,et al.  Shrinkage-mediated imaging of entire organs and organisms using uDISCO , 2016, Nature Methods.

[38]  M. Jong,et al.  Imaging preclinical tumour models: improving translational power , 2014, Nature Reviews Cancer.

[39]  F. Cordelières,et al.  A guided tour into subcellular colocalization analysis in light microscopy , 2006, Journal of microscopy.

[40]  David F. Steiner,et al.  Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer , 2018, The American journal of surgical pathology.

[41]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[42]  D. Hanahan,et al.  Hallmarks of Cancer: The Next Generation , 2011, Cell.

[43]  Steve Feng,et al.  Distributed Medical Image Analysis and Diagnosis through Crowd-Sourced Games: A Malaria Case Study , 2012, PloS one.

[44]  V. Ntziachristos Going deeper than microscopy: the optical imaging frontier in biology , 2010, Nature Methods.

[45]  Bernd J Pichler,et al.  Latest Advances in Molecular Imaging Instrumentation , 2008, Journal of Nuclear Medicine.

[46]  R. Weinberg,et al.  Emerging Biological Principles of Metastasis , 2017, Cell.

[47]  Kurt I Anderson,et al.  Imaging molecular dynamics in vivo – from cell biology to animal models , 2011, Journal of Cell Science.

[48]  J. Massagué,et al.  Metastatic colonization by circulating tumour cells , 2016, Nature.

[49]  S. Gambhir,et al.  Molecular imaging in living subjects: seeing fundamental biological processes in a new light. , 2003, Genes & development.