Harnessing multimodal data integration to advance precision oncology

[1]  K. Rogers,et al.  Spatial omics and multiplexed imaging to explore cancer biology , 2021, Nature Methods.

[2]  Gustavo S. França,et al.  Exploring tissue architecture using spatial transcriptomics , 2021, Nature.

[3]  E. Ruppin,et al.  Synthetic lethality-mediated precision oncology via the tumor transcriptome , 2021, Cell.

[4]  Neel S. Madhukar,et al.  Artificial Intelligence in Cancer Research and Precision Medicine. , 2021, Cancer discovery.

[5]  Andrew H. Beck,et al.  Human-interpretable image features derived from densely mapped cancer pathology slides predict diverse molecular phenotypes , 2021, Nature Communications.

[6]  D. Kerr,et al.  Designing deep learning studies in cancer diagnostics , 2021, Nature Reviews Cancer.

[7]  M. Cui,et al.  Artificial intelligence and computational pathology , 2021, Laboratory Investigation.

[8]  Céline Hernandez,et al.  Benchmarking joint multi-omics dimensionality reduction approaches for the study of cancer , 2021, Nature Communications.

[9]  Jason D. Buenrostro,et al.  In situ genome sequencing resolves DNA sequence and structure in intact biological samples , 2020, Science.

[10]  Andrew L. Kung,et al.  Isabl Platform, a digital biobank for processing multimodal patient data , 2020, BMC Bioinformatics.

[11]  Cindy C. Guo,et al.  High-Spatial-Resolution Multi-Omics Sequencing via Deterministic Barcoding in Tissue , 2020, Cell.

[12]  Bingbing Ni,et al.  MIA-Prognosis: A Deep Learning Framework to Predict Therapy Response , 2020, MICCAI.

[13]  Fusheng Wang,et al.  Prediction of Pathological Complete Response to Neoadjuvant Chemotherapy in Breast Cancer Using Deep Learning with Integrative Imaging, Molecular and Demographic Data , 2020, MICCAI.

[14]  Shaoting Zhang,et al.  Feature-Enhanced Graph Networks for Genetic Mutational Prediction Using Histopathological Images in Colon Cancer , 2020, MICCAI.

[15]  David S. Melnick,et al.  Addendum: International evaluation of an AI system for breast cancer screening , 2020, Nature.

[16]  Trevor Hastie,et al.  Transparency and reproducibility in artificial intelligence , 2020, Nature.

[17]  Cecilia S Lee,et al.  Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension , 2020, Nature Medicine.

[18]  Xiaoxuan Liu,et al.  Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension , 2020, Nature medicine.

[19]  B. Taylor,et al.  Discovery through clinical sequencing in oncology , 2020, Nature Cancer.

[20]  Liwen Sun,et al.  Delta lake , 2020, Proc. VLDB Endow..

[21]  Indrani Bhattacharya,et al.  CorrSigNet: Learning CORRelated Prostate Cancer SIGnatures from Radiology and Pathology Images for Improved Computer Aided Diagnosis , 2020, MICCAI.

[22]  Leo Anthony Celi,et al.  The clinical artificial intelligence department: a prerequisite for success , 2020, BMJ Health & Care Informatics.

[23]  Alexander T. Pearson,et al.  Clinical-grade Detection of Microsatellite Instability in Colorectal Tumors by Deep Learning. , 2020, Gastroenterology.

[24]  Michael Krauthammer,et al.  Reducing Annotation Burden Through Multimodal Learning , 2020, Frontiers in Big Data.

[25]  Martin L. Miller,et al.  Unraveling tumor–immune heterogeneity in advanced ovarian cancer uncovers immunogenic effect of chemotherapy , 2020, Nature Genetics.

[26]  Nicolai J. Birkbak,et al.  Geospatial immune variability illuminates differential evolution of lung adenocarcinoma , 2020, Nature Medicine.

[27]  Amir Ardalan Kalantari Dehaghi,et al.  Inferring multimodal latent topics from electronic health records , 2020, Nature Communications.

[28]  F. Saad,et al.  Olaparib for Metastatic Castration-Resistant Prostate Cancer. , 2020, The New England journal of medicine.

[29]  Lauren Wilcox,et al.  A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy , 2020, CHI.

[30]  Micah J. Sheller,et al.  The future of digital health with federated learning , 2020, npj Digital Medicine.

[31]  Henning Müller,et al.  Generalizing convolution neural networks on stain color heterogeneous data for computational pathology , 2020, Medical Imaging: Digital Pathology.

[32]  R. Steenbakkers,et al.  The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. , 2020, Radiology.

[33]  Curtis P. Langlotz,et al.  AppendiXNet: Deep Learning for Diagnosis of Appendicitis from A Small Dataset of CT Exams Using Video Pretraining , 2020, Scientific Reports.

[34]  Yoon Ho Ko,et al.  DeepBTS: Prediction of Recurrence-free Survival of Non-small Cell Lung Cancer Using a Time-binned Deep Neural Network , 2020, Scientific Reports.

[35]  Frédérique Frouin,et al.  Correction for Magnetic Field Inhomogeneities and Normalization of Voxel Values Are Needed to Better Reveal the Potential of MR Radiomic Features in Lung Cancer , 2020, Frontiers in Oncology.

[36]  Anne L. Martel,et al.  Deep neural network models for computational histopathology: A survey , 2019, Medical Image Anal..

[37]  Daniel C. Castro,et al.  Causality matters in medical imaging , 2019, Nature Communications.

[38]  Fei Wang,et al.  Should Health Care Demand Interpretable Artificial Intelligence or Accept “Black Box” Medicine? , 2019, Annals of Internal Medicine.

[39]  Bo Thiesson,et al.  Explainable artificial intelligence model to predict acute critical illness from electronic health records , 2019, Nature Communications.

[40]  M. Gerstung,et al.  Learning mutational signatures and their multidimensional genomic properties with TensorSignatures , 2019, Nature Communications.

[41]  Jakob Nikolas Kather,et al.  Pan-cancer image-based detection of clinically actionable genetic alterations , 2019, Nature Cancer.

[42]  Jared L. Johnson,et al.  Double PIK3CA mutations in cis increase oncogenicity and sensitivity to PI3Kα inhibitors , 2019, Science.

[43]  J. Fernandez-Banet,et al.  The KRASG12C Inhibitor, MRTX849, Provides Insight Toward Therapeutic Susceptibility of KRAS Mutant Cancers in Mouse Models and Patients. , 2019, Cancer discovery.

[44]  Alexander W. Jung,et al.  Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis , 2019, Nature Cancer.

[45]  S. Sleijfer,et al.  Pan-cancer whole-genome analyses of metastatic solid tumours , 2019, Nature.

[46]  Teng-Yi Huang,et al.  Automatic Classification of Brain Tumor Types with the MRI Scans and Histopathology Images , 2019, BrainLes@MICCAI.

[47]  J. Desai,et al.  The clinical KRAS(G12C) inhibitor AMG 510 drives anti-tumour immunity , 2019, Nature.

[48]  G. Wainrib,et al.  Deep learning-based classification of mesothelioma improves prediction of patient outcome , 2019, Nature Medicine.

[49]  A. Madabhushi,et al.  Artificial intelligence in digital pathology — new tools for diagnosis and precision oncology , 2019, Nature reviews. Clinical oncology.

[50]  Kenneth L Kehl,et al.  Assessment of Deep Natural Language Processing in Ascertaining Oncologic Outcomes From Radiology Reports. , 2019, JAMA oncology.

[51]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[52]  Suman V. Ravuri,et al.  A Clinically Applicable Approach to Continuous Prediction of Future Acute Kidney Injury , 2019, Nature.

[53]  C. Brennan,et al.  Genomic Correlates of Disease Progression and Treatment Response in Prospectively Characterized Gliomas , 2019, Clinical Cancer Research.

[54]  Kyung-Ah Sohn,et al.  MildInt: Deep Learning-Based Multimodal Longitudinal Data Integration Framework , 2019, Front. Genet..

[55]  H. Nielsen,et al.  Genome-wide cell-free DNA fragmentation in patients with cancer , 2019, Nature.

[56]  G. Corrado,et al.  End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography , 2019, Nature Medicine.

[57]  H. Rugo,et al.  Alpelisib for PIK3CA‐Mutated, Hormone Receptor–Positive Advanced Breast Cancer , 2019, The New England journal of medicine.

[58]  Jakob Nikolas Kather,et al.  Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer , 2019, Nature Medicine.

[59]  Jesse Thomason,et al.  Interpreting Black Box Models via Hypothesis Testing , 2019, FODS.

[60]  Olivier Gevaert,et al.  Deep learning with multimodal representation for pancancer prognosis prediction , 2019, bioRxiv.

[61]  Maher Rizkalla,et al.  SALMON: Survival Analysis Learning With Multi-Omics Neural Networks on Breast Cancer , 2019, Front. Genet..

[62]  D. Dong,et al.  Predicting EGFR mutation status in lung adenocarcinoma on computed tomography image using deep learning , 2019, European Respiratory Journal.

[63]  Ali Bashashati,et al.  Integrated structural variation and point mutation signatures in cancer genomes using correlated topic models , 2019, PLoS Comput. Biol..

[64]  R. Satija,et al.  Integrative single-cell analysis , 2019, Nature Reviews Genetics.

[65]  C. Brennan,et al.  Tumor mutational load predicts survival after immunotherapy across multiple cancer types , 2019, Nature Genetics.

[66]  John Shawe-Taylor,et al.  Combining heterogeneous data sources for neuroimaging based diagnosis: re-weighting and selecting what is important , 2018, NeuroImage.

[67]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[68]  R. Gillies,et al.  Deep learning for lung cancer prognostication: A retrospective multi-cohort radiomics study , 2018, PLoS medicine.

[69]  J. McPherson,et al.  Sensitive tumour detection and classification using plasma cell-free DNA methylomes , 2018, Nature.

[70]  Tieliu Shi,et al.  Deep Learning-Based Multi-Omics Data Integration Reveals Two Prognostic Subtypes in High-Risk Neuroblastoma , 2018, Front. Genet..

[71]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[72]  A. Madabhushi,et al.  Spatial Architecture and Arrangement of Tumor-Infiltrating Lymphocytes for Predicting Likelihood of Recurrence in Early-Stage Non–Small Cell Lung Cancer , 2018, Clinical Cancer Research.

[73]  N. Paragios,et al.  A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: an imaging biomarker, retrospective multicohort study. , 2018, The Lancet. Oncology.

[74]  Louis-Philippe Morency,et al.  Multimodal Local-Global Ranking Fusion for Emotion Recognition , 2018, ICMI.

[75]  Catherine E. Braine,et al.  Spatiotemporal dynamics of molecular pathology in amyotrophic lateral sclerosis , 2018, Science.

[76]  B. Taylor,et al.  Clinical Utility of Prospective Molecular Characterization in Advanced Endometrial Cancer , 2018, Clinical Cancer Research.

[77]  R. Collins,et al.  Durable Remissions with Ivosidenib in IDH1‐Mutated Relapsed or Refractory AML , 2018, The New England journal of medicine.

[78]  Chia-Feng Lu,et al.  Machine Learning–Based Radiomics for Molecular Subtyping of Gliomas , 2018, Clinical Cancer Research.

[79]  Ahmed Hosny,et al.  Artificial intelligence in radiology , 2018, Nature Reviews Cancer.

[80]  Fuhui Long,et al.  An anatomic transcriptional atlas of human glioblastoma , 2018, Science.

[81]  Massimo Bellomi,et al.  Radiomics of high-grade serous ovarian cancer: association between quantitative CT features, residual tumour and disease progression within 12 months , 2018, European Radiology.

[82]  Mahmud Arif Pavel,et al.  Studies on the mechanism of general anesthesia , 2018, Proceedings of the National Academy of Sciences.

[83]  Rajarsi R. Gupta,et al.  Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. , 2018, Cell reports.

[84]  Zev A. Binder,et al.  Radiomic MRI signature reveals three distinct subtypes of glioblastoma with different clinical and molecular characteristics, offering prognostic value beyond IDH1 , 2018, Scientific Reports.

[85]  Arvind Satyanarayan,et al.  The Building Blocks of Interpretability , 2018 .

[86]  Funda Meric-Bernstam,et al.  Efficacy of Larotrectinib in TRK Fusion–Positive Cancers in Adults and Children , 2018, The New England journal of medicine.

[87]  Daniele Ramazzotti,et al.  Multi-omic tumor data reveal diversity of molecular mechanisms that correlate with survival , 2018, Nature Communications.

[88]  Xin Lu,et al.  A Large‐scale, multicenter serum metabolite biomarker identification study for the early detection of hepatocellular carcinoma , 2018, Hepatology.

[89]  V. Kristensen,et al.  Serum concentrations of active tamoxifen metabolites predict long-term survival in adjuvantly treated breast cancer patients , 2017, Breast Cancer Research.

[90]  Raymond Y Huang,et al.  Residual Convolutional Neural Network for the Determination of IDH Status in Low- and High-Grade Gliomas from MR Imaging , 2017, Clinical Cancer Research.

[91]  Denis Bertrand,et al.  Predicting Cancer Drug Response Using a Recommender System , 2017, bioRxiv.

[92]  D. Brat,et al.  Predicting cancer outcomes from histology and genomics using convolutional networks , 2017, Proceedings of the National Academy of Sciences.

[93]  Ehsan Kazemi,et al.  Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images , 2017, bioRxiv.

[94]  Oliver Hofmann,et al.  Copy-number signatures and mutational processes in ovarian carcinoma , 2017, Nature Genetics.

[95]  Ludmila V. Danilova,et al.  Mismatch repair deficiency predicts response of solid tumors to PD-1 blockade , 2017, Science.

[96]  A. Lusis,et al.  Multi-omics approaches to disease , 2017, Genome Biology.

[97]  Andrew Janowczyk,et al.  Stain Normalization using Sparse AutoEncoders (StaNoSA): Application to digital pathology , 2017, Comput. Medical Imaging Graph..

[98]  Kumardeep Chaudhary,et al.  Deep Learning–Based Multi-Omics Integration Robustly Predicts Survival in Liver Cancer , 2017, Clinical Cancer Research.

[99]  T. Garrett,et al.  Study of early stage non-small-cell lung cancer using Orbitrap-based global serum metabolomics , 2017, Journal of Cancer Research and Clinical Oncology.

[100]  Ignace Vergote,et al.  Niraparib Maintenance Therapy in Platinum-Sensitive, Recurrent Ovarian Cancer. , 2016, The New England journal of medicine.

[101]  Eva Budinska,et al.  Joint analysis of histopathology image features and gene expression in breast cancer , 2016, BMC Bioinformatics.

[102]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[103]  Steven J. M. Jones,et al.  Comprehensive, Integrative Genomic Analysis of Diffuse Lower-Grade Gliomas. , 2015, The New England journal of medicine.

[104]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[105]  Marinka Zitnik,et al.  Survival regression by data fusion , 2014 .

[106]  M. Vassar,et al.  The retrospective chart review: important methodological considerations , 2013, Journal of educational evaluation for health professions.

[107]  Joel H. Saltz,et al.  Machine-Based Morphologic Analysis of Glioblastoma Using Whole-Slide Pathology Images Uncovers Clinically Relevant Molecular Correlates , 2013, PloS one.

[108]  George Hripcsak,et al.  Caveats for the use of operational electronic health record data in comparative effectiveness research. , 2013, Medical care.

[109]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[110]  Christina Appin,et al.  Tumor-Infiltrating Lymphocytes in Glioblastoma Are Associated with Specific Genomic Alterations and Related to Transcriptional Class , 2013, Clinical Cancer Research.

[111]  William D. Dunn,et al.  MR imaging predictors of molecular profile and survival: multi-institutional study of the TCGA glioblastoma data set. , 2013, Radiology.

[112]  J. Utikal,et al.  Improved survival with MEK inhibition in BRAF-mutated melanoma. , 2012, The New England journal of medicine.

[113]  M. Giger,et al.  Multimodality computer-aided breast cancer diagnosis with FFDM and DCE-MRI. , 2010, Academic radiology.

[114]  A. Gemma,et al.  F1000 highlights , 2010 .

[115]  Peter J. Haug,et al.  Exploiting missing clinical data in Bayesian network modeling for predicting medical problems , 2008, J. Biomed. Informatics.

[116]  Nigam H. Shah,et al.  The Stanford Tissue Microarray Database , 2007, Nucleic Acids Res..

[117]  Katharina Glatz-Krieger,et al.  Factors to keep in mind when introducing virtual microscopy , 2006, Virchows Archiv.

[118]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[119]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[120]  David H. Wolpert,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[121]  Albert Y. Zomaya,et al.  Hybrid context enriched deep learning model for fine-grained sentiment analysis in textual and visual semiotic modality social data , 2020, Inf. Process. Manag..

[122]  Zhi-Hua Zhou,et al.  A brief introduction to weakly supervised learning , 2018 .

[123]  AACR Project GENIE: Powering Precision Medicine through an International Consortium. , 2017, Cancer discovery.

[124]  H. Hemilä.  Citation bias in the CONSORT comments on blinding , 2010 .

[125]  Ennis,et al.  Use of chemotherapy plus a monoclonal antibody against HER2 for metastatic breast cancer that overexpresses HER2. , 2001, The New England journal of medicine.

[126]  R H Choplin,et al.  Picture archiving and communication systems: an overview. , 1992, Radiographics : a review publication of the Radiological Society of North America, Inc.