AITL: Adversarial Inductive Transfer Learning with input and output space adaptation for pharmacogenomics

Motivation The goal of pharmacogenomics is to predict drug response in patients using their single- or multi-omics data. A major challenge is that clinical data (i.e. patients) with drug response outcome is very limited, creating a need for transfer learning to bridge the gap between large pre-clinical pharmacogenomics datasets (e.g. cancer cell lines), as a source domain, and clinical datasets as a target domain. Two major discrepancies exist between pre-clinical and clinical datasets: 1) in the input space, the gene expression data due to difference in the basic biology, and 2) in the output space, the different measures of the drug response. Therefore, training a computational model on cell lines and testing it on patients violates the i.i.d assumption that train and test data are from the same distribution. Results We propose Adversarial Inductive Transfer Learning (AITL), a deep neural network method for addressing discrepancies in input and output space between the pre-clinical and clinical datasets. AITL takes gene expression of patients and cell lines as the input, employs adversarial domain adaptation and multi-task learning to address these discrepancies, and predicts the drug response as the output. To the best of our knowledge, AITL is the first adversarial inductive transfer learning method to address both input and output discrepancies. Experimental results indicate that AITL outperforms state-of-the-art pharmacogenomics and transfer learning baselines and may guide precision oncology more accurately. Availability of codes and supplementary material https://github.com/hosseinshn/AITL Contact ccollins@prostatecentre.com and ester@cs.sfu.ca

[1]  Hiroshi Mamitsuka,et al.  Improving drug response prediction by integrating multiple data sources: matrix factorization, kernel and network-based approaches , 2019, Briefings Bioinform..

[2]  Aristotelis Tsirigos,et al.  A Deep Learning Framework for Predicting Response to Therapy in Cancer. , 2019, Cell reports.

[3]  Mark Lee,et al.  BDKANN – Biological Domain Knowledge-based Artificial Neural Network for drug response prediction , 2019, bioRxiv.

[4]  Michael I. Jordan,et al.  Universal Domain Adaptation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Kate Saenko,et al.  Domain Agnostic Learning with Disentangled Representations , 2019, ICML.

[6]  Yuchen Zhang,et al.  Bridging Theory and Algorithm for Domain Adaptation , 2019, ICML.

[7]  Yu-Chiang Frank Wang,et al.  A Closer Look at Few-shot Classification , 2019, ICLR.

[8]  Kamyar Azizzadenesheli,et al.  Regularized Learning for Domain Adaptation under Label Shifts , 2019, ICLR.

[9]  Michèle Sebag,et al.  Multi-Domain Adversarial Learning , 2019, ICLR.

[10]  Benjamin Haibe-Kains,et al.  Dr.VAE: improving drug response prediction via modeling of drug perturbation effects , 2019, Bioinform..

[11]  Marcel J. T. Reinders,et al.  PRECISE: a domain adaptation approach to transfer predictors of drug response from pre-clinical models to tumors , 2019, bioRxiv.

[12]  C. Collins,et al.  MOLI: multi-omics late integration with deep neural networks for drug response prediction , 2019, bioRxiv.

[13]  Richard Socher,et al.  Augmented Cyclic Adversarial Learning for Low Resource Domain Adaptation , 2018, ICLR.

[14]  Yang Zou,et al.  Domain Adaptation for Semantic Segmentation via Class-Balanced Self-Training , 2018, ArXiv.

[15]  C. Sotiriou,et al.  Immunity drives TET1 regulation in cancer through NF-κB , 2018, Science Advances.

[16]  Michael C. Mozer,et al.  Adapted Deep Embeddings: A Synthesis of Methods for k-Shot Inductive Transfer Learning , 2018, NeurIPS.

[17]  Martin Ester,et al.  Deep Genomic Signature for early metastasis prediction in prostate cancer , 2018, bioRxiv.

[18]  Ming-Hsuan Yang,et al.  Learning to Adapt Structured Output Space for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Pedro H. O. Pinheiro,et al.  Unsupervised Domain Adaptation with Similarity Learning , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Zhaleh Safikhani,et al.  PharmacoDB: an integrative database for mining in vitro anticancer drug screening studies , 2017, bioRxiv.

[21]  Michael I. Jordan,et al.  Conditional Adversarial Domain Adaptation , 2017, NeurIPS.

[22]  Michael Q. Ding,et al.  Precision Oncology beyond Targeted Therapy: Combining Omics Data with Machine Learning Matches the Majority of Cancer Cells to Effective Therapeutics , 2017, Molecular Cancer Research.

[23]  R. Grossman,et al.  Discovering novel pharmacogenomic biomarkers by imputing drug response in cancer patients from large genomics studies , 2017, Genome research.

[24]  Wei Liu,et al.  Microtubule-associated protein tau is associated with the resistance to docetaxel in prostate cancer cell lines , 2017, Research and reports in urology.

[25]  Min Sun,et al.  No More Discrimination: Cross City Adaptation of Road Scene Segmenters , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[27]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  G. Ren,et al.  The transcription levels and prognostic values of seven proteasome alpha subunits in human cancers , 2016, Oncotarget.

[29]  L. Garraway,et al.  Suppression of 19S proteasome subunits marks emergence of an altered cell state in diverse cancers , 2016, Proceedings of the National Academy of Sciences.

[30]  Jin Gu,et al.  Evaluating the molecule-based prediction of clinical drug responses in cancer , 2016, Bioinform..

[31]  Sébastien Lemieux,et al.  Expression of immunoproteasome genes is regulated by cell-intrinsic and –extrinsic factors in human cancers , 2016, Scientific Reports.

[32]  Emanuel J. V. Gonçalves,et al.  A Landscape of Pharmacogenomic Interactions in Cancer , 2016, Cell.

[33]  Erich P Huang,et al.  RECIST 1.1-Update and clarification: From the RECIST committee. , 2016, European journal of cancer.

[34]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[35]  Joshua M. Korn,et al.  High-throughput screening using patient-derived tumor xenografts to predict clinical trial drug response , 2015, Nature Medicine.

[36]  S. Mandrekar,et al.  A Phase I/II Study of Bortezomib in Combination with Paclitaxel, Carboplatin, and Concurrent Thoracic Radiation Therapy for Non–Small-Cell Lung Cancer: North Central Cancer Treatment Group (NCCTG)-N0321 , 2015, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[37]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[38]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[39]  P. Goodfellow,et al.  Evaluation of incidence and prognostic significance of newly identified hotspot mutations in DNA polymerase epsilon (POLE) in endometrial cancer: Contextualizing findings from The Cancer Genome Atlas Research Network , 2014 .

[40]  Yi Li,et al.  Gene Expression Profile Alone Is Inadequate In Predicting Complete Response In Multiple Myeloma , 2014, Leukemia.

[41]  T. Hideshima,et al.  IKKβ inhibitor in combination with bortezomib induces cytotoxicity in breast cancer cells , 2014, International journal of oncology.

[42]  N. Cox,et al.  Clinical drug response can be predicted using baseline gene expression levels and in vitro drug sensitivity in cell lines , 2014, Genome Biology.

[43]  H. Gatla,et al.  Proteasome Inhibition by Bortezomib Increases IL-8 Expression in Androgen-Independent Prostate Cancer Cells: The Role of IKKα , 2013, The Journal of Immunology.

[44]  Joshua M. Stuart,et al.  The Cancer Genome Atlas Pan-Cancer analysis project , 2013, Nature Genetics.

[45]  Martin J. Wainwright,et al.  Randomized smoothing for (parallel) stochastic optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[46]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Adam A. Margolin,et al.  The Cancer Cell Line Encyclopedia enables predictive modeling of anticancer drug sensitivity , 2012, Nature.

[48]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[49]  S. Eschrich,et al.  BAD Phosphorylation Determines Ovarian Cancer Chemosensitivity and Patient Survival , 2011, Clinical Cancer Research.

[50]  X. Chen,et al.  Identification of human triple-negative breast cancer subtypes and preclinical models for selection of targeted therapies. , 2011, The Journal of clinical investigation.

[51]  B. Grala,et al.  The role of Tau protein in resistance to paclitaxel , 2011, Cancer Chemotherapy and Pharmacology.

[52]  L. Esserman,et al.  A genomic predictor of response and survival following taxane-anthracycline chemotherapy for invasive breast cancer. , 2011, JAMA.

[53]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[54]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[55]  Z. Szallasi,et al.  Efficacy of neoadjuvant Cisplatin in triple-negative breast cancer. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[56]  R. Caprioli,et al.  Identification of Markers of Taxane Sensitivity Using Proteomic and Genomic Analyses of Breast Tumors from Patients Receiving Neoadjuvant Paclitaxel and Radiation , 2010, Clinical Cancer Research.

[57]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  C. Caldas,et al.  The Extracellular Matrix Protein TGFBI Induces Microtubule Stabilization and Sensitizes Ovarian Cancers to Paclitaxel , 2007, Cancer cell.

[59]  Vijayasaradhi Setaluri,et al.  Microtubule-Associated Proteins as Targets in Cancer Chemotherapy , 2007, Clinical Cancer Research.

[60]  Anthony Boral,et al.  Gene expression profiling and correlation with outcome in clinical trials of the proteasome inhibitor bortezomib. , 2006, Blood.

[61]  Syed Mohsin,et al.  Patterns of resistance and incomplete response to docetaxel by gene expression profiling in breast cancer patients. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[62]  M. Relling,et al.  Pharmacogenomics: translating functional genomics into rational therapeutics. , 1999, Science.