Multimodal Fusion Using Sparse Cca For Breast Cancer Survival Prediction

Effective understanding of a disease such as cancer requires fusing multiple sources of information captured across physical scales by multimodal data. In this work, we propose a novel feature embedding module that derives from canonical correlation analyses to account for intra-modality and inter-modality correlations. Experiments on simulated and real data demonstrate how our proposed module can learn well-correlated multi-dimensional embeddings. These embeddings perform competitively on one-year survival classification of TCGA-BRCA breast cancer patients, yielding average F1 scores up to 58.69% under 5-fold cross-validation.

[1]  Joel H. Saltz,et al.  Robust Histopathology Image Analysis: To Label or to Synthesize? , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Xi Chen,et al.  An Efficient Optimization Algorithm for Structured Sparse CCA, with Applications to eQTL Mapping , 2011, Statistics in Biosciences.

[3]  Karl Rohr,et al.  Pan-Cancer Prognosis Prediction Using Multimodal Deep Learning , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[4]  Olivier Gevaert,et al.  Deep learning with multimodal representation for pancancer prognosis prediction , 2019, bioRxiv.

[5]  R. Tibshirani,et al.  A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. , 2009, Biostatistics.

[6]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[7]  Jian Ma,et al.  Integration of Spatial Distribution in Imaging-Genetics , 2018, MICCAI.

[8]  Minh N. Do,et al.  Multimodal Fusion of Imaging and Genomics for Lung Cancer Recurrence Prediction , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[9]  Shannon L. Risacher,et al.  GN-SCCA: GraphNet Based Sparse Canonical Correlation Analysis for Brain Imaging Genetics , 2015, BIH.

[10]  Jian Ma,et al.  Correlating cellular features with gene expression using CCA , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[11]  D. Shen,et al.  Feature fusion via hierarchical supervised local CCA for diagnosis of autism spectrum disorder , 2016, Brain Imaging and Behavior.

[12]  H. Hotelling Relations Between Two Sets of Variates , 1936 .