Brain graph synthesis by dual adversarial domain alignment and target graph prediction from a source graph

Developing predictive intelligence in neuroscience for learning how to generate multimodal medical data from a single modality can improve neurological disorder diagnosis with minimal data acquisition resources. Existing deep learning frameworks are mainly tailored for images, which might fail in handling geometric data (e.g., brain graphs). Specifically, predicting a target brain graph from a single source brain graph remains largely unexplored. Solving such problem is generally challenged with domain fracturecaused by the difference in distribution between source and target domains. Besides, solving the prediction and domain fracture independently might not be optimal for both tasks. To address these challenges, we unprecedentedly propose a Learning-guided Graph Dual Adversarial Domain Alignment (LG-DADA) framework for predicting a target brain graph from a source brain graph. The proposed LG-DADA is grounded in three fundamental contributions: (1) a source data pre-clustering step using manifold learning to firstly handle source data heterogeneity and secondly circumvent mode collapse in generative adversarial learning, (2) a domain alignment of source domain to the target domain by adversarially learning their latent representations, and (3) a dual adversarial regularization that jointly learns a source embedding of training and testing brain graphs using two discriminators and predict the training target graphs. Results on morphological brain graphs synthesis showed that our method produces better prediction accuracy and visual quality as compared to other graph synthesis methods.

[1]  Islem Rekik,et al.  Pairing-based Ensemble Classifier Learning using Convolutional Brain Multiplexes and Multi-view Brain Networks for Early Dementia Diagnosis , 2017, CNI@MICCAI.

[2]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[3]  Islem Rekik,et al.  Residual Embedding Similarity-Based Network Selection for Predicting Brain Network Evolution Trajectory from a Single Observation , 2020, PRIME@MICCAI.

[4]  Renjie Liao,et al.  Efficient Graph Generation with Graph Recurrent Attention Networks , 2019, NeurIPS.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  Qian Wang,et al.  Multi-Class ASD Classification Based on Functional Connectivity and Functional Correlation Tensor via Multi-Source Domain Adaptation and Multi-View Sparse Representation , 2020, IEEE Transactions on Medical Imaging.

[7]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[8]  Islem Rekik,et al.  XmoNet: A Fully Convolutional Network for Cross-Modality MR Image Inference , 2018, PRIME@MICCAI.

[9]  Jung-Woo Ha,et al.  StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Jerry L. Prince,et al.  Cross-modality image synthesis from unpaired data using CycleGAN: Effects of gradient consistency loss and training data size , 2018, SASHIMI@MICCAI.

[11]  Islem Rekik,et al.  Adversarial Connectome Embedding for Mild Cognitive Impairment Identification Using Cortical Morphological Networks , 2019, CNI@MICCAI.

[12]  Mathieu Salzmann,et al.  Learning the Number of Neurons in Deep Networks , 2016, NIPS.

[13]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[14]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Taesung Park,et al.  CyCADA: Cycle-Consistent Adversarial Domain Adaptation , 2017, ICML.

[16]  Islem Rekik,et al.  Joint functional brain network atlas estimation and feature selection for neurological disorder diagnosis with application to autism , 2019, Medical Image Anal..

[17]  Leo Egghe,et al.  The relation between Pearson's correlation coefficient r and Salton's cosine measure , 2009, J. Assoc. Inf. Sci. Technol..

[18]  Jianmin Wang,et al.  Multi-Adversarial Domain Adaptation , 2018, AAAI.

[19]  Huiguang He,et al.  Disrupted topological organization of structural networks revealed by probabilistic diffusion tractography in Tourette syndrome children , 2017, Human brain mapping.

[20]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[21]  Dinggang Shen,et al.  Outcome Prediction for Patient with High-Grade Gliomas from Brain Functional and Structural Networks , 2016, MICCAI.

[22]  Bo Zhou,et al.  Limited Angle Tomography Reconstruction: Synthetic Reconstruction via Unsupervised Sinogram Adaptation , 2019, IPMI.

[23]  Islem Rekik,et al.  7 Years of Developing Seed Techniques for Alzheimer's Disease Diagnosis Using Brain Image and Connectivity Data Largely Bypassed Prediction for Prognosis , 2019, PRIME@MICCAI.

[24]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Islem Rekik,et al.  Multi-view Brain Network Prediction from a Source View Using Sample Selection via CCA-Based Multi-kernel Connectomic Manifold Learning , 2018, PRIME@MICCAI.

[26]  Islem Rekik,et al.  Joint Pairing and Structured Mapping of Convolutional Brain Morphological Multiplexes for Early Dementia Diagnosis , 2019, Brain Connect..

[27]  Edward J. Coyle,et al.  Adaptive stack filtering under the mean absolute error criterion , 1990, Other Conferences.

[28]  Aaron Carass,et al.  Unpaired Brain MR-to-CT Synthesis Using a Structure-Constrained CycleGAN , 2018, DLMIA/ML-CDS@MICCAI.

[29]  Ben Glocker,et al.  Spectral Graph Convolutions for Population-based Disease Prediction , 2017, MICCAI.

[30]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[32]  Islem Rekik,et al.  Brain graph super-resolution for boosting neurological disorder diagnosis using unsupervised multi-topology connectional brain template learning , 2020, Medical Image Anal..

[33]  Snehashis Roy,et al.  Magnetic resonance image synthesis through patch regression , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[34]  I. Rekik,et al.  Gender differences in cortical morphological networks , 2019, Brain Imaging and Behavior.

[35]  Hayit Greenspan,et al.  Cross-Modality Synthesis from CT to PET using FCN and GAN Networks for Improved Automated Lesion Detection , 2018, Eng. Appl. Artif. Intell..

[36]  Bo Wang,et al.  SIMLR: a tool for large-scale single-cell analysis by multi-kernel learning , 2017, bioRxiv.

[37]  Zhe Gan,et al.  Variational Autoencoder for Deep Learning of Images, Labels and Captions , 2016, NIPS.

[38]  Islem Rekik,et al.  Unsupervised Manifold Learning Using High-Order Morphological Brain Networks Derived From T1-w MRI for Autism Diagnosis , 2018, Front. Neuroinform..

[39]  Islem Rekik,et al.  Clustering-based multi-view network fusion for estimating brain network atlases of healthy and disordered populations , 2019, Journal of Neuroscience Methods.

[40]  Diane J. Cook,et al.  A Survey of Unsupervised Deep Domain Adaptation , 2018, ACM Trans. Intell. Syst. Technol..

[41]  Minho Lee,et al.  Prediction to Atrial Fibrillation Using Deep Convolutional Neural Networks , 2018, PRIME@MICCAI.

[42]  Michael Breakspear,et al.  Graph analysis of the human connectome: Promise, progress, and pitfalls , 2013, NeuroImage.

[43]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Islem Rekik,et al.  Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states , 2018, Scientific Reports.

[45]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[46]  Yan Shen,et al.  Brain Tumor Segmentation on MRI with Missing Modalities , 2019, IPMI.

[47]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[48]  Ben Glocker,et al.  Distance Metric Learning Using Graph Convolutional Networks: Application to Functional Brain Networks , 2017, MICCAI.

[49]  Dinggang Shen,et al.  Synthesizing Missing PET from MRI with Cycle-consistent Generative Adversarial Networks for Alzheimer's Disease Diagnosis , 2018, MICCAI.

[50]  Dinggang Shen,et al.  Deep Learning Based Imaging Data Completion for Improved Brain Disease Diagnosis , 2014, MICCAI.