Brain Multigraph Prediction using Topology-Aware Adversarial Graph Neural Network

Brain graphs (i.e, connectomes) constructed from medical scans such as magnetic resonance imaging (MRI) have become increasingly important tools to characterize the abnormal changes in the human brain. Due to the high acquisition cost and processing time of multimodal MRI, existing deep learning frameworks based on Generative Adversarial Network (GAN) focused on predicting the missing multimodal medical images from a few existing modalities. While brain graphs help better understand how a particular disorder can change the connectional facets of the brain, synthesizing a target brain multigraph (i.e, multiple brain graphs) from a single source brain graph is strikingly lacking. Additionally, existing graph generation works mainly learn one model for each target domain which limits their scalability in jointly predicting multiple target domains. Besides, while they consider the global topological scale of a graph (i.e., graph connectivity structure), they overlook the local topology at the node scale (e.g., how central a node is in the graph). To address these limitations, we introduce topology-aware graph GAN architecture (topoGAN), which jointly predicts multiple brain graphs from a single brain graph while preserving the topological structure of each target graph. Its three key innovations are: (i) designing a novel graph adversarial auto-encoder for predicting multiple brain graphs from a single one, (ii) clustering the encoded source graphs in order to handle the mode collapse issue of GAN and proposing a cluster-specific decoder, (iii) introducing a topological loss to force the prediction of topologically sound target brain graphs. The experimental results using five target domains demonstrated the outperformance of our method in brain multigraph prediction from a single graph in comparison with baseline approaches.

[1]  Bo Wang,et al.  SIMLR: a tool for large-scale single-cell analysis by multi-kernel learning , 2017, bioRxiv.

[2]  Nicola De Cao,et al.  MolGAN: An implicit generative model for small molecular graphs , 2018, ArXiv.

[3]  Islem Rekik,et al.  Unsupervised Manifold Learning Using High-Order Morphological Brain Networks Derived From T1-w MRI for Autism Diagnosis , 2018, Front. Neuroinform..

[4]  Wenwu Zhu,et al.  Deep Learning on Graphs: A Survey , 2018, IEEE Transactions on Knowledge and Data Engineering.

[5]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[6]  Islem Rekik,et al.  Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states , 2018, Scientific Reports.

[7]  Jing Wang,et al.  Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment , 2020, Pattern Recognit..

[8]  Mingliang Wang,et al.  A Survey on Deep Learning for Neuroimaging-Based Brain Disorder Analysis , 2020, Frontiers in Neuroscience.

[9]  Jure Leskovec,et al.  Representation Learning on Graphs: Methods and Applications , 2017, IEEE Data Eng. Bull..

[10]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[11]  Paul J. Laurienti,et al.  A New Measure of Centrality for Brain Networks , 2010, PloS one.

[12]  M. A. Beauchamp AN IMPROVED INDEX OF CENTRALITY. , 1965, Behavioral science.

[13]  Davide Belli,et al.  Image-Conditioned Graph Generation for Road Network Extraction , 2019, ArXiv.

[14]  Alejandro F. Frangi,et al.  Integrating Similarity Awareness and Adaptive Calibration in Graph Convolution Network to Predict Disease , 2020, MICCAI.

[15]  Steven B. Andrews,et al.  Structural Holes: The Social Structure of Competition , 1995, The SAGE Encyclopedia of Research Design.

[16]  Islem Rekik,et al.  Adversarial Connectome Embedding for Mild Cognitive Impairment Identification Using Cortical Morphological Networks , 2019, CNI@MICCAI.

[17]  Ahmed Nebli,et al.  Deep EvoGraphNet Architecture For Time-Dependent Brain Graph Data Synthesis From a Single Timepoint , 2020, PRIME@MICCAI.

[18]  Islem Rekik,et al.  Progressive Infant Brain Connectivity Evolution Prediction from Neonatal MRI Using Bidirectionally Supervised Sample Selection , 2019, PRIME@MICCAI.

[19]  Islem Rekik,et al.  Residual Embedding Similarity-Based Network Selection for Predicting Brain Network Evolution Trajectory from a Single Observation , 2020, PRIME@MICCAI.

[20]  Xavier Bresson,et al.  A Two-Step Graph Convolutional Decoder for Molecule Generation , 2019, ArXiv.

[21]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[22]  O. Sporns,et al.  A cross-disorder connectome landscape of brain dysconnectivity , 2019, Nature Reviews Neuroscience.

[23]  Islem Rekik,et al.  Symmetric Dual Adversarial Connectomic Domain Alignment for Predicting Isomorphic Brain Graph from a Baseline Graph , 2019, MICCAI.

[24]  Islem Rekik,et al.  Joint functional brain network atlas estimation and feature selection for neurological disorder diagnosis with application to autism , 2019, Medical Image Anal..

[25]  Islem Rekik,et al.  Brain graph super-resolution for boosting neurological disorder diagnosis using unsupervised multi-topology connectional brain template learning , 2020, Medical Image Anal..

[26]  Ioannis Mitliagkas,et al.  Multi-objective training of Generative Adversarial Networks with multiple discriminators , 2019, ICML.

[27]  Mingkui Tan,et al.  Multi-marginal Wasserstein GAN , 2019, NeurIPS.

[28]  Yi Pan,et al.  Complex Brain Network Analysis and Its Applications to Brain Disorders: A Survey , 2017, Complex..

[29]  J. Zico Kolter,et al.  Overfitting in adversarially robust deep learning , 2020, ICML.

[30]  Li Wang,et al.  Recovering Brain Structural Connectivity from Functional Connectivity via Multi-GCN Based Generative Adversarial Network , 2020, MICCAI.

[31]  Qian Wang,et al.  CoCa-GAN: Common-Feature-Learning-Based Context-Aware Generative Adversarial Network for Glioma Grading , 2019, MICCAI.

[32]  Si Zhang,et al.  Graph convolutional networks: a comprehensive review , 2019, Computational Social Networks.

[33]  Islem Rekik,et al.  Hierarchical Adversarial Connectomic Domain Alignment for Target Brain Graph Prediction and Classification from a Source Graph , 2019, PRIME@MICCAI.

[34]  Jure Leskovec,et al.  Graph Convolutional Policy Network for Goal-Directed Molecular Graph Generation , 2018, NeurIPS.

[35]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[36]  Henning Müller,et al.  A Graph Model of the Lungs with Morphology-Based Structure for Tuberculosis Type Classification , 2019, IPMI.

[37]  Islem Rekik,et al.  Estimation of connectional brain templates using selective multi-view network normalization , 2020, Medical Image Anal..

[38]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[39]  Greg Mori,et al.  Graph Generation with Variational Recurrent Neural Network , 2019, ArXiv.

[40]  Mikko Kivelä,et al.  Generalizations of the clustering coefficient to weighted complex networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Patric Hagmann,et al.  Dynamic spatiotemporal patterns of brain connectivity reorganize across development , 2020, Network Neuroscience.

[42]  Behnam Neyshabur,et al.  Stabilizing GAN Training with Multiple Random Projections , 2017, ArXiv.

[43]  Chunfeng Lian,et al.  Disease-Image Specific Generative Adversarial Network for Brain Disease Diagnosis with Incomplete Multi-modal Neuroimages , 2019, MICCAI.

[44]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[45]  Renjie Liao,et al.  Efficient Graph Generation with Graph Recurrent Attention Networks , 2019, NeurIPS.

[46]  I. Rekik,et al.  Gender differences in cortical morphological networks , 2019, Brain Imaging and Behavior.

[47]  Edward J. Coyle,et al.  Adaptive stack filtering under the mean absolute error criterion , 1990, Other Conferences.

[48]  Daoqiang Zhang,et al.  Unified Brain Network with Functional and Structural Data , 2020, MICCAI.

[49]  Shinn-Zong Lin,et al.  Graph theory and network topological metrics may be the potential biomarker in Parkinson’s disease , 2019, Journal of Clinical Neuroscience.

[50]  Islem Rekik,et al.  Graph Morphology-Based Genetic Algorithm for Classifying Late Dementia States , 2019, CNI@MICCAI.

[51]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[52]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[53]  Phillip Bonacich,et al.  Some unique properties of eigenvector centrality , 2007, Soc. Networks.

[54]  Huiguang He,et al.  Disrupted topological organization of structural networks revealed by probabilistic diffusion tractography in Tourette syndrome children , 2017, Human brain mapping.

[55]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[56]  Guodong Zeng,et al.  Hybrid Generative Adversarial Networks for Deep MR to CT Synthesis Using Unpaired Data , 2019, MICCAI.

[57]  Edward Y. Chang,et al.  RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[58]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[59]  Alan Aspuru-Guzik,et al.  Graph Deconvolutional Generation , 2020, ArXiv.

[60]  Hans M. Senn,et al.  A Graph VAE and Graph Transformer Approach to Generating Molecular Graphs , 2021, ArXiv.

[61]  Jan S. Kirschke,et al.  DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesis , 2019, MICCAI.

[62]  O. Sporns,et al.  Network neuroscience , 2017, Nature Neuroscience.

[63]  Anil K. Jain Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[64]  Islem Rekik,et al.  Brain graph synthesis by dual adversarial domain alignment and target graph prediction from a source graph , 2020, Medical Image Anal..

[65]  Juntang Zhuang,et al.  Pooling Regularized Graph Neural Network for fMRI Biomarker Analysis , 2020, MICCAI.

[66]  Wen Li,et al.  Automated parcellation of the brain surface generated from magnetic resonance images , 2013, Front. Neuroinform..

[67]  Islem Rekik,et al.  Predicting High-Resolution Brain Networks Using Hierarchically Embedded and Aligned Multi-resolution Neighborhoods , 2019, PRIME@MICCAI.

[68]  Mohamed Ali Mahjoub,et al.  Supervised Multi-topology Network Cross-diffusion for Population-driven Brain Network Atlas Estimation , 2020, MICCAI.

[69]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[70]  Islem Rekik,et al.  Deep Graph Normalizer: A Geometric Deep Learning Approach for Estimating Connectional Brain Templates , 2020, MICCAI.

[71]  Sridhar Mahadevan,et al.  Generative Multi-Adversarial Networks , 2016, ICLR.

[72]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[73]  Islem Rekik,et al.  Intact Connectional Morphometricity Learning Using Multi-view Morphological Brain Networks with Application to Autism Spectrum Disorder , 2018, CNI@MICCAI.

[74]  Stefan Lee,et al.  Graph R-CNN for Scene Graph Generation , 2018, ECCV.

[75]  Martin G. Everett,et al.  A Graph-theoretic perspective on centrality , 2006, Soc. Networks.

[76]  Islem Rekik,et al.  Topology-guided cyclic brain connectivity generation using geometric deep learning , 2020, Journal of Neuroscience Methods.

[77]  Variational Graph Convolutional Networks , 2019 .

[78]  M. Breakspear,et al.  The connectomics of brain disorders , 2015, Nature Reviews Neuroscience.

[79]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[80]  Mohamed Ali Mahjoub,et al.  Topology-Aware Generative Adversarial Network for Joint Prediction of Multiple Brain Graphs from a Single Brain Graph , 2020, MICCAI.

[81]  Lina Yao,et al.  Adversarially Regularized Graph Autoencoder , 2018, IJCAI.