Deep Hypergraph U-Net for Brain Graph Embedding and Classification

-Background. Network neuroscience examines the brain as a complex system represented by a network (or connectome), providing deeper insights into the brain morphology and function, allowing the identification of atypical brain connectivity alterations, which can be used as diagnostic markers of neurological disorders. -Existing Methods. Graph embedding methods which map data samples (e.g., brain networks) into a low dimensional space have been widely used to explore the relationship between samples for classification or prediction tasks. However, the majority of these works are based on modeling the pair-wise relationships between samples, failing to capture their higher-order relationships. -New Method. In this paper, inspired by the nascent field of geometric deep learning, we propose Hypergraph U-Net (HUNet), a novel data embedding framework leveraging the hypergraph structure to learn low-dimensional embeddings of data samples while capturing their high-order relationships. Specifically, we generalize the U-Net architecture, naturally operating on graphs, to hypergraphs by improving local feature aggregation and preserving the high-order relationships present in the data. -Results. We tested our method on small-scale and large-scale heterogeneous brain connectomic datasets including morphological and functional brain networks of autistic and demented patients, respectively. -Conclusion. Our HUNet outperformed state-of-the-art geometric graph and hypergraph data embedding techniques with a gain of 4-14% in classification accuracy, demonstrating both scalability and generalizability. HUNet code is available at this https URL.

[1]  Yue Gao,et al.  Hypergraph Neural Networks , 2018, AAAI.

[2]  Edwin R. Hancock,et al.  Joint hypergraph learning and sparse regression for feature selection , 2017, Pattern Recognit..

[3]  François Fouss,et al.  Random-Walk Computation of Similarities between Nodes of a Graph with Application to Collaborative Recommendation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[4]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[5]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[6]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[7]  M. Breakspear,et al.  The connectomics of brain disorders , 2015, Nature Reviews Neuroscience.

[8]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[9]  O. Sporns,et al.  A cross-disorder connectome landscape of brain dysconnectivity , 2019, Nature Reviews Neuroscience.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Khundrakpam Budhachandra,et al.  The Neuro Bureau Preprocessing Initiative: open sharing of preprocessed neuroimaging data and derivatives , 2013 .

[12]  Keith A. Johnson,et al.  Cortical Hubs Revealed by Intrinsic Functional Connectivity: Mapping, Assessment of Stability, and Relation to Alzheimer's Disease , 2009, The Journal of Neuroscience.

[13]  Edward T. Bullmore,et al.  Schizophrenia, neuroimaging and connectomics , 2012, NeuroImage.

[14]  Meng Wang,et al.  Adaptive Hypergraph Learning and its Application in Image Classification , 2012, IEEE Transactions on Image Processing.

[15]  Islem Rekik,et al.  Adversarial Connectome Embedding for Mild Cognitive Impairment Identification Using Cortical Morphological Networks , 2019, CNI@MICCAI.

[16]  J. Rapoport,et al.  The anatomical distance of functional connections predicts brain network topology in health and schizophrenia. , 2013, Cerebral cortex.

[17]  Feiping Nie,et al.  Capped Lp-Norm Graph Embedding for Photo Clustering , 2016, ACM Multimedia.

[18]  Mark E. J. Newman A measure of betweenness centrality based on random walks , 2005, Soc. Networks.

[19]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[20]  Islem Rekik,et al.  Hierarchical Adversarial Connectomic Domain Alignment for Target Brain Graph Prediction and Classification from a Source Graph , 2019, PRIME@MICCAI.

[21]  Changsheng Xu,et al.  Topic-Sensitive Influencer Mining in Interest-Based Social Media Networks via Hypergraph Learning , 2014, IEEE Transactions on Multimedia.

[22]  Islem Rekik,et al.  High-order Connectomic Manifold Learning for Autistic Brain State Identification , 2017, CNI@MICCAI.

[23]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Liujuan Cao,et al.  Cross-Modality Microblog Sentiment Prediction via Bi-Layer Multimodal Hypergraph Learning , 2019, IEEE Transactions on Multimedia.

[25]  Kevin Chen-Chuan Chang,et al.  A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[26]  Islem Rekik,et al.  Symmetric Dual Adversarial Connectomic Domain Alignment for Predicting Isomorphic Brain Graph from a Baseline Graph , 2019, MICCAI.

[27]  Kevin Chen-Chuan Chang,et al.  Semantic Proximity Search on Heterogeneous Graph by Proximity Embedding , 2017, AAAI.

[28]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[29]  Pierre Vandergheynst,et al.  Geometric Deep Learning: Going beyond Euclidean data , 2016, IEEE Signal Process. Mag..

[30]  Chao Tang,et al.  The Dynamic Measurements of Regional Brain Activity for Resting-State fMRI: d-ALFF, d-fALFF and d-ReHo , 2018, MICCAI.

[31]  Islem Rekik,et al.  Brain multiplexes reveal morphological connectional biomarkers fingerprinting late brain dementia states , 2018, Scientific Reports.

[32]  Alexander J. Smola,et al.  Distributed large-scale natural graph factorization , 2013, WWW.

[33]  Islem Rekik,et al.  Autism Spectrum Disorder Diagnosis Using Sparse Graph Embedding of Morphological Brain Networks , 2017, GRAIL/MFCA/MICGen@MICCAI.

[34]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[35]  Le Song,et al.  Discriminative Embeddings of Latent Variable Models for Structured Data , 2016, ICML.

[36]  Hu Lu,et al.  Detecting Community Structure Based on Optimized Modularity by Genetic Algorithm in Resting-State fMRI , 2017, ISNN.

[37]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[38]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[39]  Dinggang Shen,et al.  Multiple-Network Classification of Childhood Autism Using Functional Connectivity Dynamics , 2014, MICCAI.

[40]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[41]  Ben Glocker,et al.  Distance Metric Learning Using Graph Convolutional Networks: Application to Functional Brain Networks , 2017, MICCAI.

[42]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[43]  Bernhard Schölkopf,et al.  Learning with Hypergraphs: Clustering, Classification, and Embedding , 2006, NIPS.

[44]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.