Similarity Learning with Higher-Order Graph Convolutions for Brain Network Analysis

Learning a similarity metric has gained much attention recently, where the goal is to learn a function that maps input patterns to a target space while preserving the semantic distance in the input space. While most related work focused on images, we focus instead on learning a similarity metric for neuroimages, such as fMRI and DTI images. We propose an end-to-end similarity learning framework called Higher-order Siamese GCN for multi-subject fMRI data analysis. The proposed framework learns the brain network representations via a supervised metric-based approach with siamese neural networks using two graph convolutional networks as the twin networks. Our proposed framework performs higher-order convolutions by incorporating higher-order proximity in graph convolutional networks to characterize and learn the community structure in brain connectivity networks. To the best of our knowledge, this is the first community-preserving similarity learning framework for multi-subject brain network analysis. Experimental results on four real fMRI datasets demonstrate the potential use cases of the proposed framework for multi-subject brain analysis in health and neuropsychiatric disorders. Our proposed approach achieves an average AUC gain of 75% compared to PCA, an average AUC gain of 65.5% compared to Spectral Embedding, and an average AUC gain of 24.3% compared to S-GCN across the four datasets, indicating promising application in clinical investigation and brain disease diagnosis.

[1]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[2]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[3]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[4]  Wei-Ying Ma,et al.  Learning similarity measure for natural image retrieval with relevance feedback , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Anil K. Jain,et al.  On-line signature verification, , 2002, Pattern Recognit..

[6]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[7]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[8]  Klaus Hechenbichler,et al.  Weighted k-Nearest-Neighbor Techniques and Ordinal Classification , 2004 .

[9]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[11]  M. Greicius Resting-state functional connectivity in neuropsychiatric disorders , 2008, Current opinion in neurology.

[12]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[13]  O Sporns,et al.  Predicting human resting-state functional connectivity from structural connectivity , 2009, Proceedings of the National Academy of Sciences.

[14]  E. Bullmore,et al.  Human brain networks in health and disease , 2009, Current opinion in neurology.

[15]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[16]  Samy Bengio,et al.  An Online Algorithm for Large Scale Image Similarity Learning , 2009, NIPS.

[17]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[18]  Susan L. Whitfield-Gabrieli,et al.  Conn: A Functional Connectivity Toolbox for Correlated and Anticorrelated Brain Networks , 2012, Brain Connect..

[19]  Lorenzo Livi,et al.  The graph matching problem , 2012, Pattern Analysis and Applications.

[20]  Ying Wu,et al.  Structural brain alterations can be detected early in HIV infection , 2012, Neurology.

[21]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[22]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[23]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[24]  Tung-Ping Su,et al.  Altered Resting-State Functional Connectivity of Striatal-Thalamic Circuit in Bipolar Disorder , 2014, PloS one.

[25]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[26]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[27]  Bertrand Thirion,et al.  Graph-Based Inter-Subject Pattern Analysis of fMRI Data , 2014, PloS one.

[28]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[30]  Philip S. Yu,et al.  Identification of Discriminative Subgraph Patterns in fMRI Brain Networks in Bipolar Affective Disorder , 2015, BIH.

[31]  B T Thomas Yeo,et al.  The modular and integrative functional architecture of the human brain , 2015, Proceedings of the National Academy of Sciences.

[32]  Ryan A. Rossi,et al.  Efficient Graphlet Counting for Large Networks , 2015, 2015 IEEE International Conference on Data Mining.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[35]  Philip S. Yu,et al.  Multi-graph Clustering Based on Interior-Node Topology with Applications to Brain Networks , 2016, ECML/PKDD.

[36]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[37]  Jure Leskovec,et al.  Higher-order organization of complex networks , 2016, Science.

[38]  Danai Koutra,et al.  Scalable Hashing-Based Network Discovery , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[39]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[40]  Yi Pan,et al.  Complex Brain Network Analysis and Its Applications to Brain Disorders: A Survey , 2017, Complex..

[41]  Philip S. Yu,et al.  Multi-view Graph Embedding with Hub Detection for Brain Network Analysis , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[42]  Dimitris Samaras,et al.  Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example , 2016, NeuroImage.

[43]  Ryan A. Rossi,et al.  Deep Feature Learning for Graphs , 2017, ArXiv.

[44]  Björn Ommer,et al.  Deep Unsupervised Similarity Learning Using Partially Ordered Sets , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Philip S. Yu,et al.  Multi-view Clustering with Graph Embedding for Connectome Analysis , 2017, CIKM.

[46]  Philip S. Yu,et al.  Structural Deep Brain Network Mining , 2017, KDD.

[47]  Fei Wang,et al.  Unsupervised Network Discovery for Brain Imaging Data , 2017, KDD.

[48]  Ryan A. Rossi,et al.  Learning Role-based Graph Embeddings , 2018, ArXiv.

[49]  Ryan A. Rossi,et al.  Relational Similarity Machines (RSM): A Similarity-based Learning Framework for Graphs , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[50]  Ryan A. Rossi,et al.  Continuous-Time Dynamic Network Embeddings , 2018, WWW.

[51]  Nesreen K. Ahmed,et al.  Sampling for Approximate Bipartite Network Projection , 2017, IJCAI.

[52]  Ryan A. Rossi,et al.  Higher-order Network Representation Learning , 2018, WWW.

[53]  Ryan A. Rossi,et al.  Attention Models in Graphs: A Survey , 2018 .

[54]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[55]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[56]  Ryan A. Rossi,et al.  Graph Classification using Structural Attention , 2018, KDD.

[57]  Ben Glocker,et al.  Metric learning with spectral graph convolutions on brain connectivity networks , 2018, NeuroImage.

[58]  Ryan A. Rossi,et al.  Similarity-based Multi-label Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[59]  Essa Yacoub,et al.  The Lifespan Human Connectome Project in Aging: An overview , 2019, NeuroImage.

[60]  Michael W. Cole,et al.  Mapping the human brain's cortical-subcortical functional network organization , 2018, NeuroImage.

[61]  Tsuyoshi Murata,et al.  {m , 1934, ACML.