Similarity Learning with Higher-Order Proximity for Brain Network Analysis

In recent years, the similarity learning problem has been widely studied. Most of the existing works focus on images and few of these works could be applied to learn similarity between neuroimages, such as fMRI images and DTI images, which are important data sources for human brain analysis. In this paper, we focus on the similarity learning for fMRI brain network analysis. We propose a general framework called "Multi-hop Siamese GCN" for similarity learning on graphs. This framework provides options for refining the graph representations with high-order structure information, thus can be used for graph similarity learning on various brain network data sets. We apply the proposed Multi-hop Siamese GCN approach on four real fMRI brain network datasets for similarity learning with respect to brain health status and cognitive abilities. Our proposed method achieves an average AUC gain of 82.6% compared to PCA, and an average AUC gain of 42% compared to S-GCN across a variety of datasets, indicating its promising learning ability for clinical investigation and brain disease diagnosis.

[1]  Samy Bengio,et al.  An Online Algorithm for Large Scale Image Similarity Learning , 2009, NIPS.

[2]  Philip S. Yu,et al.  Multi-view Clustering with Graph Embedding for Connectome Analysis , 2017, CIKM.

[3]  B T Thomas Yeo,et al.  The modular and integrative functional architecture of the human brain , 2015, Proceedings of the National Academy of Sciences.

[4]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[5]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[6]  Ryan A. Rossi,et al.  Graph Classification using Structural Attention , 2018, KDD.

[7]  Yang Song,et al.  Learning Fine-Grained Image Similarity with Deep Ranking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[9]  Ryan A. Rossi,et al.  Relational Similarity Machines (RSM): A Similarity-based Learning Framework for Graphs , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[10]  Lorenzo Livi,et al.  The graph matching problem , 2012, Pattern Analysis and Applications.

[11]  Ryan A. Rossi,et al.  Deep Feature Learning for Graphs , 2017, ArXiv.

[12]  Ryan A. Rossi,et al.  Similarity-based Multi-label Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[13]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[14]  Fei Wang,et al.  Unsupervised Network Discovery for Brain Imaging Data , 2017, KDD.

[15]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[16]  Timothy O. Laumann,et al.  Functional Network Organization of the Human Brain , 2011, Neuron.

[17]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[18]  Danai Koutra,et al.  Scalable Hashing-Based Network Discovery , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[19]  Michael W. Cole,et al.  Mapping the human brain's cortical-subcortical functional network organization , 2018, NeuroImage.

[20]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[21]  Daniel P. Kennedy,et al.  The Autism Brain Imaging Data Exchange: Towards Large-Scale Evaluation of the Intrinsic Brain Architecture in Autism , 2013, Molecular Psychiatry.

[22]  Essa Yacoub,et al.  The Lifespan Human Connectome Project in Aging: An overview , 2019, NeuroImage.

[23]  O Sporns,et al.  Predicting human resting-state functional connectivity from structural connectivity , 2009, Proceedings of the National Academy of Sciences.

[24]  P. Morgane,et al.  A review of systems and networks of the limbic forebrain/limbic midbrain , 2005, Progress in Neurobiology.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Yi Pan,et al.  Complex Brain Network Analysis and Its Applications to Brain Disorders: A Survey , 2017, Complex..

[27]  Björn Ommer,et al.  Deep Unsupervised Similarity Learning Using Partially Ordered Sets , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Wei-Ying Ma,et al.  Learning similarity measure for natural image retrieval with relevance feedback , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[30]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[31]  Ryan A. Rossi,et al.  Continuous-Time Dynamic Network Embeddings , 2018, WWW.

[32]  Ryan A. Rossi,et al.  Learning Role-based Graph Embeddings , 2018, ArXiv.

[33]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[34]  Nesreen K. Ahmed,et al.  Sampling for Approximate Bipartite Network Projection , 2017, IJCAI.

[35]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Ryan A. Rossi,et al.  Higher-order Network Representation Learning , 2018, WWW.

[37]  Jure Leskovec,et al.  Higher-order organization of complex networks , 2016, Science.

[38]  Philip S. Yu,et al.  Identification of Discriminative Subgraph Patterns in fMRI Brain Networks in Bipolar Affective Disorder , 2015, BIH.

[39]  Philip S. Yu,et al.  Multi-view Graph Embedding with Hub Detection for Brain Network Analysis , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[40]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[41]  Ying Wu,et al.  Structural brain alterations can be detected early in HIV infection , 2012, Neurology.

[42]  Philip S. Yu,et al.  Spatio-Temporal Tensor Analysis for Whole-Brain fMRI Classification , 2016, SDM.

[43]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[44]  Yong He,et al.  BrainNet Viewer: A Network Visualization Tool for Human Brain Connectomics , 2013, PloS one.

[45]  V. Matousek,et al.  Signature verification using ART-2 neural network , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[46]  Philip S. Yu,et al.  Multi-graph Clustering Based on Interior-Node Topology with Applications to Brain Networks , 2016, ECML/PKDD.

[47]  Susan L. Whitfield-Gabrieli,et al.  Conn: A Functional Connectivity Toolbox for Correlated and Anticorrelated Brain Networks , 2012, Brain Connect..

[48]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[49]  Philip S. Yu,et al.  Structural Deep Brain Network Mining , 2017, KDD.

[50]  Bertrand Thirion,et al.  Graph-Based Inter-Subject Pattern Analysis of fMRI Data , 2014, PloS one.

[51]  Ryan A. Rossi,et al.  Attention Models in Graphs , 2018, ACM Trans. Knowl. Discov. Data.

[52]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[53]  Dimitris Samaras,et al.  Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example , 2016, NeuroImage.

[54]  Ben Glocker,et al.  Metric learning with spectral graph convolutions on brain connectivity networks , 2018, NeuroImage.

[55]  Klaus Hechenbichler,et al.  Weighted k-Nearest-Neighbor Techniques and Ordinal Classification , 2004 .