Brain Network Analysis and Classification Based on Convolutional Neural Network

Background: Convolution neural networks (CNN) is increasingly used in computer science and finds more and more applications in different fields. However, analyzing brain network with CNN is not trivial, due to the non-Euclidean characteristics of brain network built by graph theory. Method: To address this problem, we used a famous algorithm “word2vec” from the field of natural language processing (NLP), to represent the vertexes of graph in the node embedding space, and transform the brain network into images, which can bridge the gap between brain network and CNN. Using this model, we analyze and classify the brain network from Magnetoencephalography (MEG) data into two categories: normal controls and patients with migraine. Results: In the experiments, we applied our method on the clinical MEG dataset, and got the mean classification accuracy rate 81.25%. Conclusions: These results indicate that our method can feasibly analyze and classify the brain network, and all the abundant resources of CNN can be used on the analysis of brain network.

[1]  Fernando Maestú,et al.  What graph theory actually tells us about resting state interictal MEG epileptic activity , 2015, NeuroImage: Clinical.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Roger Guimerà,et al.  Cartography of complex networks: modules and universal roles , 2005, Journal of statistical mechanics.

[4]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[5]  M. Breakspear,et al.  Changes in Community Structure of Resting State Functional Connectivity in Unipolar Depression , 2012, PloS one.

[6]  O. Sporns,et al.  Motifs in Brain Networks , 2004, PLoS biology.

[7]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[8]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[9]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[10]  Michalis Vazirgiannis,et al.  Classifying Graphs as Images with Convolutional Neural Networks , 2017, ArXiv.

[11]  Jeffrey D. Rudie,et al.  Development of the Default Mode and Central Executive Networks across early adolescence: A longitudinal study , 2014, Developmental Cognitive Neuroscience.

[12]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[13]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[14]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[15]  Edward T. Bullmore,et al.  Small-World Brain Networks Revisited , 2016, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[16]  Ghassan Hamarneh,et al.  BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment , 2017, NeuroImage.

[17]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[18]  L. Freeman.  Centrality in social networks conceptual clarification , 1978 .

[19]  K. Gurney,et al.  Network ‘Small-World-Ness’: A Quantitative Method for Determining Canonical Network Equivalence , 2008, PloS one.

[20]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[21]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[22]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Danielle Smith Bassett,et al.  Small-World Brain Networks , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[26]  R Pastor-Satorras,et al.  Dynamical and correlation properties of the internet. , 2001, Physical review letters.

[27]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[28]  D. Halliday,et al.  Volume conduction effects in brain network inference from electroencephalographic recordings using phase lag index , 2012, Journal of Neuroscience Methods.

[29]  M E J Newman.  Assortative mixing in networks. , 2002, Physical review letters.

[30]  C. Stam,et al.  Altered sleep brain functional connectivity in acutely depressed patients , 2009, Human brain mapping.

[31]  Fumiko Hoeft,et al.  GAT: A Graph-Theoretical Analysis Toolbox for Analyzing Between-Group Differences in Large-Scale Structural and Functional Brain Networks , 2012, PloS one.

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[34]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[35]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[36]  Beilei Wang,et al.  Functional brain network alterations in epilepsy: A magnetoencephalography study , 2016, Epilepsy Research.

[37]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[38]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[39]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[40]  Kunihiko Fukushima,et al.  Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition , 1982 .

[41]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[42]  Xiaoqi Huang,et al.  Disrupted Brain Connectivity Networks in Drug-Naive, First-Episode Major Depressive Disorder , 2011, Biological Psychiatry.