A Graph Signal Processing View on Functional Brain Imaging

Modern neuroimaging techniques provide us with unique views on brain structure and function; i.e., how the brain is wired, and where and when activity takes place. Data acquired using these techniques can be analyzed in terms of its network structure to reveal organizing principles at the systems level. Graph representations are versatile models where nodes are associated to brain regions and edges to structural or functional connections. Structural graphs model neural pathways in white matter that are the anatomical backbone between regions. Functional graphs are built based on functional connectivity, which is a pairwise measure of statistical interdependency between activity traces of regions. Therefore, most research to date has focused on analyzing these graphs reflecting structure or function. Graph signal processing (GSP) is an emerging area of research where signals recorded at the nodes of the graph are studied atop the underlying graph structure. An increasing number of fundamental operations have been generalized to the graph setting, allowing to analyze the signals from a new viewpoint. Here, we review GSP for brain imaging data and discuss their potential to integrate brain structure, contained in the graph itself, with brain function, residing in the graph signals. We review how brain activity can be meaningfully filtered based on concepts of spectral modes derived from brain structure. We also derive other operations such as surrogate data generation or decompositions informed by cognitive systems. In sum, GSP offers a novel framework for the analysis of brain imaging data.

[1]  D. Navon Forest before trees: The precedence of global features in visual perception , 1977, Cognitive Psychology.

[2]  Andreas Loukas,et al.  A Time-Vertex Signal Processing Framework , 2017 .

[3]  O. Sporns,et al.  Rich-Club Organization of the Human Connectome , 2011, The Journal of Neuroscience.

[4]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[5]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[6]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[7]  Gonzalo Mateos,et al.  A digraph fourier transform with spread frequency components , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[8]  Stephen M. Smith,et al.  BET: Brain Extraction Tool , 2013 .

[9]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[10]  Sahin Albayrak,et al.  Spectral Analysis of Signed Graphs for Clustering, Prediction and Visualization , 2010, SDM.

[11]  Dimitri Van De Ville,et al.  Anatomically-adapted graph wavelets for improved group-level fMRI activation mapping , 2015, NeuroImage.

[12]  Siheng Chen,et al.  Localization, Decomposition, and Dictionary Learning of Piecewise-Constant Signals on Graphs , 2016 .

[13]  Ngai-Man Cheung,et al.  Simultaneous low-rank component and graph estimation for high-dimensional graph signals: Application to brain imaging , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Anthony Randal McIntosh,et al.  Relating brain signal variability to knowledge representation , 2012, NeuroImage.

[15]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[16]  Maria Giulia Preti,et al.  Dynamics of functional connectivity at high spatial resolution reveal long-range interactions and fine-scale organization , 2017, Scientific Reports.

[17]  Gene Cheung,et al.  Graph Laplacian Regularization for Inverse Imaging: Analysis in the Continuous Domain , 2016, ArXiv.

[18]  Luke Bloy,et al.  GABA estimation in the brains of children on the autism spectrum: Measurement precision and regional cortical variation , 2014, NeuroImage.

[19]  Dimitri Van De Ville,et al.  When Slepian Meets Fiedler: Putting a Focus on the Graph Spectrum , 2017, IEEE Signal Processing Letters.

[20]  Zachary C. Irving,et al.  Mind-wandering as spontaneous thought: a dynamic framework , 2016, Nature Reviews Neuroscience.

[21]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[22]  Santiago Segarra,et al.  Diffusion filtering of graph signals and its use in recommendation systems , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[24]  Dimitri Van De Ville,et al.  Tight Wavelet Frames on Multislice Graphs , 2013, IEEE Transactions on Signal Processing.

[25]  Gonzalo Mateos,et al.  Closing the Knowledge Gap in an Online Learning Community: Network-Analytic Discoveries, Simulation and Prediction , 2017, ArXiv.

[26]  Scott T. Grafton,et al.  Structural foundations of resting-state and task-based functional connectivity in the human brain , 2013, Proceedings of the National Academy of Sciences.

[27]  D. Bassett,et al.  A Network Neuroscience of Human Learning: Potential to Inform Quantitative Theories of Brain and Behavior , 2017, Trends in Cognitive Sciences.

[28]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[29]  S. MacDonald,et al.  Neuroscience and Biobehavioral Reviews Review Moment-to-moment Brain Signal Variability: a next Frontier in Human Brain Mapping? , 2022 .

[30]  D. Bassett,et al.  Dynamic reconfiguration of frontal brain networks during executive cognition in humans , 2015, Proceedings of the National Academy of Sciences.

[31]  Alejandro Ribeiro,et al.  Functional Alignment with Anatomical Networks is Associated with Cognitive Flexibility , 2016, Nature Human Behaviour.

[32]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Selen Atasoy,et al.  Human brain networks function in connectome-specific harmonic waves , 2016, Nature Communications.

[34]  C. Grady,et al.  The modulation of BOLD variability between cognitive states varies by age and processing speed. , 2013, Cerebral cortex.

[35]  E. Bullmore,et al.  Human brain networks in health and disease , 2009, Current opinion in neurology.

[36]  V. Calhoun,et al.  The Chronnectome: Time-Varying Connectivity Networks as the Next Frontier in fMRI Data Discovery , 2014, Neuron.

[37]  Mark W. Woolrich,et al.  FSL , 2012, NeuroImage.

[38]  Fang-Cheng Yeh,et al.  Estimation of fiber orientation and spin density distribution by diffusion deconvolution , 2011, NeuroImage.

[39]  O. Sporns,et al.  Mapping the Structural Core of Human Cerebral Cortex , 2008, PLoS biology.

[40]  Fikret Isik Karahanoglu,et al.  Dynamics of large-scale fMRI networks: Deconstruct brain activity to build better models of brain function , 2017 .

[41]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[42]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[43]  S. Mallat A wavelet tour of signal processing , 1998 .

[44]  Richard F. Betzel,et al.  Modular Brain Networks. , 2016, Annual review of psychology.

[45]  Pascal Frossard,et al.  Graph-Based Compression of Dynamic 3D Point Cloud Sequences , 2015, IEEE Transactions on Image Processing.

[46]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[47]  D. Chialvo,et al.  Brain resting state is disrupted in chronic back pain patients , 2010, Neuroscience Letters.

[48]  S. Swinnen,et al.  Subcortical volume analysis in traumatic brain injury: The importance of the fronto-striato-thalamic circuit in task switching , 2014, Cortex.

[49]  Tülay Adalı,et al.  Diversity in Independent Component and Vector Analyses: Identifiability, algorithms, and applications in medical imaging , 2014, IEEE Signal Processing Magazine.

[50]  Scott T. Grafton,et al.  Dynamic reconfiguration of human brain networks during learning , 2010, Proceedings of the National Academy of Sciences.

[51]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[52]  B. T. Thomas Yeo,et al.  Cerebral functional connectivity periodically (de)synchronizes with anatomical constraints , 2015, Brain Structure and Function.

[53]  Julia P. Owen,et al.  Brain network eigenmodes provide a robust and compact representation of the structural connectome in health and disease , 2017, PLoS Comput. Biol..

[54]  Olaf Sporns,et al.  Dynamic fluctuations coincide with periods of high and low modularity in resting-state functional brain networks , 2015, NeuroImage.

[55]  D. Long Networks of the Brain , 2011 .

[56]  Jean M. Vettel,et al.  Controllability of structural brain networks , 2014, Nature Communications.

[57]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[58]  Ronald R. Coifman,et al.  Diffusion Maps for Signal Processing: A Deeper Look at Manifold-Learning Techniques Based on Kernels and Graphs , 2013, IEEE Signal Processing Magazine.

[59]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[60]  Alejandro Ribeiro,et al.  Collaborative filtering via graph signal processing , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[61]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[62]  Hillary D. Schwarb,et al.  Short‐time windows of correlation between large‐scale functional brain networks predict vigilance intraindividually and interindividually , 2013, Human brain mapping.

[63]  Pierre Borgnat,et al.  Subgraph-Based Filterbanks for Graph Signals , 2015, IEEE Transactions on Signal Processing.

[64]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[65]  Alejandro Ribeiro,et al.  Graph Frequency Analysis of Brain Signals , 2015, IEEE Journal of Selected Topics in Signal Processing.

[66]  P. P. Vaidyanathan,et al.  Uncertainty Principles and Sparse Eigenvectors of Graphs , 2017, IEEE Transactions on Signal Processing.

[67]  Pierre Borgnat,et al.  Graph Wavelets for Multiscale Community Mining , 2014, IEEE Transactions on Signal Processing.

[68]  N. Makris,et al.  Gyri of the human neocortex: an MRI-based analysis of volume and variance. , 1998, Cerebral cortex.

[69]  B. Silverman,et al.  Multiscale methods for data on graphs and irregular multidimensional situations , 2009 .

[70]  Vince D. Calhoun,et al.  A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data , 2009, NeuroImage.

[71]  G. Ermentrout Principles of brain functioning: A synergetic approach to brain activity, behavior, and cognition , 1997 .

[72]  Santiago Segarra,et al.  Stationary Graph Processes and Spectral Estimation , 2016, IEEE Transactions on Signal Processing.

[73]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[74]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[75]  Jonathan D. Power,et al.  Prediction of Individual Brain Maturity Using fMRI , 2010, Science.

[76]  Pier Luigi Dragotti,et al.  The graph FRI framework-spline wavelet theory and sampling on circulant graphs , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[77]  O. Sporns Contributions and challenges for network models in cognitive neuroscience , 2014, Nature Neuroscience.

[78]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[79]  Michael G. Rabbat,et al.  Graph Laplacian distributed particle filtering , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[80]  Dimitri Van De Ville,et al.  The dynamic functional connectome: State-of-the-art and perspectives , 2017, NeuroImage.

[81]  Pierre Vandergheynst,et al.  Stationary Signal Processing on Graphs , 2016, IEEE Transactions on Signal Processing.

[82]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[83]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[84]  Patric Hagmann,et al.  Mapping the human connectome at multiple scales with diffusion spectrum MRI , 2012, Journal of Neuroscience Methods.

[85]  Antonio Ortega,et al.  A graph-based joint bilateral approach for depth enhancement , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[86]  Scott T. Grafton,et al.  Local termination pattern analysis: a tool for comparing white matter morphology , 2013, Brain Imaging and Behavior.

[87]  R. Kahn,et al.  Efficiency of Functional Brain Networks and Intellectual Performance , 2009, The Journal of Neuroscience.

[88]  Dimitri Van De Ville,et al.  A Spectral Method for Generating Surrogate Graph Signals , 2016, IEEE Signal Processing Letters.

[89]  Danielle S. Bassett,et al.  Dynamic graph metrics: Tutorial, toolbox, and tale , 2017, NeuroImage.

[90]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[91]  Vincent Gripon,et al.  Toward an uncertainty principle for weighted graphs , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[92]  Edward T. Bullmore,et al.  Whole-brain anatomical networks: Does the choice of nodes matter? , 2010, NeuroImage.

[93]  Pierre Vandergheynst,et al.  Towards stationary time-vertex signal processing , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[94]  M. Weiner,et al.  A Network Diffusion Model of Disease Progression in Dementia , 2012, Neuron.

[95]  Viktor K. Jirsa,et al.  An automated pipeline for constructing personalized virtual brains from multimodal neuroimaging data , 2015, NeuroImage.

[96]  Somwrita Sarkar,et al.  Eigenmodes of brain activity: Neural field theory predictions and comparison with experiment , 2016, NeuroImage.

[97]  Mark Crovella,et al.  Graph wavelets for spatial traffic analysis , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[98]  Santiago Segarra,et al.  Brain network efficiency is influenced by the pathologic source of corticobasal syndrome , 2017, Neurology.

[99]  Pier Luigi Dragotti,et al.  Sampling and Reconstruction of Sparse Signals on Circulant Graphs - An Introduction to Graph-FRI , 2016, ArXiv.

[100]  Dimitri Van De Ville,et al.  Signal-Adapted Tight Frames on Graphs , 2016, IEEE Transactions on Signal Processing.

[101]  Xavier Bresson,et al.  Matrix Completion on Graphs , 2014, NIPS 2014.

[102]  O. Sporns,et al.  Network neuroscience , 2017, Nature Neuroscience.

[103]  H. Voss,et al.  Network diffusion accurately models the relationship between structural and functional brain connectivity networks , 2014, NeuroImage.

[104]  H. Mhaskar A unified framework for harmonic analysis of functions on directed graphs and changing data , 2016, 1604.06835.

[105]  José M. F. Moura,et al.  Signal Localization, Decomposition and Dictionary Learning on Graphs , 2016, ArXiv.

[106]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.