Graph-Based Decoding Model for Functional Alignment of Unaligned fMRI Data

Aggregating multi-subject functional magnetic resonance imaging (fMRI) data is indispensable for generating valid and general inferences from patterns distributed across human brains. The disparities in anatomical structures and functional topographies of human brains warrant aligning fMRI data across subjects. However, the existing functional alignment methods cannot handle well various kinds of fMRI datasets today, especially when they are not temporally-aligned, i.e., some of the subjects probably lack the responses to some stimuli, or different subjects might follow different sequences of stimuli. In this paper, a cross-subject graph that depicts the (dis)similarities between samples across subjects is used as a priori for developing a more flexible framework that suits an assortment of fMRI datasets. However, the high dimension of fMRI data and the use of multiple subjects makes the crude framework time-consuming or unpractical. To address this issue, we further regularize the framework, so that a novel feasible kernel-based optimization, which permits non-linear feature extraction, could be theoretically developed. Specifically, a low-dimension assumption is imposed on each new feature space to avoid overfitting caused by the high-spatial-low-temporal resolution of fMRI data. Experimental results on five datasets suggest that the proposed method is not only superior to several state-of-the-art methods on temporally-aligned fMRI data, but also suitable for dealing with temporally-unaligned fMRI data.

[1]  U. Feige,et al.  Spectral graph theory , 2019, Zeta and 𝐿-functions in Number Theory and Combinatorics.

[2]  Theodore L. Willke,et al.  Capturing Shared and Individual Information in fMRI Data , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Theodore L. Willke,et al.  A semi-supervised method for multi-subject FMRI functional alignment , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  J. S. Guntupalli,et al.  A Model of Representational Spaces in Human Cortex , 2016, Cerebral cortex.

[5]  Po-Hsuan Chen,et al.  A Reduced-Dimension fMRI Shared Response Model , 2015, NIPS.

[6]  Johan D. Carlin,et al.  Adjudicating between face-coding models with individual-face fMRI responses , 2015, bioRxiv.

[7]  J. S. Guntupalli,et al.  Decoding neural representational spaces using multivariate pattern analysis. , 2014, Annual review of neuroscience.

[8]  Peter J. Ramadge,et al.  Kernel Hyperalignment , 2012, NIPS.

[9]  Hao Xu,et al.  Regularized hyperalignment of multi-set fMRI data , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[10]  J. Mumford,et al.  Decreasing Ventromedial Prefrontal Cortex Activity During Sequential Risk-Taking: An fMRI Investigation of the Balloon Analog Risk Task , 2012, Front. Neurosci..

[11]  Bryan R. Conroy,et al.  A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex , 2011, Neuron.

[12]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[13]  Joshua M. Lewis,et al.  Multi-view kernel construction , 2010, Machine Learning.

[14]  Peter J. Ramadge,et al.  fMRI-Based Inter-Subject Cortical Alignment Using Functional Connectivity , 2009, NIPS.

[15]  Bryan R. Conroy,et al.  Function-based Intersubject Alignment of Human Cortical Anatomy , 2009, Cerebral cortex.

[16]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[17]  Russell A Poldrack,et al.  Modulation of competing memory systems by distraction. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[18]  N. Logothetis The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[19]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[20]  A. Galaburda,et al.  Topographical variation of the human primary cortices: implications for neuroimaging, brain mapping, and neurobiology. , 1993, Cerebral cortex.

[21]  Richard S. J. Frackowiak,et al.  Area V5 of the human brain: evidence from a combined study using positron emission tomography and magnetic resonance imaging. , 1993, Cerebral cortex.

[22]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[23]  W. Rudin Real and complex analysis , 1968 .

[24]  Po-Hsuan Chen,et al.  Joint SVD-Hyperalignment for multi-subject FMRI data alignment , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[25]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.