Zero-shot fMRI decoding with three-dimensional registration based on diffusion tensor imaging

Functional magnetic resonance imaging (fMRI) acquisitions include a great deal of individual variability. This individuality often generates obstacles to the efficient use of databanks from multiple subjects. Although recent studies have suggested that inter-regional connectivity reflects individuality, conventional three-dimensional (3D) registration methods that calibrate inter-subject variability are based on anatomical information about the gray matter shape (e.g., T1-weighted). Here, we present a new registration method focusing more on the white matter structure, which is directly related to the connectivity in the brain, and apply it to subject-transfer brain decoding. Our registration method based on diffusion tensor imaging (DTI) transferred functional maps of each individual to a common anatomical space, where a decoding analysis of multi-voxel patterns was performed. The decoder trained on functional maps from other individuals in the common space showed a transfer decoding accuracy comparable to that of an individual decoder trained on single-subject functional maps. The DTI-based registration allowed more precise transformation of gray matter boundaries than a well-established T1-based method. These results suggest that the DTI-based registration is a promising tool for standardization of the brain functions, and moreover, will allow us to perform ‘zero-shot’ learning of decoders which is profitable in brain machine interface scenes.

[1]  Alex M Thomson,et al.  Excitatory connections made by presynaptic cortico-cortical pyramidal cells in layer 6 of the neocortex. , 2005, Cerebral cortex.

[2]  Masa-aki Sato,et al.  Reconstruction of two-dimensional movement trajectories from selected magnetoencephalography cortical currents by combined sparse Bayesian methods , 2011, NeuroImage.

[3]  Peter J. Ramadge,et al.  Inter-subject alignment of human cortical anatomy using functional connectivity , 2013, NeuroImage.

[4]  Arno Klein,et al.  101 Labeled Brain Images and a Consistent Human Cortical Labeling Protocol , 2012, Front. Neurosci..

[5]  D. V. van Essen,et al.  Surface-based approaches to spatial localization and registration in primate cerebral cortex. , 2004, NeuroImage.

[6]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[7]  Paul A. Yushkevich,et al.  Registration of diffusion tensor images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  André J. W. van der Kouwe,et al.  Brain morphometry with multiecho MPRAGE , 2008, NeuroImage.

[9]  Alex R. Smith,et al.  Sex differences in the structural connectome of the human brain , 2013, Proceedings of the National Academy of Sciences.

[10]  Paolo Maria Rossini,et al.  The electroencephalographic fingerprint of sleep is genetically determined: A twin study , 2008, Annals of neurology.

[11]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[12]  Motoaki Kawanabe,et al.  Decoding spatial attention by using cortical currents estimated from electroencephalography with near-infrared spectroscopy prior information , 2014, NeuroImage.

[13]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[14]  Kentaro Yamada,et al.  Inter-subject neural code converter for visual image representation , 2015, NeuroImage.

[15]  Shin Ishii,et al.  Deep learning of fMRI big data: a novel approach to subject-transfer decoding , 2015, ArXiv.

[16]  Bryan R. Conroy,et al.  A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex , 2011, Neuron.

[17]  Michael J. Brammer,et al.  Bayesian multi-task learning for decoding multi-subject neuroimaging data , 2014, NeuroImage.

[18]  P. Basser,et al.  Estimation of the effective self-diffusion tensor from the NMR spin echo. , 1994, Journal of magnetic resonance. Series B.

[19]  Paul A. Yushkevich,et al.  Deformable registration of diffusion tensor MR images with explicit orientation optimization , 2006, Medical Image Anal..

[20]  M. Chun,et al.  Functional connectome fingerprinting: Identifying individuals based on patterns of brain connectivity , 2015, Nature Neuroscience.

[21]  D. V. van Essen,et al.  A Population-Average, Landmark- and Surface-based (PALS) atlas of human cerebral cortex. , 2005, NeuroImage.

[22]  J. S. Guntupalli,et al.  Decoding neural representational spaces using multivariate pattern analysis. , 2014, Annual review of neuroscience.

[23]  Motoaki Kawanabe,et al.  Learning a common dictionary for subject-transfer decoding with resting calibration , 2015, NeuroImage.

[24]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[25]  Timoteo Carletti,et al.  The Stochastic Evolution of a Protocell: The Gillespie Algorithm in a Dynamically Varying Volume , 2011, Comput. Math. Methods Medicine.

[26]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[27]  R. Ptak The Frontoparietal Attention Network of the Human Brain , 2012, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[28]  Shinji Nishimoto,et al.  Lining Up Brains via a Common Representational Space , 2016, Trends in Cognitive Sciences.

[29]  Hervé Abdi,et al.  Multiple Subject Barycentric Discriminant Analysis (MUSUBADA): How to Assign Scans to Categories without Using Spatial Normalization , 2012, Comput. Math. Methods Medicine.

[30]  Arthur W. Toga,et al.  Human neuroimaging as a “Big Data” science , 2013, Brain Imaging and Behavior.

[31]  M D'Esposito,et al.  The roles of prefrontal brain regions in components of working memory: effects of memory load and individual differences. , 1999, Proceedings of the National Academy of Sciences of the United States of America.