Employing Transformer Encoders for Enhanced Functional Connectivity Mapping

Functional magnetic resonance imaging (fMRI) provides a way to spatially and temporally map brain activity, making it a crucial tool in many advanced psychology and neuroscience studies. A variety of techniques are suggested to analyze the four-dimensional data produced by fMRI scans. When it comes to classification tasks, the most prevalent method involves examining functional connectivity. This process involves dividing the brain volume into separate regions and determining the correlation between the series of events occurring over time in these regions. While deep graph models and deep convolutional models are frequently employed to process functional connectivity, these methods can sometimes overcomplicate the procedure. In contrast, we present a straightforward approach that utilizes transformer encoders to map functional connectivity to labels. Our method demonstrates superior performance in gender classification tasks when compared to existing deep graph and convolution models. We've validated this on two publicly accessible datasets.

[1]  Irmak Sivgin,et al.  A Plug-In Graph Neural Network to Boost Temporal Sensitivity in fMRI Analysis , 2023, IEEE Journal of Biomedical and Health Informatics.

[2]  Onat Dalmaz,et al.  Unsupervised Medical Image Translation With Adversarial Diffusion Models , 2022, IEEE Transactions on Medical Imaging.

[3]  S. Avestimehr,et al.  One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesis , 2022, Medical Image Anal..

[4]  Alper Gungor,et al.  Adaptive Diffusion Priors for Accelerated MRI Reconstruction , 2022, Medical Image Anal..

[5]  T. Çukur,et al.  BolT: Fused Window Transformers for fMRI Time Series Analysis , 2022, Medical Image Anal..

[6]  S. Avestimehr,et al.  Federated Learning of Generative Image Priors for MRI Reconstruction , 2022, IEEE Transactions on Medical Imaging.

[7]  Can Barics Top,et al.  TranSMS: Transformers for Super-Resolution Calibration in Magnetic Particle Imaging , 2021, IEEE Transactions on Medical Imaging.

[8]  J. Gallant,et al.  Cortical networks of dynamic scene category representation in the human brain , 2021, Cortex.

[9]  T. Çukur,et al.  ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis , 2021, IEEE Transactions on Medical Imaging.

[10]  Tolga Çukur,et al.  Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers , 2021, IEEE Transactions on Medical Imaging.

[11]  H. Scholte,et al.  The Amsterdam Open MRI Collection, a set of multimodal MRI datasets for individual difference analyses , 2020, Scientific Data.

[12]  Juntang Zhuang,et al.  BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis , 2020, bioRxiv.

[13]  Tolga Çukur,et al.  Informed feature regularization in voxelwise modeling for naturalistic fMRI experiments , 2020, The European journal of neuroscience.

[14]  Tolga Çukur,et al.  Spatially informed voxelwise modeling for naturalistic fMRI experiments , 2019, NeuroImage.

[15]  Aykut Koç,et al.  Semantic Structure and Interpretability of Word Embeddings , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[16]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[17]  Evan M. Gordon,et al.  Local-Global Parcellation of the Human Cerebral Cortex From Intrinsic Functional Connectivity MRI , 2017, bioRxiv.

[18]  Ghassan Hamarneh,et al.  BrainNetCNN: Convolutional neural networks for brain networks; towards predicting neurodevelopment , 2017, NeuroImage.

[19]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[20]  Yu-Jhe Li Unsupervised , 2009, Encyclopedia of Biometrics.