Semi-spatiotemporal fMRI Brain Decoding

Functional behavior of the brain can be captured using functional Magnetic Resonance Imaging (fMRI). Even though fMRI signals have temporal and spatial structures, most studies have neglected the temporal structure when inferring mental states (brain decoding). This has two main side effects: 1. Degradation in brain decoding performance due to lack of temporal information in the model, 2. Inability to provide temporal interpretability. Few studies have targeted this issue but have had less success due to the burdening challenges related to high feature-to-instance ratio. In this study, a novel model for incorporating temporal information while maintaining a low feature-to-instance ratio, is proposed. Experimental results show the effectiveness of the model compared to recent state of the art approaches.

[1]  Bernard Ng,et al.  Generalized group sparse classifiers with application in fMRI brain decoding , 2011, CVPR 2011.

[2]  Ghassan Hamarneh,et al.  Generalized Sparse Classifiers for Decoding Cognitive States in fMRI , 2010, MLMI.

[3]  P. Sajda,et al.  Spatiotemporal Linear Decoding of Brain State , 2008, IEEE Signal Processing Magazine.

[4]  Jonathan E. Taylor,et al.  Interpretable whole-brain prediction analysis with GraphNet , 2013, NeuroImage.

[5]  Brian Knutson,et al.  Interpretable Classifiers for fMRI Improve Prediction of Purchases , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Kaustubh Supekar,et al.  Sparse logistic regression for whole-brain classification of fMRI data , 2010, NeuroImage.

[7]  Luca Baldassarre,et al.  Structured Sparsity Models for Brain Decoding from fMRI Data , 2012, 2012 Second International Workshop on Pattern Recognition in NeuroImaging.

[8]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[9]  Lars Kai Hansen,et al.  Model sparsity and brain pattern interpretation of classification models in neuroimaging , 2012, Pattern Recognit..

[10]  Lotfi Chaâri,et al.  Fast Joint Detection-Estimation of Evoked Brain Activity in Event-Related fMRI Using a Variational Approach , 2013, IEEE Transactions on Medical Imaging.

[11]  Jean-Baptiste Poline,et al.  Connectivity-informed Sparse Classifiers for fMRI Brain Decoding , 2012, 2012 Second International Workshop on Pattern Recognition in NeuroImaging.

[12]  Bernard Ng,et al.  Modeling Spatiotemporal Structure in fMRI Brain Decoding Using Generalized Sparse Classifiers , 2011, 2011 International Workshop on Pattern Recognition in NeuroImaging.

[13]  Dimitris Samaras,et al.  Exploiting Temporal Information in Functional Magnetic Resonance Imaging Brain Data , 2005, MICCAI.

[14]  Pappas Ioannis,et al.  StarPlus fMRI data , 2015 .

[15]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[16]  J. Gallant,et al.  Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies , 2011, Current Biology.

[17]  A. Ravishankar Rao,et al.  Prediction and interpretation of distributed neural activity with sparse models , 2009, NeuroImage.

[18]  Jianfeng Feng,et al.  Voxel Selection in fMRI Data Analysis Based on Sparse Representation , 2009, IEEE Transactions on Biomedical Engineering.