Decoding Semi-Constrained Brain Activity from fMRI Using Support Vector Machines and Gaussian Processes

Predicting a particular cognitive state from a specific pattern of fMRI voxel values is still a methodological challenge. Decoding brain activity is usually performed in highly controlled experimental paradigms characterized by a series of distinct states induced by a temporally constrained experimental design. In more realistic conditions, the number, sequence and duration of mental states are unpredictably generated by the individual, resulting in complex and imbalanced fMRI data sets. This study tests the classification of brain activity, acquired on 16 volunteers using fMRI, during mental imagery, a condition in which the number and duration of mental events were not externally imposed but self-generated. To deal with these issues, two classification techniques were considered (Support Vector Machines, SVM, and Gaussian Processes, GP), as well as different feature extraction methods (General Linear Model, GLM and SVM). These techniques were combined in order to identify the procedures leading to the highest accuracy measures. Our results showed that 12 data sets out of 16 could be significantly modeled by either SVM or GP. Model accuracies tended to be related to the degree of imbalance between classes and to task performance of the volunteers. We also conclude that the GP technique tends to be more robust than SVM to model unbalanced data sets.

[1]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[2]  Janaina Mourão Miranda,et al.  The impact of temporal compression and space selection on SVM analysis of single-subject and multi-subject fMRI data , 2006, NeuroImage.

[3]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[4]  Robert Turner,et al.  Image Distortion Correction in fMRI: A Quantitative Evaluation , 2002, NeuroImage.

[5]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[6]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[7]  Rainer Goebel,et al.  Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns , 2008, NeuroImage.

[8]  R. Chervin Epworth sleepiness scale? , 2003, Sleep medicine.

[9]  Nick C Fox,et al.  Automatic classification of MR scans in Alzheimer's disease. , 2008, Brain : a journal of neurology.

[10]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[11]  R A Steer,et al.  Further Evidence for the Construct Validity of the Beck Depression Inventory-II with Psychiatric Outpatients , 1997, Psychological reports.

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[14]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[15]  A. Beck,et al.  An inventory for measuring clinical anxiety: psychometric properties. , 1988, Journal of consulting and clinical psychology.

[16]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[17]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[18]  J. Horne,et al.  A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms. , 1976, International journal of chronobiology.

[19]  D. Hassabis,et al.  Decoding Individual Episodic Memory Traces in the Human Hippocampus , 2010, Current Biology.

[20]  Vaidehi S. Natu,et al.  Category-Specific Cortical Activity Precedes Retrieval During Memory Search , 2005, Science.

[21]  Giancarlo Valente,et al.  Multivariate analysis of fMRI time series: classification and regression of brain responses using machine learning. , 2008, Magnetic resonance imaging.

[22]  M. Johns,et al.  A new method for measuring daytime sleepiness: the Epworth sleepiness scale. , 1991, Sleep.

[23]  R Turner,et al.  Optimisation of the 3D MDEFT sequence for anatomical brain imaging: technical implications at 1.5 and 3 T , 2004, NeuroImage.

[24]  M. Koganezawa,et al.  The Shaping of Male Courtship Posture by Lateralized Gustatory Inputs to Male-Specific Interneurons , 2010, Current Biology.

[25]  Tom Michael Mitchell,et al.  From the SelectedWorks of Marcel Adam Just 2008 Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings , 2016 .

[26]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[27]  D. Hassabis,et al.  Decoding Neuronal Ensembles in the Human Hippocampus , 2009, Current Biology.

[28]  Kate Smith-Miles,et al.  On learning algorithm selection for classification , 2006, Appl. Soft Comput..

[29]  Daniel J Buysse,et al.  The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research , 1989, Psychiatry Research.

[30]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[31]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[32]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[33]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[34]  Janaina Mourão Miranda,et al.  Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes , 2010, NeuroImage.