An empirical solution for over-pruning with a novel ensemble-learning method for fMRI decoding

BACKGROUND Recent functional magnetic resonance imaging (fMRI) decoding techniques allow us to predict the contents of sensory and motor events or participants' mental states from multi-voxel patterns of fMRI signals. Sparse logistic regression (SLR) is a useful pattern classification algorithm that has the advantage of being able to automatically select voxels to avoid over-fitting. However, SLR suffers from over-pruning, in which many voxels that are potentially useful for prediction are discarded. NEW METHOD We propose an ensemble solution for over-pruning, called "Iterative Recycling" (iRec), in which sparse classifiers are trained iteratively by recycling over-pruned voxels. RESULTS Our simulation demonstrates that iRec can effectively rectify over-pruning in SLR and improve its classification accuracy. We also conduct an fMRI experiment in which eight healthy volunteers perform a finger-tapping task with their index or middle fingers. The results indicate that SLR with iRec (iSLR) can predict the finger used more accurately than SLR. Further, iSLR is able to identify a voxel cluster representing the finger movements in the biologically plausible contralateral primary sensory-motor cortices in each participant. We also successfully dissociated the regularly arranged representation for each finger in the cluster. CONCLUSION AND COMPARISON WITH OTHER METHODS To the best of our knowledge, ours is the first study to propose a solution for over-pruning with ensemble-learning that is applicable to any sparse algorithm. In addition, from the viewpoint of machine learning, we provide the novel idea of using the sparse classification algorithm to generate accurate divergent base classifiers.

[1]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[2]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[3]  W. Penfield,et al.  SOMATIC MOTOR AND SENSORY REPRESENTATION IN THE CEREBRAL CORTEX OF MAN AS STUDIED BY ELECTRICAL STIMULATION , 1937 .

[4]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[5]  Jens Frahm,et al.  Functional somatotopy of finger representations in human primary motor cortex , 2003, Human brain mapping.

[6]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[7]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[8]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[9]  Bernard Ng,et al.  Modeling Spatiotemporal Structure in fMRI Brain Decoding Using Generalized Sparse Classifiers , 2011, 2011 International Workshop on Pattern Recognition in NeuroImaging.

[10]  Haibo He,et al.  Adaptive Iterative Learning for Classification based on Feature Selection and Combination Voting , 2007, 2007 International Joint Conference on Neural Networks.

[11]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Kaustubh Supekar,et al.  Sparse logistic regression for whole-brain classification of fMRI data , 2010, NeuroImage.

[13]  Gaël Varoquaux,et al.  Total Variation Regularization for fMRI-Based Prediction of Behavior , 2011, IEEE Transactions on Medical Imaging.

[14]  Alan C. Evans,et al.  A general statistical analysis for fMRI data , 2000, NeuroImage.

[15]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[16]  Mannes Poel,et al.  Online decoding of object‐based attention using real‐time fMRI , 2014, The European journal of neuroscience.

[17]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[18]  Rainer Goebel,et al.  Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns , 2008, NeuroImage.

[19]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[20]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[21]  Giancarlo Valente,et al.  Multivariate analysis of fMRI time series: classification and regression of brain responses using machine learning. , 2008, Magnetic resonance imaging.

[22]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[23]  Ghassan Hamarneh,et al.  Generalized Sparse Classifiers for Decoding Cognitive States in fMRI , 2010, MLMI.

[24]  Kagan Tumer,et al.  Error Correlation and Error Reduction in Ensemble Classifiers , 1996, Connect. Sci..

[25]  S. Resnick,et al.  Alzheimer's Disease Risk Assessment Using Large-Scale Machine Learning Methods , 2013, PloS one.

[26]  M. D’Esposito,et al.  The Variability of Human, BOLD Hemodynamic Responses , 1998, NeuroImage.

[27]  Robert A. Jacobs,et al.  Methods For Combining Experts' Probability Assessments , 1995, Neural Computation.

[28]  Jonathan E. Taylor,et al.  Interpretable whole-brain prediction analysis with GraphNet , 2013, NeuroImage.

[29]  Kagan Tumer,et al.  Classifier Combining: Analytical Results and Implications , 1995 .

[30]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.