Second revision : Supplementary Material Linking brain-wide multivoxel activation patterns to behaviour : examples from language and math

A key goal of cognitive neuroscience is to find simple and direct connections between brain and behaviour. However, fMRI analysis typically involves choices between many possible options, with each choice potentially biasing any brain-behaviour correlations that emerge. Standard methods of fMRI analysis assess each voxel individually, but then face the problem of selection bias when combining those voxels into a region-of-interest, or ROI. Multivariate pattern-based fMRI analysis methods use classifiers to analyse multiple voxels together, but can also introduce selection bias via data-reduction steps as feature selection of voxels, pre-selecting activated regions, or principal components analysis. We show here that strong brain-behaviour links can be revealed without any voxel selection or data reduction, using just plain linear regression as a classifier applied to the whole brain at once, i.e. treating each entire brain volume as a single multi-voxel pattern. The brain-behaviour correlations emerged despite the fact that the classifier was not provided with any information at all about subjects' behaviour, but instead was given only the neural data and its condition-labels. Surprisingly, more powerful classifiers such as a linear SVM and regularised logistic regression produce very similar results. We discuss some possible reasons why the very simple brain-wide linear regression model is able to find correlations with behaviour that are as strong as those obtained on the one hand from a specific ROI and on the other hand from more complex classifiers. In a manner which is unencumbered by arbitrary choices, our approach offers a method for investigating connections between brain and behaviour which is simple, rigorous and direct.

[1]  Bruce D. McCandliss,et al.  White matter microstructures underlying mathematical abilities in children , 2008, Neuroreport.

[2]  Daniel Ansari,et al.  Common and segregated neural pathways for the processing of symbolic and nonsymbolic numerical magnitude: An fMRI study , 2010, NeuroImage.

[3]  Janaina Mourão Miranda,et al.  Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes , 2010, NeuroImage.

[4]  D G Gadian,et al.  Calculation difficulties in children of very low birthweight: a neural correlate. , 2001, Brain : a journal of neurology.

[5]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[6]  ROBERT S. MOYER,et al.  Time required for Judgements of Numerical Inequality , 1967, Nature.

[7]  R. Raizada,et al.  Quantifying the adequacy of neural representations for a cross-language phonetic discrimination task: prediction of individual differences. , 2010, Cerebral cortex.

[8]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[9]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[10]  Nitai P Bhattacharyya Huntington’s disease: a monogenic disorder with cellular and biochemical complexities , 2008, The FEBS journal.

[11]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[12]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Stanislas Dehaene,et al.  Arithmetic and the Brain This Review Comes from a Themed Issue on Cognitive Neuroscience Edited the Intraparietal Sulcus and Number Sense Number Sense in the Animal Brain , 2022 .

[14]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[15]  F. J. Anscombe,et al.  Graphs in Statistical Analysis , 1973 .

[16]  Jieping Ye,et al.  An optimization criterion for generalized discriminant analysis on undersampled problems , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[18]  L. K. Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.

[19]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[20]  Stuart G. Baker,et al.  Identifying genes that contribute most to good classification in microarrays , 2006, BMC Bioinformatics.

[21]  Marie-Pascale Noël,et al.  Neural Correlates of Symbolic Number Comparison in Developmental Dyscalculia , 2010, Journal of Cognitive Neuroscience.

[22]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[23]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[24]  Anil K. Jain,et al.  Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[26]  Robert M. Haralick,et al.  Feature normalization and likelihood-based similarity measures for image retrieval , 2001, Pattern Recognit. Lett..

[27]  Gavin R. Price,et al.  Impaired parietal magnitude processing in developmental dyscalculia , 2007, Current Biology.

[28]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[29]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[30]  Lars Kai Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.

[31]  Daniel Ansari,et al.  Mapping numerical magnitudes onto symbols: the numerical distance effect and individual differences in children's mathematics achievement. , 2009, Journal of experimental child psychology.

[32]  R. Tibshirani,et al.  Efficient quadratic regularization for expression arrays. , 2004, Biostatistics.

[33]  H. Pashler,et al.  Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition 1 , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.

[34]  Daniel Ansari,et al.  Developmental Specialization in the Right Intraparietal Sulcus for the Abstract Representation of Numerical Magnitude , 2010, Journal of Cognitive Neuroscience.