Theoretical, Statistical, and Practical Perspectives on Pattern-based Classification Approaches to the Analysis of Functional Neuroimaging Data

The goal of pattern-based classification of functional neuroimaging data is to link individual brain activation patterns to the experimental conditions experienced during the scans. These brain-reading analyses advance functional neuroimaging on three fronts. From a technical standpoint, pattern-based classifiers overcome fatal f laws in the status quo inferential and exploratory multivariate approaches by combining pattern-based analyses with a direct link to experimental variables. In theoretical terms, the results that emerge from pattern-based classifiers can offer insight into the nature of neural representations. This shifts the emphasis in functional neuroimaging studies away from localizing brain activity toward understanding how patterns of brain activity encode information. From a practical point of view, pattern-based classifiers are already well established and understood in many areas of cognitive science. These tools are familiar to many researchers and provide a quantitatively sound and qualitatively satisfying answer to most questions addressed in functional neuroimaging studies. Here, we examine the theoretical, statistical, and practical underpinnings of pattern-based classification approaches to functional neuroimaging analyses. Pattern-based classification analyses are well positioned to become the standard approach to analyzing functional neuroimaging data.

[1]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[2]  Leslie G. Ungerleider,et al.  Distributed representation of objects in the human ventral visual pathway. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[3]  H. Abdi Multivariate Analysis , 1972 .

[4]  G. Rees,et al.  Predicting the Stream of Consciousness from Activity in Human Visual Cortex , 2005, Current Biology.

[5]  Stefan Pollmann,et al.  PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI Data , 2009, Neuroinformatics.

[6]  S. Edelman,et al.  Toward direct visualization of the internal shape representation space by fMRI , 1998, Psychobiology.

[7]  C. Carter,et al.  Optimizing the Design and Analysis of Clinical Functional Magnetic Resonance Imaging Research Studies , 2008, Biological Psychiatry.

[8]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[9]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[10]  M. Young,et al.  Sparse population coding of faces in the inferotemporal cortex. , 1992, Science.

[11]  Jacob Cohen The earth is round (p < .05) , 1994 .

[12]  Dinggang Shen,et al.  Classifying spatial patterns of brain activity with machine learning methods: Application to lie detection , 2005, NeuroImage.

[13]  Tom M. Mitchell,et al.  Learning to Decode Cognitive States from Brain Images , 2004, Machine Learning.

[14]  H. Barlow,et al.  Single Units and Sensation: A Neuron Doctrine for Perceptual Psychology? , 1972, Perception.

[15]  Karl J. Friston Modes or models: a critique on independent component analysis for fMRI , 1998, Trends in Cognitive Sciences.

[16]  J. Kippenhan,et al.  Evaluation of a neural-network classifier for PET scans of normal and Alzheimer's disease subjects. , 1992, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[17]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[18]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[19]  Alison J. Wiggett,et al.  Patterns of fMRI Activity Dissociate Overlapping Functional Brain Areas that Respond to Biological Motion , 2006, Neuron.

[20]  Gregory A. Miller,et al.  Classification of functional brain images with a spatio-temporal dissimilarity map , 2006, NeuroImage.

[21]  Lars Kai Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.

[22]  Thomas E. Nichols,et al.  Statistical limitations in functional neuroimaging. II. Signal detection and statistical inference. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  Anthony Randal McIntosh,et al.  Partial least squares analysis of neuroimaging data: applications and advances , 2004, NeuroImage.

[24]  David G. Stork,et al.  Pattern Classification , 1973 .

[25]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[26]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[27]  Alice J. O'Toole,et al.  Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[28]  R. Poldrack The role of fMRI in Cognitive Neuroscience: where do we stand? , 2008, Current Opinion in Neurobiology.

[29]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[30]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[31]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.

[32]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[33]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[34]  Rebecca F. Schwarzlose,et al.  Separate Face and Body Selectivity on the Fusiform Gyrus , 2005, The Journal of Neuroscience.

[35]  Trevor F. Cox,et al.  Metric multidimensional scaling , 2000 .

[36]  P. Anderson More is different. , 1972, Science.

[37]  G. Rees The new phrenology: the limits of localizing cognitive processes in the brain , 2002 .

[38]  J R Moeller,et al.  A Regional Covariance Approach to the Analysis of Functional Patterns in Positron Emission Tomographic Data , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[39]  K. Grill-Spector,et al.  High-resolution imaging reveals highly selective nonface clusters in the fusiform face area , 2006, Nature Neuroscience.

[40]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[41]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[42]  Alice J. O'Toole,et al.  DISTATIS: The Analysis of Multiple Distance Matrices , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[43]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[44]  Essa Yacoub,et al.  The Evaluation of Preprocessing Choices in Single-Subject BOLD fMRI Using NPAIRS Performance Metrics , 2003, NeuroImage.

[45]  Janaina Mourão Miranda,et al.  Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data , 2005, NeuroImage.

[46]  Jean-Baptiste Poline,et al.  Group analysis in functional neuroimaging: selecting subjects using similarity measures , 2003, NeuroImage.

[47]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[48]  Luiz Pessoa,et al.  Quantitative prediction of perceptual decisions during near-threshold fear detection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[49]  P. Pietrini,et al.  Early Detection of Alzheimer's Disease: A Statistical Approach Using Positron Emission Tomographic Data , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[50]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[51]  A. McIntosh,et al.  Spatiotemporal analysis of experimental differences in event-related potential data with partial least squares. , 2001, Psychophysiology.

[52]  J. V. Haxby,et al.  Spatial Pattern Analysis of Functional Brain Images Using Partial Least Squares , 1996, NeuroImage.

[53]  Neil Salkind Encyclopedia of Measurement and Statistics , 2006 .

[54]  Stephen José Hanson,et al.  Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area? , 2004, NeuroImage.

[55]  J. Obleser,et al.  Pre-lexical abstraction of speech in the auditory cortex , 2009, Trends in Cognitive Sciences.

[56]  M. Hayden,et al.  The FDG/PET Methodology for Early Detection of Disease Onset: A Statistical Model , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[57]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[58]  L. K. Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.

[59]  R. Savoy Functional Magnetic Resonance Imaging (fMRI) , 2002 .