Decoding the Infant Mind: Multichannel Pattern Analysis (MCPA) using fNIRS

The MRI environment restricts the types of populations and tasks that can be studied by cognitive neuroscientists (e.g., young infants, face-to-face communication). FNIRS is a neuroimaging modality that records the same physiological signal as fMRI but without the constraints of MRI, and with better spatial localization than EEG. However, research in the fNIRS community largely lacks the analytic sophistication of analogous fMRI work, restricting the application of this imaging technology. The current paper presents a method of multivariate pattern analysis for fNIRS that allows the authors to decode the infant mind (a key fNIRS population). Specifically, multi-channel pattern analysis (MCPA) employs a correlation-based decoding method where a group model is constructed for all infants except one; both average patterns (i.e., infant-level) and single trial patterns (i.e., trial-level) of activation are decoded. Between subjects decoding is a particularly difficult task, because each infant has their own somewhat idiosyncratic patterns of neural activation. The fact that our method succeeds at across-subject decoding demonstrates the presence of group-level multi-channel regularities across infants. The code for implementing these analyses has been made readily available online to facilitate the quick adoption of this method to advance the methodological tools available to the fNIRS researcher.

[1]  R. Raizada,et al.  Quantifying the adequacy of neural representations for a cross-language phonetic discrimination task: prediction of individual differences. , 2010, Cerebral cortex.

[2]  Rainer Goebel,et al.  "Who" Is Saying "What"? Brain-Based Decoding of Human Voice and Speech , 2008, Science.

[3]  John T. Serences,et al.  Computational advances towards linking BOLD and behavior , 2012, Neuropsychologia.

[4]  Floris P. de Lange,et al.  Prior Expectations Evoke Stimulus Templates in the Primary Visual Cortex , 2014, Journal of Cognitive Neuroscience.

[5]  Jens Steinbrink,et al.  Decoding Vigilance with NIRS , 2014, PloS one.

[6]  D. Boas,et al.  HomER: a review of time-series analysis methods for near-infrared spectroscopy of the brain. , 2009, Applied optics.

[7]  Richard N. Aslin,et al.  Top-down modulation in the infant brain: Learning-induced expectations rapidly affect the sensory cortex at 6 months , 2015, Proceedings of the National Academy of Sciences.

[8]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[9]  Yoko Mano,et al.  Decoding what one likes or dislikes from single-trial fNIRS measurements , 2011, Neuroreport.

[10]  Tanja Schultz,et al.  Continuous Recognition of Affective States by Functional Near Infrared Spectroscopy Signals , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[11]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[12]  A. Blasi,et al.  Illuminating the developing brain: The past, present and future of functional near infrared spectroscopy , 2010, Neuroscience & Biobehavioral Reviews.

[13]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[14]  Tetsuya Shimokawa,et al.  Possibility for Predicting the Evaluation of Product Price in the Prefrontal Cortex : A NIRS Study , 2014 .

[15]  M. Okada,et al.  Novel method to classify hemodynamic response obtained using multi-channel fNIRS measurements into two groups: exploring the combinations of channels , 2014, Front. Hum. Neurosci..

[16]  J. Haynes A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives , 2015, Neuron.

[17]  F. De Filippis,et al.  A Selected Core Microbiome Drives the Early Stages of Three Popular Italian Cheese Manufactures , 2014, PloS one.

[18]  J. Tanaka,et al.  The NimStim set of facial expressions: Judgments from untrained research participants , 2009, Psychiatry Research.

[19]  Robert Oostenveld,et al.  Identifying Object Categories from Event-Related EEG: Toward Decoding of Conceptual Representations , 2010, PloS one.

[20]  Thomas E. Nichols,et al.  Nonparametric Permutation Tests for Functional Neuroimaging , 2003 .

[21]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[22]  Sungho Tak,et al.  Statistical analysis of fNIRS data: A comprehensive review , 2014, NeuroImage.

[23]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[24]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Rajeev D. S. Raizada,et al.  What Makes Different People's Representations Alike: Neural Similarity Space Solves the Problem of Across-subject fMRI Decoding , 2012, Journal of Cognitive Neuroscience.

[26]  Tom Chau,et al.  Decoding subjective preference from single-trial near-infrared spectroscopy signals , 2009, Journal of neural engineering.

[27]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[28]  R. Aslin,et al.  Developmental Cognitive Neuroscience Near-infrared Spectroscopy: a Report from the Mcdonnell Infant Methodology Consortium , 2022 .

[29]  Lauren L Emberson,et al.  Hemodynamic correlates of cognition in human infants. , 2015, Annual review of psychology.

[30]  Declan G. M. Murphy,et al.  Coregistering functional near-infrared spectroscopy with underlying cortical areas in infants , 2014, Neurophotonics.

[31]  Benjamin D. Zinszer,et al.  Representational similarity encoding for fMRI: Pattern-based synthesis to predict brain activity using stimulus-model-similarities , 2016, NeuroImage.

[32]  Ping Li,et al.  Second language experience modulates neural specialization for first language lexical tones , 2015, Journal of Neurolinguistics.

[33]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.