A statistical approach for segregating cognitive task stages from multivariate fMRI BOLD time series

Multivariate pattern analysis can reveal new information from neuroimaging data to illuminate human cognition and its disturbances. Here, we develop a methodological approach, based on multivariate statistical/machine learning and time series analysis, to discern cognitive processing stages from functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) time series. We apply this method to data recorded from a group of healthy adults whilst performing a virtual reality version of the delayed win-shift radial arm maze (RAM) task. This task has been frequently used to study working memory and decision making in rodents. Using linear classifiers and multivariate test statistics in conjunction with time series bootstraps, we show that different cognitive stages of the task, as defined by the experimenter, namely, the encoding/retrieval, choice, reward and delay stages, can be statistically discriminated from the BOLD time series in brain areas relevant for decision making and working memory. Discrimination of these task stages was significantly reduced during poor behavioral performance in dorsolateral prefrontal cortex (DLPFC), but not in the primary visual cortex (V1). Experimenter-defined dissection of time series into class labels based on task structure was confirmed by an unsupervised, bottom-up approach based on Hidden Markov Models. Furthermore, we show that different groupings of recorded time points into cognitive event classes can be used to test hypotheses about the specific cognitive role of a given brain region during task execution. We found that whilst the DLPFC strongly differentiated between task stages associated with different memory loads, but not between different visual-spatial aspects, the reverse was true for V1. Our methodology illustrates how different aspects of cognitive information processing during one and the same task can be separated and attributed to specific brain regions based on information contained in multivariate patterns of voxel activity.

[1]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[2]  P. Roland,et al.  Functional anatomy of reaching and visuomotor learning: a positron emission tomography study. , 1995, Cerebral cortex.

[3]  M. Speekenbrink,et al.  depmixS4: An R Package for Hidden Markov Models , 2010 .

[4]  Stefan Bode,et al.  Decoding sequential stages of task preparation in the human brain , 2009, NeuroImage.

[5]  A. Berthoz,et al.  Mental navigation along memorized routes activates the hippocampus, precuneus, and insula , 1997, Neuroreport.

[6]  N. Jaworska,et al.  A review of fMRI studies during visual emotive processing in major depressive disorder , 2015, The world journal of biological psychiatry : the official journal of the World Federation of Societies of Biological Psychiatry.

[7]  M D'Esposito,et al.  The roles of prefrontal brain regions in components of working memory: effects of memory load and individual differences. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[8]  L. Deserno,et al.  Reduced Prefrontal-Parietal Effective Connectivity and Working Memory Deficits in Schizophrenia , 2012, The Journal of Neuroscience.

[9]  Karl J. Friston,et al.  Modeling regional and psychophysiologic interactions in fMRI: the importance of hemodynamic deconvolution , 2003, NeuroImage.

[10]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[11]  Elizabeth K. Baker,et al.  fMRI Hippocampal Activity During a VirtualRadial Arm Maze , 2005, Applied psychophysiology and biofeedback.

[12]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[13]  Karl J. Friston,et al.  CHAPTER 2 – Statistical parametric mapping , 2007 .

[14]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[15]  Jian Yang,et al.  Using brain imaging to track problem solving in a complex state space , 2012, NeuroImage.

[16]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Daniel Durstewitz,et al.  Amphetamine Exerts Dose-Dependent Changes in Prefrontal Cortex Attractor Dynamics during Working Memory , 2015, The Journal of Neuroscience.

[18]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[19]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[20]  A. Meyer-Lindenberg,et al.  Regionally specific disturbance of dorsolateral prefrontal-hippocampal functional connectivity in schizophrenia. , 2005, Archives of general psychiatry.

[21]  Daniel Durstewitz,et al.  Attracting Dynamics of Frontal Cortex Ensembles during Memory-Guided Decision-Making , 2011, PLoS Comput. Biol..

[22]  Nina Kraus,et al.  Relating Structure to Function: Heschl's Gyrus and Acoustic Processing , 2009, The Journal of Neuroscience.

[23]  Daniel Durstewitz,et al.  Successful choice behavior is associated with distinct and coherent network states in anterior cingulate cortex , 2008, Proceedings of the National Academy of Sciences.

[24]  M. Brass,et al.  Unconscious determinants of free decisions in the human brain , 2008, Nature Neuroscience.

[25]  John R. Anderson,et al.  Discovering the structure of mathematical problem solving , 2013, NeuroImage.

[26]  Michael E. Hasselmo,et al.  A Model of Prefrontal Cortical Mechanisms for Goal-directed Behavior , 2005, Journal of Cognitive Neuroscience.

[27]  Ruben C. Gur,et al.  PAGES_DCNS 46_5.qxd:DCNS#45 , 2010 .

[28]  Joseph A Maldjian,et al.  Precentral gyrus discrepancy in electronic versions of the Talairach atlas , 2004, NeuroImage.

[29]  S. Cichon,et al.  Neural Mechanisms of a Genome-Wide Supported Psychosis Variant , 2009, Science.

[30]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[31]  B. Postle,et al.  Functional neuroanatomical double dissociation of mnemonic and executive control processes contributing to working memory performance. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Andreas Meyer-Lindenberg,et al.  From maps to mechanisms through neuroimaging of schizophrenia , 2010, Nature.

[33]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[34]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[35]  E. Kandel,et al.  What is remembered? Role of attention on the encoding and retrieval of hippocampal representations , 2009, The Journal of physiology.

[36]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[37]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[38]  N. Logothetis,et al.  Neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging , 2004 .

[39]  S. J. Martin,et al.  The rodent hippocampus and spatial memory: from synapses to systems , 2007, Cellular and Molecular Life Sciences.

[40]  Richard F. Haase,et al.  Multivariate General Linear Models , 2011 .

[41]  B. Postle,et al.  Prefrontal cortical contributions to working memory: evidence from event-related fMRI studies , 2000, Experimental Brain Research.

[42]  Bradley R Postle,et al.  The dependence of span and delayed-response performance on prefrontal cortex , 1999, Neuropsychologia.

[43]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[44]  Nikolaus Kriegeskorte,et al.  Pattern-information analysis: From stimulus decoding to computational-model testing , 2011, NeuroImage.

[45]  Justin A. Harris,et al.  Transient Storage of a Tactile Memory Trace in Primary Somatosensory Cortex , 2002, The Journal of Neuroscience.

[46]  J. Haynes.  Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[47]  J. O'Doherty,et al.  Decoding the neural substrates of reward-related decision making with functional MRI , 2007, Proceedings of the National Academy of Sciences.

[48]  I. Hickie,et al.  A systematic review of resting-state functional-MRI studies in major depression. , 2012, Journal of affective disorders.

[49]  B. Balleine,et al.  The Role of the Dorsal Striatum in Reward and Decision-Making , 2007, The Journal of Neuroscience.

[50]  Paul J. Laurienti,et al.  An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets , 2003, NeuroImage.

[51]  Jakob Heinzle,et al.  Decoding different roles for vmPFC and dlPFC in multi-attribute decision making , 2011, NeuroImage.

[52]  E. Forbes.  fMRI Studies of Reward Processing in Adolescent Depression , 2011, Neuropsychopharmacology.

[53]  N. Logothetis.  The neural basis of the blood-oxygen-level-dependent functional magnetic resonance imaging signal. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[54]  J. Seamans,et al.  Selective Roles for Hippocampal, Prefrontal Cortical, and Ventral Striatal Circuits in Radial-Arm Maze Tasks With or Without a Delay , 1997, The Journal of Neuroscience.

[55]  N. Logothetis.  What we can do and what we cannot do with fMRI , 2008, Nature.

[56]  Hiroshi Handa,et al.  A Neural Correlate of Working Memory in the Monkey Primary Visual Cortex , 2017 .

[57]  A. Meyer-Lindenberg,et al.  Intermediate phenotypes and genetic mechanisms of psychiatric disorders , 2006, Nature Reviews Neuroscience.

[58]  James R. Schott,et al.  Principles of Multivariate Analysis: A User's Perspective , 2002 .

[59]  Gary W. Giumetti,et al.  Spatial pattern learning in the radial arm maze , 2006, Learning & behavior.

[60]  Justin A. Harris,et al.  The Topography of Tactile Working Memory , 2001, Journal of Neuroscience.

[61]  M. Corbetta,et al.  Functional Organization of Human Intraparietal and Frontal Cortex for Attending, Looking, and Pointing , 2003, The Journal of Neuroscience.

[62]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[63]  O. Sporns,et al.  Rich-Club Organization of the Human Connectome , 2011, The Journal of Neuroscience.

[64]  Mark D'Esposito,et al.  From cognitive to neural models of working memory , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[65]  J. Bullier.  Integrated model of visual processing , 2001, Brain Research Reviews.

[66]  Soyoung Q. Park,et al.  Decoding the Formation of Reward Predictions across Learning , 2011, The Journal of Neuroscience.

[67]  D. Olton,et al.  Animal Behavior Processes , 2022 .

[68]  M. Mintun,et al.  Resting-state functional MRI in depression unmasks increased connectivity between networks via the dorsal nexus , 2010, Proceedings of the National Academy of Sciences.

[69]  D. A. Riley,et al.  Flexible memory processing by rats: use of prospective and retrospective information in the radial maze. , 1985, Journal of experimental psychology. Animal behavior processes.

[70]  Daniel Durstewitz,et al.  Hippocampal–Dorsolateral Prefrontal Coupling as a Species-Conserved Cognitive Mechanism: A Human Translational Imaging Study , 2015, Neuropsychopharmacology.

[71]  A. Oliverio,et al.  A study on the role of the dorsal striatum and the nucleus accumbens in allocentric and egocentric spatial memory consolidation. , 2005, Learning & memory.