Using fMRI to Test Models of Complex Cognition

This article investigates the potential of fMRI to test assumptions about different components in models of complex cognitive tasks. If the components of a model can be associated with specific brain regions, one can make predictions for the temporal course of the BOLD response in these regions. An event-locked procedure is described for dealing with temporal variability and bringing model runs and individual data trials into alignment. Statistical methods for testing the model are described that deal with the scan-to-scan correlations in the errors of measurement of the BOLD signal. This approach is illustrated using a "sacrificial" ACT-R model that involves mapping 6 modules onto 6 brain regions in an experiment from Ravizza, Anderson, and Carter (in press) concerned with equation solving. The model's visual encoding predicted the BOLD response in the fusiform gyrus, its controlled retrieval predicted the BOLD response in the lateral inferior prefrontal cortex, and its subgoal setting predicted the BOLD response in the anterior cingulate cortex. On the other hand, its motor programming failed to predict anticipatory activation in the motor cortex, its representational changes failed to predicted the pattern of activity in the posterior parietal cortex, and its procedural component failed to predict an initial spike in caudate. The results illustrate the power of such data to direct the development of a theory of complex problem solving, both at the level of a specific task model as well as at the level of the cognitive architecture.

[1]  R. Henson,et al.  Frontal lobes and human memory: insights from functional neuroimaging. , 2001, Brain : a journal of neurology.

[2]  Karl J. Friston Experimental Design and Statistical Parametric Mapping , 2003 .

[3]  Anthony D Wagner,et al.  Assembling and encoding word representations: fMRI subsequent memory effects implicate a role for phonological control , 2003, Neuropsychologia.

[4]  John R. Anderson,et al.  Endogenous Control and Task Representation: An fMRI Study in Algebraic Problem-solving , 2008, Journal of Cognitive Neuroscience.

[5]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[6]  M. Posner,et al.  Attentional networks , 1994, Trends in Neurosciences.

[7]  R. Davidson,et al.  Consciousness and Self-Regulation: Advances in Research and Theory IV , 1976 .

[8]  E. Wagenmakers A practical solution to the pervasive problems ofp values , 2007, Psychonomic bulletin & review.

[9]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[10]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[11]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[12]  Joshua W. Brown,et al.  Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex , 2005, Science.

[13]  Karl J. Friston Introduction Experimental design and Statistical Parametric Mapping , 2003 .

[14]  David Badre,et al.  Semantic retrieval, mnemonic control, and prefrontal cortex. , 2002, Behavioral and cognitive neuroscience reviews.

[15]  Barbara Tversky,et al.  A Parametric Study of Mental Spatial Transformations of Bodies , 2002, NeuroImage.

[16]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[17]  E. Bullmore,et al.  Statistical methods of estimation and inference for functional MR image analysis , 1996, Magnetic resonance in medicine.

[18]  S. Lehéricy,et al.  Foot, hand, face and eye representation in the human striatum. , 2003, Cerebral cortex.

[19]  Pat Gunn,et al.  A rational account of memory predicts left prefrontal activation during controlled retrieval. , 2008, Cerebral cortex.

[20]  G. Miller,et al.  Cognitive science. , 1981, Science.

[21]  A M Graybiel,et al.  Time-varying covariance of neural activities recorded in striatum and frontal cortex as monkeys perform sequential-saccade tasks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  M. D’Esposito,et al.  The neural basis of the central executive system of working memory , 1995, Nature.

[23]  Erik D. Reichle,et al.  The Neural Bases of Strategy and Skill in Sentence–Picture Verification , 2000, Cognitive Psychology.

[24]  A. Georgopoulos,et al.  Time‐resolved fMRI of mental rotation , 1997, Neuroreport.

[25]  Lila Davachi,et al.  When Keeping in Mind Supports Later Bringing to Mind: Neural Markers of Phonological Rehearsal Predict Subsequent Remembering , 2001, Journal of Cognitive Neuroscience.

[26]  R. Weisskoff,et al.  Effect of temporal autocorrelation due to physiological noise and stimulus paradigm on voxel‐level false‐positive rates in fMRI , 1998, Human brain mapping.

[27]  M. Petrides,et al.  Functional activation of the human brain during mental rotation , 1997, Neuropsychologia.

[28]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[29]  M. Just,et al.  From the Selectedworks of Marcel Adam Just the Organization of Thinking: What Functional Brain Imaging Reveals about the Neuroarchitecture of Complex Cognition , 2022 .

[30]  John R. Anderson,et al.  Using Brain Imaging to Extract the Structure of Complex Events at the Rational Time Band , 2008, Journal of Cognitive Neuroscience.

[31]  Cameron S. Carter,et al.  Separating semantic conflict and response conflict in the Stroop task: A functional MRI study , 2005, NeuroImage.

[32]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[33]  Irene P. Kan,et al.  Effects of Repetition and Competition on Activity in Left Prefrontal Cortex during Word Generation , 1999, Neuron.

[34]  Randi C. Martin,et al.  Selection demands versus association strength in the verb generation task , 2006 .

[35]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[36]  Michael J. Frank,et al.  Interactions between frontal cortex and basal ganglia in working memory: A computational model , 2001, Cognitive, affective & behavioral neuroscience.

[37]  S. Dehaene,et al.  THREE PARIETAL CIRCUITS FOR NUMBER PROCESSING , 2003, Cognitive neuropsychology.

[38]  Susan M. Ravizza,et al.  Errors of mathematical processing: The relationship of accuracy to neural regions associated with retrieval or representation of the problem state , 2008, Brain Research.

[39]  Myeong-Ho Sohn,et al.  An information-processing model of three cortical regions: evidence in episodic memory retrieval , 2005, NeuroImage.

[40]  A. Amos A Computational Model of Information Processing in the Frontal Cortex and Basal Ganglia , 2000, Journal of Cognitive Neuroscience.

[41]  John R. Anderson,et al.  Behavioral equivalence, but not neural equivalence—neural evidence of alternative strategies in mathematical thinking , 2004, Nature Neuroscience.

[42]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[43]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[44]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[45]  S. Petersen,et al.  Frontal cortex contributes to human memory formation , 1999, Nature Neuroscience.

[46]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[47]  Mark D'Esposito,et al.  Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses , 2004, NeuroImage.

[48]  Scott Douglass,et al.  Traveling the Second Bridge: Using fMRI to Assess an ACT-R Model of Geometry Proof , 2008 .

[49]  J. Lange,et al.  A Model of Biological Motion Perception from Configural Form Cues , 2006, The Journal of Neuroscience.

[50]  D. Norman,et al.  Attention to Action: Willed and Automatic Control of Behavior Technical Report No. 8006. , 1980 .

[51]  D. Norman,et al.  Attention to action: Willed and automatic control , 1980 .

[52]  S. Kotz,et al.  Distribution of Sum of Identically Distributed Exponentially Correlated Gamma-Variables , 1964 .

[53]  Abraham Z. Snyder,et al.  A default mode of brain function: A brief history of an evolving idea , 2007, NeuroImage.

[54]  Irene P. Kan,et al.  Verb generation in patients with focal frontal lesions: a neuropsychological test of neuroimaging findings. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[55]  J. Hohnsbein,et al.  Event-related potential correlates of errors in reaction tasks. , 1995, Electroencephalography and clinical neurophysiology. Supplement.

[56]  P. Glimcher,et al.  The neural correlates of subjective value during intertemporal choice , 2007, Nature Neuroscience.

[57]  D. Schacter,et al.  Prefrontal Contributions to Executive Control: fMRI Evidence for Functional Distinctions within Lateral Prefrontal Cortex , 2001, NeuroImage.

[58]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[59]  C. Gerfen,et al.  The frontal cortex-basal ganglia system in primates. , 1996, Critical reviews in neurobiology.

[60]  M. Posner,et al.  Executive attention: Conflict, target detection, and cognitive control. , 1998 .

[61]  Jon M Fincham,et al.  Role of prefrontal and parietal cortices in associative learning. , 2008, Cerebral cortex.

[62]  Michael D. Lee,et al.  Model evaluation and selection: Established methods and recent developments , 2008 .

[63]  M. Botvinick,et al.  Parsing executive processes: strategic vs. evaluative functions of the anterior cingulate cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[64]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[65]  John R. Anderson,et al.  Information-processing modules and their relative modality specificity , 2007, Cognitive Psychology.

[66]  R. Poldrack,et al.  Recovering Meaning Left Prefrontal Cortex Guides Controlled Semantic Retrieval , 2001, Neuron.

[67]  M. Farah,et al.  Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[68]  Marsha C. Lovett,et al.  Neural correlates of arithmetic calculation strategies , 2009, Cognitive, affective & behavioral neuroscience.

[69]  G. Schwartz,et al.  Consciousness and Self-Regulation , 1976 .

[70]  Martin Heil,et al.  The functional significance of ERP effects during mental rotation. , 2002, Psychophysiology.

[71]  M. Delgado,et al.  Dorsal striatum responses to reward and punishment: Effects of valence and magnitude manipulations , 2003, Cognitive, affective & behavioral neuroscience.

[72]  Alan C. Evans,et al.  A General Statistical Analysis for fMRI Data , 2000, NeuroImage.

[73]  Carol A. Seger,et al.  Striatal activation during acquisition of a cognitive skill. , 1999, Neuropsychology.

[74]  M. Just,et al.  Graded Functional Activation in the Visuospatial System with the Amount of Task Demand , 1999, Journal of Cognitive Neuroscience.

[75]  Florin Dolcos,et al.  Similarities and Differences in the Neural Correlates of Episodic Memory Retrieval and Working Memory , 2002, NeuroImage.

[76]  F. Ashby,et al.  The Neuropsychological Bases of Category Learning , 2000 .

[77]  John R. Anderson,et al.  Competition and representation during memory retrieval: Roles of the prefrontal cortex and the posterior parietal cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.