Using Data-Driven Model-Brain Mappings to Constrain Formal Models of Cognition

In this paper we propose a method to create data-driven mappings from components of cognitive models to brain regions. Cognitive models are notoriously hard to evaluate, especially based on behavioral measures alone. Neuroimaging data can provide additional constraints, but this requires a mapping from model components to brain regions. Although such mappings can be based on the experience of the modeler or on a reading of the literature, a formal method is preferred to prevent researcher-based biases. In this paper we used model-based fMRI analysis to create a data-driven model-brain mapping for five modules of the ACT-R cognitive architecture. We then validated this mapping by applying it to two new datasets with associated models. The new mapping was at least as powerful as an existing mapping that was based on the literature, and indicated where the models were supported by the data and where they have to be improved. We conclude that data-driven model-brain mappings can provide strong constraints on cognitive models, and that model-based fMRI is a suitable way to create such mappings.

[1]  Jelmer P Borst,et al.  Avoiding the problem state bottleneck by strategic use of the environment. , 2013, Acta psychologica.

[2]  Justin L. Vincent,et al.  Distinct brain networks for adaptive and stable task control in humans , 2007, Proceedings of the National Academy of Sciences.

[3]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[4]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[5]  John R. Anderson,et al.  Using model-based functional MRI to locate working memory updates and declarative memory retrievals in the fronto-parietal network , 2013, Proceedings of the National Academy of Sciences.

[6]  John P O'Doherty,et al.  Model-based approaches to neuroimaging: combining reinforcement learning theory with fMRI data. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[7]  Yvonne Koch.  The Psychology Of Learning And Motivation , 2016 .

[8]  Shawn Betts,et al.  Cognitive and Metacognitive Activity in Mathematical Problem Solving: Prefrontal and Parietal Patterns It Also Appears to Play a Key Role in Retrieval of Arithmetic , 2022 .

[9]  Niels Taatgen,et al.  The Multitasking Mind , 2010, Oxford series on cognitive models and architectures.

[10]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[11]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[12]  Niels Taatgen,et al.  Predicting interference in concurrent multitasking , 2013 .

[13]  Ryen W. White,et al.  No clicks, no problem: using cursor movements to understand and improve search , 2011, CHI.

[14]  Dario D. Salvucci,et al.  Threaded cognition: an integrated theory of concurrent multitasking. , 2008, Psychological review.

[15]  Andrea Stocco,et al.  The Neural Correlates of Problem States: Testing fMRI Predictions of a Computational Model of Multitasking , 2010, PloS one.

[16]  N. Taatgen,et al.  The problem state: a cognitive bottleneck in multitasking. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[17]  Myeong-Ho Sohn,et al.  An information-processing model of three cortical regions: evidence in episodic memory retrieval , 2005, NeuroImage.

[18]  John R. Anderson,et al.  Constraints in Cognitive Architectures , 2008 .

[19]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[20]  J. Binder,et al.  Functional magnetic resonance imaging of human auditory cortex , 1994, Annals of neurology.

[21]  Leslie G. Ungerleider,et al.  Dissociation of object and spatial visual processing pathways in human extrastriate cortex. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[22]  J. Rieskamp,et al.  Deciding When to Decide: Time-Variant Sequential Sampling Models Explain the Emergence of Value-Based Decisions in the Human Brain , 2012, The Journal of Neuroscience.

[23]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[24]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[25]  John R. Anderson,et al.  Using fMRI to Test Models of Complex Cognition , 2008, Cogn. Sci..

[26]  Menno Nijboer,et al.  Decision Making in Concurrent Multitasking: Do People Adapt to Task Interference? , 2013, PloS one.

[27]  J. O'Doherty,et al.  Model‐Based fMRI and Its Application to Reward Learning and Decision Making , 2007, Annals of the New York Academy of Sciences.

[28]  John R. Anderson,et al.  What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing , 2001, CHI Extended Abstracts.

[29]  S. Lewandowsky,et al.  Forgetting in immediate serial recall: decay, temporal distinctiveness, or interference? , 2008, Psychological review.

[30]  Shawn Betts,et al.  Brain Networks Supporting Execution of Mathematical Skills versus Acquisition of New Mathematical Competence , 2012, PloS one.

[31]  John R. Anderson,et al.  Competition and representation during memory retrieval: Roles of the prefrontal cortex and the posterior parietal cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Walter Schneider,et al.  The cognitive control network: Integrated cortical regions with dissociable functions , 2007, NeuroImage.

[33]  Niels Taatgen,et al.  Single-task fMRI overlap predicts concurrent multitasking interference , 2014, NeuroImage.

[34]  John R Anderson,et al.  Predicting the practice effects on the blood oxygenation level-dependent (BOLD) function of fMRI in a symbolic manipulation task , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[35]  S. Hillyard,et al.  Involvement of striate and extrastriate visual cortical areas in spatial attention , 1999, Nature Neuroscience.

[36]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[37]  Klaus Wunderlich,et al.  Neural computations underlying action-based decision making in the human brain , 2009, Proceedings of the National Academy of Sciences.

[38]  L. Tucker.  A METHOD FOR SYNTHESIS OF FACTOR ANALYSIS STUDIES , 1951 .

[39]  John R. Anderson,et al.  Serial modules in parallel: the psychological refractory period and perfect time-sharing. , 2001, Psychological review.

[40]  P. Dayan,et al.  Model-based influences on humans’ choices and striatal prediction errors , 2011, Neuron.

[41]  Birte U. Forstmann,et al.  Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract? , 2011, Trends in Cognitive Sciences.

[42]  Dario D. Salvucci.  The 2011 Benjamin Franklin Medal in computer and cognitive science presented to John R. Anderson , 2014, J. Frankl. Inst..

[43]  J. O'Doherty,et al.  The Role of the Ventromedial Prefrontal Cortex in Abstract State-Based Inference during Decision Making in Humans , 2006, The Journal of Neuroscience.

[44]  John R. Anderson,et al.  Endogenous Control and Task Representation: An fMRI Study in Algebraic Problem-solving , 2008, Journal of Cognitive Neuroscience.

[45]  B. Love,et al.  Learning the exception to the rule: model-based FMRI reveals specialized representations for surprising category members. , 2012, Cerebral cortex.

[46]  John R. Anderson,et al.  A step-by-step tutorial on using the cognitive architecture ACT-R in combination with fMRI data , 2017 .

[47]  Marieke K. van Vugt,et al.  Cognitive architectures as a tool for investigating the role of oscillatory power and coherence in cognition , 2014, NeuroImage.

[48]  M. Just,et al.  From the Selectedworks of Marcel Adam Just the Organization of Thinking: What Functional Brain Imaging Reveals about the Neuroarchitecture of Complex Cognition , 2022 .

[49]  John R. Anderson,et al.  Discovering the Sequential Structure of Thought , 2014, Cogn. Sci..

[50]  J. Berge,et al.  Tucker's congruence coefficient as a meaningful index of factor similarity. , 2006 .

[51]  Jon M Fincham,et al.  Role of prefrontal and parietal cortices in associative learning. , 2008, Cerebral cortex.

[52]  John R. Anderson,et al.  A central circuit of the mind , 2008, Trends in Cognitive Sciences.

[53]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[54]  Scott D. Brown,et al.  Neural Correlates of Trial-to-Trial Fluctuations in Response Caution , 2011, The Journal of Neuroscience.

[55]  Michael D. Lee,et al.  A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods , 2008, Cogn. Sci..

[56]  Hedderik van Rijn,et al.  Validating Models of Complex, Real-Life Tasks Using fMRI , 2013 .

[57]  Caitlin Tenison,et al.  Detecting math problem solving strategies: An investigation into the use of retrospective self-reports, latency and fMRI data , 2014, Neuropsychologia.

[58]  I. J. Myung,et al.  Toward a method of selecting among computational models of cognition. , 2002, Psychological review.

[59]  Florin Dolcos,et al.  Attention-related activity during episodic memory retrieval: a cross-function fMRI study , 2003, Neuropsychologia.

[60]  Joseph Lee Rodgers,et al.  Theory development should begin (but not end) with good empirical fits: a comment on Roberts and Pashler (2000). , 2002, Psychological review.

[61]  Niels Taatgen,et al.  Using a symbolic process model as input for model-based fMRI analysis: Locating the neural correlates of problem state replacements , 2011, NeuroImage.

[62]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[63]  C. Lebiere,et al.  The Newell Test for a theory of cognition , 2003, Behavioral and Brain Sciences.

[64]  G. Glover.  Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[65]  Justin L. Vincent,et al.  Evidence for a frontoparietal control system revealed by intrinsic functional connectivity. , 2008, Journal of neurophysiology.

[66]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[67]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[68]  Daniel L. Schacter,et al.  Default network activity, coupled with the frontoparietal control network, supports goal-directed cognition , 2010, NeuroImage.

[69]  John R. Anderson,et al.  Using Brain Imaging to Extract the Structure of Complex Events at the Rational Time Band , 2008, Journal of Cognitive Neuroscience.

[70]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[71]  John P. Spencer,et al.  Autonomy in Action: Linking the Act of Looking to Memory Formation in Infancy via Dynamic Neural Fields , 2013, Cogn. Sci..

[72]  John R. Anderson,et al.  Information-processing modules and their relative modality specificity , 2007, Cognitive Psychology.

[73]  John R. Anderson,et al.  An information-processing model of the BOLD response in symbol manipulation tasks , 2003, Psychonomic bulletin & review.

[74]  Mark S. Cohen,et al.  Parametric Analysis of fMRI Data Using Linear Systems Methods , 1997, NeuroImage.

[75]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .