Hidden Stages of Cognition Revealed in Patterns of Brain Activation

To advance cognitive theory, researchers must be able to parse the performance of a task into its significant mental stages. In this article, we describe a new method that uses functional MRI brain activation to identify when participants are engaged in different cognitive stages on individual trials. The method combines multivoxel pattern analysis to identify cognitive stages and hidden semi-Markov models to identify their durations. This method, applied to a problem-solving task, identified four distinct stages: encoding, planning, solving, and responding. We examined whether these stages corresponded to their ascribed functions by testing whether they are affected by appropriate factors. Planning-stage duration increased as the method for solving the problem became less obvious, whereas solving-stage duration increased as the number of calculations to produce the answer increased. Responding-stage duration increased with the difficulty of the motor actions required to produce the answer.

[1]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[2]  R W Cox,et al.  Software tools for analysis and visualization of fMRI data , 1997, NMR in biomedicine.

[3]  Aryn Pyke,et al.  Visuospatial referents facilitate the learning and transfer of mathematical operations: Extending the role of the angular gyrus , 2015, Cognitive, affective & behavioral neuroscience.

[4]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[5]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[6]  Saul Sternberg,et al.  The discovery of processing stages: Extensions of Donders' method , 1969 .

[7]  Jian Yang,et al.  Using brain imaging to track problem solving in a complex state space , 2012, NeuroImage.

[8]  John R. Anderson,et al.  Extending problem-solving procedures through reflection , 2014, Cognitive Psychology.

[9]  Shawn Betts,et al.  Tracking children's mental states while solving algebra equations , 2012, Human brain mapping.

[10]  Christa Neuper,et al.  Individual differences in mathematical competence predict parietal brain activation during mental calculation , 2007, NeuroImage.

[11]  John R. Anderson,et al.  Discovering the structure of mathematical problem solving , 2013, NeuroImage.

[12]  G. Glover Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[13]  Tom Michael Mitchell,et al.  A Neurosemantic Theory of Concrete Noun Representation Based on the Underlying Brain Codes , 2010, PloS one.

[14]  Grigori Yourganov,et al.  Comparing within‐subject classification and regularization methods in fMRI for large and small sample sizes , 2014, Human brain mapping.

[15]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[16]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[17]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[18]  Max Coltheart,et al.  How Can Functional Neuroimaging Inform Cognitive Theories? , 2013, Perspectives on psychological science : a journal of the Association for Psychological Science.

[19]  John R Anderson,et al.  Neural imaging to track mental states while using an intelligent tutoring system , 2010, Proceedings of the National Academy of Sciences.

[20]  Andrew R. Mayer,et al.  Neural networks underlying endogenous and exogenous visual–spatial orienting , 2004, NeuroImage.