Uncovering the Sequential Structure of Thought

Multi-voxel pattern recognition techniques combined with Hidden Markov models can be used to discover the mental states that people go through in performing a task. The combined method identifies both the mental states and how their durations vary with experimental conditions. The paper applies this method to a task where participants solve novel mathematical problems. It identifies four states in the solution of these problems: Encoding, Planning, Solving, and Respond. The duration of the planning state varies on a trial-to-trial basis with novelty of the problem. The duration of solution stage similarly varies with the amount of computation needed to produce a solution once a plan is devised. The response stage similarly varies with the complexity of the answer produced. Thus, we were able to decompose the overall problem solving time into estimates of its components and interpret what participants are doing on individual problem-solving trials.

[1]  Shawn Betts,et al.  Cognitive and Metacognitive Activity in Mathematical Problem Solving: Prefrontal and Parietal Patterns It Also Appears to Play a Key Role in Retrieval of Arithmetic , 2022 .

[2]  John R Anderson,et al.  Neural imaging to track mental states while using an intelligent tutoring system , 2010, Proceedings of the National Academy of Sciences.

[3]  John R. Anderson,et al.  Tracking problem solving by multivariate pattern analysis and Hidden Markov Model algorithms , 2012, Neuropsychologia.

[4]  Bertrand Thirion,et al.  Deciphering Cortical Number Coding from Human Brain Activity Patterns , 2009, Current Biology.

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  John R. Anderson,et al.  The acquisition of robust and flexible cognitive skills. , 2008, Journal of experimental psychology. General.

[7]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[8]  G. Glover.  Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[9]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[10]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[11]  R W Cox,et al.  Software tools for analysis and visualization of fMRI data , 1997, NMR in biomedicine.

[12]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[13]  J. Ghosh,et al.  Approximations and consistency of Bayes factors as model dimension grows , 2003 .

[14]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[15]  S. Petersen,et al.  The maturing architecture of the brain's default network , 2008, Proceedings of the National Academy of Sciences.

[16]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[17]  L. J. P. van der Maaten,et al.  An Introduction to Dimensionality Reduction Using Matlab , 2007 .

[18]  Shawn Betts,et al.  Brain Networks Supporting Execution of Mathematical Skills versus Acquisition of New Mathematical Competence , 2012, PloS one.

[19]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[20]  Tom Michael Mitchell,et al.  A Neurosemantic Theory of Concrete Noun Representation Based on the Underlying Brain Codes , 2010, PloS one.

[21]  Abraham Z. Snyder,et al.  A default mode of brain function: A brief history of an evolving idea , 2007, NeuroImage.

[22]  H. Kobayashi,et al.  An efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2003, IEEE Signal Processing Letters.

[23]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[24]  K. A. Ericsson,et al.  Protocol Analysis and Expert Thought: Concurrent Verbalizations of Thinking during Experts' Performance on Representative Tasks , 2006 .

[25]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[26]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[27]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[28]  Shunzheng Yu,et al.  Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2006, IEEE Transactions on Signal Processing.

[29]  Richard H. Jones,et al.  Bayesian information criterion for longitudinal and clustered data , 2011, Statistics in medicine.

[30]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[31]  Marsha C. Lovett,et al.  Neural correlates of arithmetic calculation strategies , 2009, Cognitive, affective & behavioral neuroscience.

[32]  John R. Anderson,et al.  Using fMRI to Test Models of Complex Cognition , 2008, Cogn. Sci..