Uncovering the Sequential Structure of Thought 1. Introduction: Using Neural Imaging to Uncover Problem-solving States

Multi-voxel pattern recognition techniques combined with Hidden Markov models can be used to discover the mental states that people go through in performing a task. The combined method identifies both the mental states and how their durations vary with experimental conditions. The paper applies this method to a task where participants solve novel mathematical problems. It identifies four states in the solution of these problems: Encoding, Planning, Solving, and Respond. The duration of the planning state varies on a trial-to-trial basis with novelty of the problem. The duration of solution stage similarly varies with the amount of computation needed to produce a solution once a plan is devised. The response stage similarly varies with the complexity of the answer produced. Thus, we were able to decompose the overall problem solving time into estimates of its components and interpret what participants are doing on individual problem-solving trials.

[1]  Shawn Betts,et al.  Brain Networks Supporting Execution of Mathematical Skills versus Acquisition of New Mathematical Competence , 2012, PloS one.

[2]  Shawn Betts,et al.  Tracking children's mental states while solving algebra equations , 2012, Human brain mapping.

[3]  John R. Anderson,et al.  Tracking problem solving by multivariate pattern analysis and Hidden Markov Model algorithms , 2012, Neuropsychologia.

[4]  Richard H. Jones,et al.  Bayesian information criterion for longitudinal and clustered data , 2011, Statistics in medicine.

[5]  Shawn Betts,et al.  Cognitive and Metacognitive Activity in Mathematical Problem Solving: Prefrontal and Parietal Patterns It Also Appears to Play a Key Role in Retrieval of Arithmetic , 2022 .

[6]  John R Anderson,et al.  Neural imaging to track mental states while using an intelligent tutoring system , 2010, Proceedings of the National Academy of Sciences.

[7]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[8]  Tom Michael Mitchell,et al.  A Neurosemantic Theory of Concrete Noun Representation Based on the Underlying Brain Codes , 2010, PloS one.

[9]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[10]  Bertrand Thirion,et al.  Deciphering Cortical Number Coding from Human Brain Activity Patterns , 2009, Current Biology.

[11]  Marsha C. Lovett,et al.  Neural correlates of arithmetic calculation strategies , 2009, Cognitive, affective & behavioral neuroscience.

[12]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[13]  John R. Anderson,et al.  Using fMRI to Test Models of Complex Cognition , 2008, Cogn. Sci..

[14]  John R. Anderson,et al.  The acquisition of robust and flexible cognitive skills. , 2008, Journal of experimental psychology. General.

[15]  S. Petersen,et al.  The maturing architecture of the brain's default network , 2008, Proceedings of the National Academy of Sciences.

[16]  Abraham Z. Snyder,et al.  A default mode of brain function: A brief history of an evolving idea , 2007, NeuroImage.

[17]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[18]  L. J. P. van der Maaten,et al.  An Introduction to Dimensionality Reduction Using Matlab , 2007 .

[19]  Tony O’Hagan.  Bayes factors , 2006 .

[20]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[21]  K. A. Ericsson,et al.  Protocol Analysis and Expert Thought: Concurrent Verbalizations of Thinking during Experts' Performance on Representative Tasks , 2006 .

[22]  Shunzheng Yu,et al.  Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2006, IEEE Transactions on Signal Processing.

[23]  Paul J. Feltovich,et al.  An Introduction to Cambridge Handbook of Expertise and Expert Performance: Its Development, Organization, and Content , 2006 .

[24]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[25]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[26]  H. Kobayashi,et al.  An efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2003, IEEE Signal Processing Letters.

[27]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[28]  G. Glover.  Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[29]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[30]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[31]  R W Cox,et al.  Software tools for analysis and visualization of fMRI data , 1997, NMR in biomedicine.

[32]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[33]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[34]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[35]  Allen Newell,et al.  Human Problem Solving. , 1973 .