Discovering the Sequential Structure of Thought

Multi-voxel pattern recognition techniques combined with Hidden Markov models can be used to discover the mental states that people go through in performing a task. The combined method identifies both the mental states and how their durations vary with experimental conditions. We apply this method to a task where participants solve novel mathematical problems. We identify four states in the solution of these problems: Encoding, Planning, Solving, and Respond. The method allows us to interpret what participants are doing on individual problem-solving trials. The duration of the planning state varies on a trial-to-trial basis with novelty of the problem. The duration of solution stage similarly varies with the amount of computation needed to produce a solution once a plan is devised. The response stage similarly varies with the complexity of the answer produced. In addition, we identified a number of effects that ran counter to a prior model of the task. Thus, we were able to decompose the overall problem-solving time into estimates of its components and in way that serves to guide theory.

[1]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[2]  Shunzheng Yu,et al.  Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2006, IEEE Transactions on Signal Processing.

[3]  John R. Anderson,et al.  The acquisition of robust and flexible cognitive skills. , 2008, Journal of experimental psychology. General.

[4]  John R. Anderson,et al.  Tracking problem solving by multivariate pattern analysis and Hidden Markov Model algorithms , 2012, Neuropsychologia.

[5]  J. Mazziotta,et al.  Automated image registration , 1993 .

[6]  G. Miller,et al.  Cognitive science. , 1981, Science.

[7]  Bertrand Thirion,et al.  Deciphering Cortical Number Coding from Human Brain Activity Patterns , 2009, Current Biology.

[8]  Tom Michael Mitchell,et al.  A Neurosemantic Theory of Concrete Noun Representation Based on the Underlying Brain Codes , 2010, PloS one.

[9]  John R. Anderson,et al.  Using fMRI to Test Models of Complex Cognition , 2008, Cogn. Sci..

[10]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[11]  Abraham Z. Snyder,et al.  A default mode of brain function: A brief history of an evolving idea , 2007, NeuroImage.

[12]  Shawn Betts,et al.  Brain Networks Supporting Execution of Mathematical Skills versus Acquisition of New Mathematical Competence , 2012, PloS one.

[13]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Jian Yang,et al.  Using brain imaging to track problem solving in a complex state space , 2012, NeuroImage.

[16]  R W Cox,et al.  Software tools for analysis and visualization of fMRI data , 1997, NMR in biomedicine.

[17]  Marsha C. Lovett,et al.  Neural correlates of arithmetic calculation strategies , 2009, Cognitive, affective & behavioral neuroscience.

[18]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[19]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[20]  Richard H. Jones,et al.  Bayesian information criterion for longitudinal and clustered data , 2011, Statistics in medicine.

[21]  John R Anderson,et al.  Neural imaging to track mental states while using an intelligent tutoring system , 2010, Proceedings of the National Academy of Sciences.

[22]  Shawn Betts,et al.  Cognitive and Metacognitive Activity in Mathematical Problem Solving: Prefrontal and Parietal Patterns It Also Appears to Play a Key Role in Retrieval of Arithmetic , 2022 .

[23]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[24]  J. Ghosh,et al.  Approximations and consistency of Bayes factors as model dimension grows , 2003 .

[25]  H. Kobayashi,et al.  An efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2003, IEEE Signal Processing Letters.

[26]  K. A. Ericsson,et al.  Protocol Analysis and Expert Thought: Concurrent Verbalizations of Thinking during Experts' Performance on Representative Tasks , 2006 .

[27]  Shawn Betts,et al.  Tracking children's mental states while solving algebra equations , 2012, Human brain mapping.

[28]  G. Glover.  Deconvolution of Impulse Response in Event-Related BOLD fMRI1 , 1999, NeuroImage.

[29]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .

[30]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[31]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[32]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[33]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[34]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[35]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[36]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[37]  S. Petersen,et al.  The maturing architecture of the brain's default network , 2008, Proceedings of the National Academy of Sciences.

[38]  Dong Ren,et al.  A Remarkable New Family of Jurassic Insects (Neuroptera) with Primitive Wing Venation and Its Phylogenetic Position in Neuropterida , 2012, PloS one.