Tracking children's mental states while solving algebra equations

Behavioral and function magnetic resonance imagery (fMRI) data were combined to infer the mental states of students as they interacted with an intelligent tutoring system. Sixteen children interacted with a computer tutor for solving linear equations over a six‐day period (Days 0–5), with Days 1 and 5 occurring in an fMRI scanner. Hidden Markov model algorithms combined a model of student behavior with multi‐voxel imaging pattern data to predict the mental states of students. We separately assessed the algorithms' ability to predict which step in a problem‐solving sequence was performed and whether the step was performed correctly. For Day 1, the data patterns of other students were used to predict the mental states of a target student. These predictions were improved on Day 5 by adding information about the target student's behavioral and imaging data from Day 1. Successful tracking of mental states depended on using the combination of a behavioral model and multi‐voxel pattern analysis, illustrating the effectiveness of an integrated approach to tracking the cognition of individuals in real time as they perform complex tasks. Hum Brain Mapp, 2012. © 2011 Wiley Periodicals, Inc.

[1]  John R. Anderson,et al.  Automated Eye-Movement Protocol Analysis , 2001, Hum. Comput. Interact..

[2]  Theodore J. Huppert,et al.  Real-time imaging of human brain function by near-infrared spectroscopy using an adaptive general linear model , 2009, NeuroImage.

[3]  G. Rees,et al.  Predicting the Stream of Consciousness from Activity in Human Visual Cortex , 2005, Current Biology.

[4]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[5]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[6]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[7]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[8]  John R. Anderson,et al.  Human Symbol Manipulation Within an Integrated Cognitive Architecture , 2005, Cogn. Sci..

[9]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[10]  John R Anderson,et al.  Predicting the practice effects on the blood oxygenation level-dependent (BOLD) function of fMRI in a symbolic manipulation task , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Dinggang Shen,et al.  Classifying spatial patterns of brain activity with machine learning methods: Application to lie detection , 2005, NeuroImage.

[12]  Indrayana Rustandi,et al.  Modeling fMRI data generated by overlapping cognitive processes with unknown onsets using Hidden Process Models , 2009, NeuroImage.

[13]  John R. Anderson,et al.  What role do cognitive architectures play in intelligent tutoring systems , 2001 .

[14]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[15]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[16]  Shawn Betts,et al.  Practice Enables Successful Learning Under Minimal Guidance , 2009 .

[17]  Arthur C. Graesser,et al.  The Relationship between Affective States and Dialog Patterns during Interactions with AutoTutor , 2005 .

[18]  R. Turner,et al.  Event-Related fMRI: Characterizing Differential Responses , 1998, NeuroImage.

[19]  K. R. Ridderinkhof,et al.  Conscious perception of errors and its relation to the anterior insula , 2010, Brain Structure and Function.

[20]  A R McIntosh,et al.  Positron emission tomography correlations in and beyond medial temporal lobes , 1999, Hippocampus.

[21]  Scott T. Grafton,et al.  Automated image registration: I. General methods and intrasubject, intramodality validation. , 1998, Journal of computer assisted tomography.

[22]  Lars Kai Hansen,et al.  Mining the posterior cingulate: Segregation between memory and pain components , 2005, NeuroImage.

[23]  Tom Michael Mitchell,et al.  Predicting Human Brain Activity Associated with the Meanings of Nouns , 2008, Science.

[24]  M. Herrmann,et al.  Common brain regions underlying different arithmetic operations as revealed by conjunct fMRI–BOLD activation , 2007, Brain Research.

[25]  John R. Anderson,et al.  The change of the brain activation patterns as children learn algebra equation solving. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[26]  G. McLachlan.  Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[27]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[28]  John R. Anderson,et al.  Using fMRI to Test Models of Complex Cognition , 2008, Cogn. Sci..

[29]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[30]  John R. Anderson,et al.  Cognitive Tutors: Lessons Learned , 1995 .

[31]  John R Anderson,et al.  Neural imaging to track mental states while using an intelligent tutoring system , 2010, Proceedings of the National Academy of Sciences.

[32]  Vinod Menon,et al.  Neuro-functional differences associated with arithmetic processing in Turner syndrome. , 2006, Cerebral cortex.

[33]  John R. Anderson.  How Can the Human Mind Occur in the Physical Universe , 2007 .