Modeling the Development of Problem Solving Skills in Chemistry with a Web-Based Tutor

This research describes a probabilistic approach for developing predictive models of how students learn problem-solving skills in general qualitative chemistry. The goal is to use these models to apply active, real-time interventions when the learning appears less than optimal. We first use self-organizing artificial neural networks to identify the most common student strategies on the online tasks, and then apply Hidden Markov Modeling to sequences of these strategies to model learning trajectories. We have found that: strategic learning trajectories, which are consistent with theories of competence development, can be modeled with a stochastic state transition paradigm; trajectories differ across gender, collaborative groups and student ability; and, these models can be used to accurately (>80%) predict future performances. While we modeled this approach in chemistry, it is applicable to many science domains where learning in a complex domain can be followed over time.

[1]  Susanne P. Lajoie Transitions and Trajectories for Studies of Expertise , 2003 .

[2]  Peter A. Frensch,et al.  The Role of Information Reduction in Skill Acquisition , 1996, Cognitive Psychology.

[3]  Anton E. Lawson,et al.  Science Teaching and Development Of Thinking , 1994 .

[4]  Alan M. Lesgold,et al.  A Computational Approach to Analyzing Online Knowledge Sharing Interaction , 2003 .

[5]  Amy Soller,et al.  Strategic Collaboration Support in a Web-based Scientific Inquiry Environment , 2004 .

[6]  R. Stevens,et al.  Artificial neural network-based performance assessments , 1999 .

[7]  Amy Soller,et al.  Understanding knowledge-sharing breakdowns: a meeting of the quantitative and qualitative minds , 2004, J. Comput. Assist. Learn..

[8]  John R. Anderson Cognitive Psychology and Its Implications , 1980 .

[9]  K. VanLehn,et al.  Cognitive skill acquisition. , 1996, Annual review of psychology.

[10]  L M Reder,et al.  Awareness and working memory in strategy adaptivity , 2001, Memory & cognition.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[13]  Sandra Katz,et al.  Extensions of intelligent tutoring paradigms to support collaborative learning , 1992 .

[14]  Ronald H. Stevens,et al.  Exploring Alternative Models of Complex Patient Management with Artificial Neural Networks , 2000, Advances in health sciences education : theory and practice.

[15]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[16]  John R. Anderson,et al.  The generality/specificity of expertise in scientific reasoning , 1999, Cogn. Sci..

[17]  P. Alexander The Development of Expertise: The Journey From Acclimation to Proficiency , 2003 .

[18]  John R. Anderson,et al.  Knowledge tracing: Modeling the acquisition of procedural knowledge , 2005, User Modeling and User-Adapted Interaction.

[19]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[20]  S. Kay On the Nature of Expertise. , 1992 .

[21]  S. Dijkstra,et al.  Instructional Models in Computer-Based Learning Environments , 1992 .

[22]  R H Stevens,et al.  Artificial neural networks as adjuncts for assessing medical students' problem solving performances on computer-based simulations. , 1993, Computers and biomedical research, an international journal.