Probabilities and predictions: modeling the development of scientific problem-solving skills.

The IMMEX (Interactive Multi-Media Exercises) Web-based problem set platform enables the online delivery of complex, multimedia simulations, the rapid collection of student performance data, and has already been used in several genetic simulations. The next step is the use of these data to understand and improve student learning in a formative manner. This article describes the development of probabilistic models of undergraduate student problem solving in molecular genetics that detailed the spectrum of strategies students used when problem solving, and how the strategic approaches evolved with experience. The actions of 776 university sophomore biology majors from three molecular biology lecture courses were recorded and analyzed. Each of six simulations were first grouped by artificial neural network clustering to provide individual performance measures, and then sequences of these performances were probabilistically modeled by hidden Markov modeling to provide measures of progress. The models showed that students with different initial problem-solving abilities choose different strategies. Initial and final strategies varied across different sections of the same course and were not strongly correlated with other achievement measures. In contrast to previous studies, we observed no significant gender differences. We suggest that instructor interventions based on early student performances with these simulations may assist students to recognize effective and efficient problem-solving strategies and enhance learning.

[1]  Alan M. Lesgold,et al.  A Computational Approach to Analyzing Online Knowledge Sharing Interaction , 2003 .

[2]  Susanne P. Lajoie.  Transitions and Trajectories for Studies of Expertise , 2003 .

[3]  A. Roli.  Artificial Neural Networks , 2012, Lecture Notes in Computer Science.

[4]  K. Kitchener,et al.  Developing Reflective Judgment: Understanding and Promoting Intellectual Growth and Critical Thinking in Adolescents and Adults. Jossey-Bass Higher and Adult Education Series and Jossey-Bass Social and Behavioral Science Series. , 2009 .

[5]  R H Stevens,et al.  Search path mapping: a versatile approach for visualizing problem-solving behavior. , 1991, Academic medicine : journal of the Association of American Medical Colleges.

[6]  Ronald H. Stevens,et al.  Modeling the Development of Problem Solving Skills in Chemistry with a Web-Based Tutor , 2004, Intelligent Tutoring Systems.

[7]  Deborah Allen,et al.  Approaches to biology teaching and learning: from assays to assessments--on collecting evidence in science teaching. , 2004, Cell biology education.

[8]  Ron Stevens,et al.  Assessing Student Problem-Solving Skills With Complex Computer-Based Tasks , 2002 .

[9]  B. Yegnanarayana,et al.  Artificial Neural Networks , 2004 .

[10]  P. Alexander.  The Development of Expertise: The Journey From Acclimation to Proficiency , 2003 .

[11]  Amy Soller,et al.  Understanding knowledge-sharing breakdowns: a meeting of the quantitative and qualitative minds , 2004, J. Comput. Assist. Learn..

[12]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[13]  Anton E. Lawson,et al.  Science Teaching and Development Of Thinking , 1994 .

[14]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[15]  Daniel D. Suthers,et al.  Towards a Systematic Study of Representational Guidance for Collaborative Learing Discourse , 2001, J. Univers. Comput. Sci..

[16]  Terry Vendlinski,et al.  A Markov Model Analysis of Problem-Solving Progress. , 2002 .

[17]  S. Kay.  On the Nature of Expertise. , 1992 .

[18]  R H Stevens,et al.  Artificial neural networks as adjuncts for assessing medical students' problem solving performances on computer-based simulations. , 1993, Computers and biomedical research, an international journal.

[19]  Ron Stevens,et al.  Design and performance frameworks for constructing problem-solving simulations. , 2003, Cell biology education.

[20]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[21]  G. Kane.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[22]  K. VanLehn,et al.  Cognitive skill acquisition. , 1996, Annual review of psychology.

[23]  M. Sundberg,et al.  Assessing student learning. , 2002, Cell biology education.

[24]  R. Stevens,et al.  Artificial neural network-based performance assessments , 1999 .