Auto-scoring Discovery and Confirmation Bias in Interpreting Data during Science Inquiry in a Microworld

Many students have difficulty with inquiry and difficulty with interpreting data, in particular. Of interest here is confirmation bias, i.e., when students won’t discard a hypothesis based on disconfirming results, which is in direct contrast to when students make a discovery, having originally made a scientifically inaccurate hypothesis. The goal of the present study is to better understand these two data interpretation patterns and autoscore them. 145 eighth grade students engaged in inquiry with a state change microworld. Production rules were written to produce model-tracing in order to identify when students either made a discovery or engaged in confirmation bias. Interesting to note was an emerging pattern wherein many of the same students made discoveries across the four inquiry tasks. These data are important for performance assessment of inquiry and suggest that students may need adaptive scaffolding support while engaging in data interpretation.

[1]  Alan H. Schoenfeld,et al.  Mathematical Problem Solving , 1985 .

[2]  Kevin Dunbar,et al.  Concept Discovery in a Scientific Domain , 1993, Cogn. Sci..

[3]  John R. Anderson,et al.  The generality/specificity of expertise in scientific reasoning , 1999, Cogn. Sci..

[4]  A. Corbett,et al.  The Cambridge Handbook of the Learning Sciences: Cognitive Tutors , 2005 .

[5]  L. Schauble,et al.  Cross-Domain Development of Scientific Reasoning , 1992 .

[6]  Leona Schauble,et al.  Students' Understanding of the Objectives and Procedures of Experimentation in the Science Classroom , 1995 .

[7]  Ton de Jong,et al.  Scientific Discovery Learning with Computer Simulations of Conceptual Domains , 1998 .

[8]  D. Klahr,et al.  All other things being equal: acquisition and transfer of the control of variables strategy. , 1999, Child development.

[9]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[10]  Manu Kapur.  Moving beyond the Pedagogy of Mathematics: Foregrounding Epistemological Concerns , 2009 .

[11]  R. Sawyer.  The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[12]  Herbert A. Simon,et al.  Scientific discovery , 1993, BMJ : British Medical Journal.

[13]  Janice D. Gobert,et al.  Leveraging Educational Data Mining for Real-time Performance Assessment of Scientific Inquiry Skills within Microworlds , 2012, EDM 2012.

[14]  Daniel D. Suthers,et al.  Component-Based Construction of a Science Learning Space , 1998, Intelligent Tutoring Systems.

[15]  Kenneth R. Koedinger,et al.  Using Model-Tracing to Conduct Performance Assessment of Students' Inquiry Skills within a Microworld. , 2011 .

[16]  David Klahr,et al.  Dual Space Search During Scientific Reasoning , 1988, Cogn. Sci..

[17]  Ryan Shaun Joazeiro de Baker,et al.  Leveraging machine-learned detectors of systematic inquiry behavior to estimate and predict transfer of inquiry skill , 2011, User Modeling and User-Adapted Interaction.

[18]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .