Identifying Productive Inquiry in Virtual Labs Using Sequence Mining

Virtual labs are exploratory learning environments in which students learn by conducting inquiry to uncover the underlying scientific model. Although students often fail to learn efficiently in these environments, providing effective support is challenging since it is unclear what productive engagement looks like. This paper focuses on the mining and identification of student inquiry strategies during an unstructured activity with the DC Circuit Construction Kit (https://phet.colorado.edu/). We use an information theoretic sequence mining method to identify productive and unproductive strategies of a hundred students. Low domain knowledge students who successfully learned during the activity paused more after testing their circuits, particularly on simply structured circuits that target the activity’s learning goals, and mainly earlier in the activity. Moreover, our results show that a strategic use of pauses so that they become opportunities for reflection and planning is highly associated with productive learning. Implication to theory, support, and assessment are discussed.

[1]  Ya'akov Gal,et al.  Plan Recognition for Exploratory Learning Environments Using Interleaved Temporal Search , 2015, AI Mag..

[2]  Paulo Blikstein,et al.  Learning Environments and Inquiry Behaviors in Science Inquiry Learning: How Their Interplay Affects the Development of Conceptual Understanding in Physics , 2015, EDM.

[3]  Gautam Biswas,et al.  Mining Temporally-Interesting Learning Behavior Patterns , 2013, EDM.

[4]  Antonija Mitrovic,et al.  Teaching Database Design with Constraint-Based Tutors , 2015, International Journal of Artificial Intelligence in Education.

[5]  Kenneth R. Koedinger,et al.  A Response Time Model For Bottom-Out Hints as Worked Examples , 2008, EDM.

[6]  David R. Geelan,et al.  Enhancing Students' Scientific Literacy Using Interactive Simulations: A Critical Literature Review. , 2013 .

[7]  T. Jong,et al.  Exploratory learning with a computer simulation for control theory: learning processes and instructional support , 1993 .

[8]  Janice D. Gobert,et al.  From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining , 2013, Journal of the Learning Sciences.

[9]  Tiffany Barnes,et al.  Preface for the Special Issue on AI-Supported Education in Computer Science , 2017, International Journal of Artificial Intelligence in Education.

[10]  K. Koedinger,et al.  Fostering the Intelligent Novice: Learning From Errors With Metacognitive Tutoring , 2005 .

[11]  Wouter R. van Joolingen,et al.  Students' reasoning during modeling in an inquiry learning environment , 2005, Comput. Hum. Behav..

[12]  Wouter van Joolingen,et al.  Model-Based Diagnosis for Regulative Support in Inquiry Learning , 2013 .

[13]  Ryan Shaun Joazeiro de Baker,et al.  Educational Data Mining and Learning Analytics: Applications to Constructionist Research , 2014, Technology, Knowledge and Learning.

[14]  Cristina Conati,et al.  Automatic Recognition of Learner Groups in Exploratory Learning Environments , 2006, Intelligent Tutoring Systems.

[15]  C. Wieman,et al.  PhET: Simulations That Enhance Learning , 2008, Science.

[16]  Jody Clarke,et al.  Towards general models of effective science inquiry in virtual performance assessments , 2016, J. Comput. Assist. Learn..

[17]  Cristina Conati,et al.  Applying a Framework for Student Modeling in Exploratory Learning Environments: Comparing Data Representation Granularity to Handle Environment Complexity , 2017, International Journal of Artificial Intelligence in Education.

[18]  Ido Roll,et al.  Understanding, evaluating, and supporting self-regulated learning using learning analytics , 2015, J. Learn. Anal..

[19]  F. Manganello Constructivist Instruction: Success or Failure? , 2010 .

[20]  Daniel L. Schwartz,et al.  Seeking the General Explanation: A Test of Inductive Activities for Learning and Transfer. , 2015 .

[21]  Ton de Jong,et al.  Scientific Discovery Learning with Computer Simulations of Conceptual Domains , 1998 .

[22]  Ton de Jong,et al.  Trends and issues of regulative support use during inquiry learning: Patterns from three studies , 2009, Comput. Hum. Behav..

[23]  Ido Roll,et al.  Making the failure more productive: scaffolding the invention process to improve inquiry behaviors and outcomes in invention activities , 2014 .

[24]  Vincent Aleven,et al.  On the Benefits of Seeking (and Avoiding) Help in Online Problem-Solving Environments , 2014, Journal of the Learning Sciences.