Differences in Student Trajectories via Filtered Time Series Analysis in an Immersive Virtual World

To scaffold students' investigations of an inquiry-based immersive virtual world for science education without undercutting the affordances an open-ended activity provides, this study explores ways time-stamped log files of groups' actions may enable the automatic generation of formative supports. Groups' logged actions in the virtual world are filtered via principal component analysis to provide a time series trajectory showing the rate of their investigative activities over time. This technique functions well in open-ended environments and examines the entire course of their experience in the virtual world instead of specific subsequences. Groups' trajectories are grouped via k-means clustering to identify different typical pathways taken through the immersive virtual world. These different approaches are then correlated with learning gains across several survey constructs (affective dimensions, ecosystem science content, understanding of causality, and experimental methods) to see how various trends are associated with different outcomes. Differences by teacher and school are explored to see how best to support inclusion and success of a diverse array of learners.

[1]  Tamara Sumner,et al.  Scientific modeling: using learning analytics to examine student practices and classroom variation , 2017, LAK.

[2]  Kenneth R. Koedinger,et al.  Automatic Generation of Programming Feedback; A Data-Driven Approach , 2013, AIED Workshops.

[3]  J. Shea National Science Education Standards , 1995 .

[4]  Chris Dede,et al.  EcoXPT: Designing for Deeper Learning through Experimentation in an Immersive Virtual Ecosystem , 2017, J. Educ. Technol. Soc..

[5]  Paul R. Cohen,et al.  Modeling learning patterns of students with a tutoring system using Hidden Markov Models , 2007, AIED.

[6]  Roger Azevedo,et al.  Filtered Time Series Analyses of Student Problem-Solving Behaviors in Game-based Learning , 2018, EDM.

[7]  David N. Beede,et al.  STEM: Good Jobs Now and for the Future. ESA Issue Brief #03-11. , 2011 .

[8]  Ryan Shaun Joazeiro de Baker,et al.  Using Text Replay Tagging to Produce Detectors of Systematic Experimentation Behavior Patterns , 2010, EDM.

[9]  Jon Heales,et al.  Forms of Formative Assessment in Virtual Learning Environments , 2015, AMCIS.

[10]  Ryan Shaun Joazeiro de Baker,et al.  New Potentials for Data-Driven Intelligent Tutoring System Development and Optimization , 2013, AI Mag..

[11]  V. Shute SteAlth ASSeSSment in computer-BASed GAmeS to Support leArninG , 2011 .

[12]  J. Bransford How people learn , 2000 .

[13]  Taylor Martin,et al.  Using Learning Analytics to Understand the Learning Pathways of Novice Programmers , 2013 .

[14]  Roger Azevedo,et al.  Enhancing Student Models in Game-based Learning with Facial Expression Recognition , 2017, UMAP.

[15]  Jody Clarke,et al.  Predicting Successful Inquiry Learning in a Virtual Performance Assessment for Science , 2013, UMAP.

[16]  Gautam Biswas,et al.  Analyzing the temporal evolution of students’ behaviors in open-ended learning environments , 2014 .

[17]  Stella Fayer,et al.  BLS Spotlight on Statistics: STEM Occupations - Past, Present, and Future , 2017 .

[18]  Xibin Zhu,et al.  Cluster Based Feedback Provision Strategies in Intelligent Tutoring Systems , 2012, ITS.

[19]  Zoran Popovic,et al.  Collaborative Problem Solving in an Open-Ended Scientific Discovery Game , 2017, Proc. ACM Hum. Comput. Interact..

[20]  Chris Dede,et al.  Assessment, Technology, and Change , 2010 .

[21]  J. Lagowski National Science Education Standards , 1995 .

[22]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[23]  Judy Kay,et al.  Analysing Frequent Sequential Patterns of Collaborative Learning Activity Around an Interactive Tabletop. Nominee for Best Paper Award , 2010, EDM.

[24]  Yun-En Liu,et al.  The impact of tutorials on games of varying complexity , 2012, CHI.

[25]  Zoran Popovic,et al.  Learning Individual Behavior in an Educational Game: A Data-Driven Approach , 2014, EDM.