Providing Adaptive Support in an Interactive Simulation for Learning: An Experimental Evaluation

Recent rise of Massive Open Online Courses (MOOCs) with unlimited participants, makes employing learning tools such as interactive simulations all but inevitable. Interactive simulations give students the opportunity to experiment with concrete examples and develop better understanding of concepts they have learned. However, some students do not learn well from this relatively unstructured form of interaction, suggesting the provision of adaptive support as a way to address this issue. This paper presents a formal evaluation of providing support to facilitate open exploration. We describe the process of designing an intervention delivery mechanism for adding adaptive support to an exploratory interactive simulation. The experimental evaluation of the adaptive version of the simulation indicates that the adaptive support provided to students significantly improved their learning performance. Quantitative and qualitative evaluations of users' acceptance of the system are generally positive but pinpoint areas for improvement.

[1]  Russell V. Lenth,et al.  Java Applets for Power and Sample Size , 2015 .

[2]  Ton de Jong,et al.  Technological Advances in Inquiry Learning , 2006 .

[3]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[4]  Arthur C. Graesser,et al.  AutoTutor 3-D Simulations: Analyzing Users' Actions and Learning Trends , 2006 .

[5]  Samad Kardan Data mining for adding adaptive interventions to exploratory and open-ended environments , 2012, UMAP.

[6]  Manolis Mavrikis,et al.  Design requirements, student perception indicators and validation metrics for intelligent exploratory learning environments , 2013, Personal and Ubiquitous Computing.

[7]  L Poole David,et al.  Artificial Intelligence: Foundations of Computational Agents , 2010 .

[8]  Michael Eagle,et al.  Experimental Evaluation of Automatic Hint Generation for a Logic Tutor , 2011, Int. J. Artif. Intell. Educ..

[9]  Alan K. Mackworth,et al.  Artificial Intelligence - Foundations of Computational Agents , 2010 .

[10]  R. O’Brien,et al.  A Caution Regarding Rules of Thumb for Variance Inflation Factors , 2007 .

[11]  Cristina Conati,et al.  A Framework for Capturing Distinguishing User Interaction Behaviors in Novel Interfaces , 2011, EDM.

[12]  Ton de Jong,et al.  Issues in computer supported inquiry learning in science , 2007, J. Comput. Assist. Learn..

[13]  Cristina Conati,et al.  Exploring gaze data for determining user learning with an interactive simulation , 2012, UMAP.

[14]  Cristina Conati,et al.  Pedagogy and usability in interactive algorithm visualizations: Designing and evaluating CIspace , 2016, Interact. Comput..

[15]  Kurt VanLehn,et al.  The Behavior of Tutoring Systems , 2006, Int. J. Artif. Intell. Educ..

[16]  Andrea Bunt,et al.  Matching attentional draw with utility in interruption , 2007, CHI.

[17]  Florin D. Salajan,et al.  Learning with web-based interactive objects: An investigation into student perceptions of effectiveness , 2009, Comput. Educ..

[18]  Beverly Park Woolf,et al.  Transforming Learning with New Technologies (second edition) , 2013 .

[19]  Rolf Plötzner,et al.  Students' difficulties in learning from dynamic visualisations and how they may be overcome , 2009, Comput. Hum. Behav..

[20]  Bruce M. McLaren,et al.  How Much Assistance Is Helpful to Students in Discovery Learning? , 2009, EC-TEL.

[21]  Antonija Mitrovic,et al.  Intelligent Augmented Reality Training for Assembly Tasks , 2013, AIED.

[22]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[23]  C. Wieman,et al.  PhET: Interactive Simulations for Teaching and Learning Physics , 2006 .

[24]  Choo-Yee Ting,et al.  A Decision-Theoretic Approach to Scientific Inquiry Exploratory Learning Environment , 2006, Intelligent Tutoring Systems.

[25]  Alan Koenig,et al.  Designing and Developing Effective Training Games for the US Navy , 2009 .

[26]  Ryan Shaun Joazeiro de Baker,et al.  The Science Assistments Project: Scaffolding Scientific Inquiry Skills , 2010, Intelligent Tutoring Systems.