Do novices and advanced students benefit differently from worked examples and ITS

Prior research shows that novices learn more from examples than unsupported problem solving. Intelligent Tutoring Systems (ITS) support problem solving in many ways, adaptive feedback being one of them. However, when students repeatedly request hints from ITSs, problem solving is eventually replaced with worked examples when students request solutions to the current step or the whole problem. We conducted a study to observe the difference in learning outcomes when novices and advanced students learn from examples or with an ITS. The study had three conditions: Examples Only (EO), Problems Only (PO) and Alternating Examples and Problems (AEP). After each example/problem, students received Self-Explanation (SE) prompts. The result shows that novices learnt significantly more conceptual knowledge in the AEP compared to the PO condition. Moreover, novices in the AEP and PO conditions performed significantly better on SE prompts than students in the EO condition. Advanced students who learnt from examples only did not significantly improve in the study. Overall, the study suggests using AEP for novices and either AEP or PO for advanced students. The results clearly reveal that using examples alone is not an effective approach for novices and advanced students in comparison with ITSs.

[1]  K. VanLehn.  The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[2]  T. Gog,et al.  Effects of worked examples, example-problem, and problem-example pairs on novices learning , 2011 .

[3]  John Sweller,et al.  Efficiency in Learning: Evidence-Based Guidelines to Manage Cognitive Load , 2005 .

[4]  Kurt VanLehn,et al.  The Design of Self-explanation Prompts: The Fit Hypothesis , 2009 .

[5]  Neil T. Heffernan,et al.  Tutored Problem Solving vs. “Pure” Worked Examples , 2009 .

[6]  M. Chi,et al.  Eliciting Self‐Explanations Improves Understanding , 1994 .

[7]  Paul Chandler,et al.  Levels of Expertise and Instructional Design , 1998, Hum. Factors.

[8]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[9]  Carolyn Penstein Rosé,et al.  The Beginning of a Beautiful Friendship? Intelligent Tutoring Systems and MOOCs , 2015, AIED.

[10]  Antonija Mitrovic,et al.  An Intelligent SQL Tutor on the Web , 2003, Int. J. Artif. Intell. Educ..

[11]  Vincent Aleven,et al.  The expertise reversal effect and worked examples in tutored problem solving , 2010 .

[12]  Antonija Mitrovic,et al.  Revisiting Ill-Definedness and the Consequences for ITSs , 2009, AIED.

[13]  Alexander Renkl,et al.  Learning how to use a computer-based concept-mapping tool: Self-explaining examples helps , 2009, Comput. Hum. Behav..

[14]  Vincent Aleven,et al.  The worked-example effect: Not an artefact of lousy control conditions , 2009, Comput. Hum. Behav..

[15]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[16]  Bruce M. McLaren,et al.  When Is It Best to Learn with All Worked Examples? , 2011, AIED.

[17]  Vincent Aleven,et al.  Intelligent Tutoring Goes To School in the Big City , 1997 .

[18]  John Sweller,et al.  The worked-example effect using ill-defined problems: Learning to recognise designers' styles , 2009 .

[19]  J. Sweller.  The worked example effect and human cognition , 2006 .

[20]  Antonija Mitrovic,et al.  Examples and Tutored Problems: How Can Self-Explanation Make a Difference to Learning? , 2013, AIED.

[21]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[22]  M. Chi,et al.  The Content of Physics Self-Explanations , 1991 .

[23]  Antonija Mitrovic,et al.  Fifteen years of constraint-based tutors: what we have achieved and where we are going , 2011, User Modeling and User-Adapted Interaction.

[24]  J. Sweller,et al.  The Use of Worked Examples as a Substitute for Problem Solving in Learning Algebra , 1985 .

[25]  T. Gog,et al.  Example-Based Learning: Integrating Cognitive and Social-Cognitive Research Perspectives , 2010 .

[26]  S. Derry,et al.  Learning from Examples: Instructional Principles from the Worked Examples Research , 2000 .