Problem Order Implications for Learning

The order of problems presented to students is an important variable that affects learning effectiveness. Previous studies have shown that solving problems in a blocked order, in which all problems of one type are completed before the student is switched to the next problem type, results in less effective performance than does solving the problems in an interleaved order. However, we have no precise understanding of the reason for this effect. In addition to existing theoretical results, we use a machine-learning agent that learns cognitive skills from examples and problem solving experience, SimStudent, to provide a computational model of the problem order question. We conduct a controlled simulation study in three different math and science domains (i.e., fraction addition, equation solving and stoichiometry), where SimStudent is tutored by automatic tutors given problems that have been used to teach human students. We compare two problem orders: the blocked problem order, and the interleaved problem order. The results show that the interleaved problem order yields as effective or more effective learning in all three domains, because the interleaved problem order provides more or better opportunities for error detection and correction to the learning agent. Examination of the agent’s performance shows that learning when to apply a skill benefits more from interleaved problem orders, and suggests that learning how to apply a skill benefits more from blocked problem orders.

[1]  R. Magill,et al.  The contextual interference effect in parameter modifications of the same generalized motor program. , 1996, Research quarterly for exercise and sport.

[2]  Vincent Aleven,et al.  A New Paradigm for Intelligent Tutoring Systems: Example-Tracing Tutors , 2009, Int. J. Artif. Intell. Educ..

[3]  H Carnahan,et al.  A noted on the relationship between task requirements and the contextual interference effect. , 1990, Journal of motor behavior.

[4]  P Del Rey,et al.  Effects of Contextual Interference on the Memory of Older Females Differing in Levels of Physical Activity , 1982, Perceptual and motor skills.

[5]  Luc De Raedt,et al.  Inductive Logic Programming: Theory and Methods , 1994, J. Log. Program..

[6]  Mykola Pechenizkiy,et al.  Handbook of Educational Data Mining , 2010 .

[7]  Eric Buckolz,et al.  Practice schedule effects on the acquisition and retention of a motor skill , 1987 .

[8]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[9]  J. R. Quinlan Learning Logical Definitions from Relations , 1990 .

[10]  Julius Marie Pieters,et al.  Practice schedule and cognitive style interaction in learning a maze task , 1989 .

[11]  Douglas E. Young,et al.  Contextual interference and motor skill acquisition: On the processes that influence retention , 1993 .

[12]  Charles L. Forgy,et al.  Rete: a fast algorithm for the many pattern/many object pattern match problem , 1991 .

[13]  J. Shea,et al.  Contextual interference effects on the acquisition, retention, and transfer of a motor skill. , 1979 .

[14]  H. Simon,et al.  Perception in chess , 1973 .

[15]  Pat Langley,et al.  A Unified Cognitive Architecture for Physical Agents , 2006, AAAI.

[16]  Pat Langley,et al.  Improving Acquisition of Teleoreactive Logic Programs through Representation Change , 2011, AAAI Fall Symposium: Advances in Cognitive Systems.

[17]  Vincent Aleven,et al.  Eliciting Intelligent Novice Behaviors with Grounded Feedback in a Fraction Addition Tutor , 2011, AIED.

[18]  John R. Anderson,et al.  Abstract Planning and Perceptual Chunks: Elements of Expertise in Geometry , 1990, Cogn. Sci..

[19]  Kenneth R. Koedinger,et al.  Efficient Cross-Domain Learning of Complex Skills , 2012, ITS.

[20]  Kenneth R. Koedinger,et al.  A Machine Learning Approach for Automatic Student Model Discovery , 2011, EDM.

[21]  Yuandong Tian,et al.  Integrating Perceptual Learning with External World Knowledge in a Simulated Student , 2013, AIED.

[22]  Kenneth R. Koedinger,et al.  A Data Repository for the EDM Community: The PSLC DataShop , 2010 .

[23]  R. Magill,et al.  American Psychological Association, Inc. The Locus of Contextual Interference in Motor-Skill Acquisition i , 2022 .

[24]  P. Hietala,et al.  The Competence of Learning Companion Agents , 1997 .

[25]  Judith E. Rink,et al.  Effects of Contextual Interference on Retention of Three Volleyball Skills , 1990 .

[26]  T D Lee,et al.  Contextual interference in learning new patterns of bimanual coordination. , 1998, Journal of motor behavior.

[27]  Kurt VanLehn,et al.  Learning one Subprocedure per Lesson , 1987, Artif. Intell..

[28]  Kenneth R. Koedinger,et al.  Why Tutored Problem Solving May be Better Than Example Study: Theoretical Implications from a Simulated-Student Study , 2008, Intelligent Tutoring Systems.

[29]  Kenneth R. Koedinger,et al.  A Computational Model of Accelerated Future Learning through Feature Recognition , 2010, Intelligent Tutoring Systems.

[30]  Tessa A. Lau,et al.  Programming by demonstration: an inductive learning formulation , 1998, IUI '99.

[31]  Tak-Wai Chan,et al.  Exploring the Design of Computer Supports for Reciprocal Tutoring , 1997 .

[32]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[33]  S. Monsell Task switching , 2003, Trends in Cognitive Sciences.

[34]  C. Shea,et al.  Principles derived from the study of simple skills do not generalize to complex skill learning , 2002, Psychonomic bulletin & review.

[35]  K. VanLehn Mind Bugs: The Origins of Procedural Misconceptions , 1990 .

[36]  Stellan Ohlsson,et al.  Computational Models of Skill Acquisition , 2008 .

[37]  H B Richman,et al.  Simulation of expert memory using EPAM IV. , 1995, Psychological review.

[38]  Kenneth R. Koedinger,et al.  When and how often should worked examples be given to students? New results and a summary of the current state of research , 2008 .

[39]  Kenneth R. Koedinger,et al.  Integrating representation learning and skill learning in a human-like intelligent agent , 2015, Artif. Intell..

[40]  Patricia Del Rey,et al.  Effects of contextual interference on the memory of older females differing in levels of physical activity. , 1982 .

[41]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[42]  Thomas G. Dietterich Learning at the Knowledge Level , 1986, Machine Learning.