Optimizing Human Learning

Spaced repetition is a technique for efficient memorization which uses repeated, spaced review of content to improve long-term retention. Can we find the optimal reviewing schedule to maximize the benefits of spaced repetition? In this paper, we introduce a novel, flexible representation of spaced repetition using the framework of marked temporal point processes and then address the above question as an optimal control problem for stochastic differential equations with jumps. For two well-known human memory models, we show that the optimal reviewing schedule is given by the recall probability of the content to be learned. As a result, we can then develop a simple, scalable online algorithm, Memorize, to sample the optimal reviewing times. Experiments on both synthetic and real data gathered from Duolingo, a popular language-learning online platform, show that our algorithm may be able to help learners memorize more effectively than alternatives.

[1]  Ed Vul,et al.  Predicting the Optimal Spacing of Study: A Multiscale Context Model of Memory , 2009, NIPS.

[2]  Hamid R. Rabiee,et al.  Cheshire: An Online Algorithm for Activity Maximization in Social Networks , 2017, ArXiv.

[3]  Burr Settles,et al.  A Trainable Spaced Repetition Model for Language Learning , 2016, ACL.

[4]  Kristine C. Bloom,et al.  Effects of Massed and Distributed Practice on the Learning and Retention of Second-Language Vocabulary , 1981 .

[5]  P. Kellman,et al.  A comparison of adaptive and fixed schedules of practice. , 2016, Journal of experimental psychology. General.

[6]  Robert V. Lindsey,et al.  Improving Students’ Long-Term Knowledge Retention Through Personalized Review , 2014, Psychological science.

[7]  G. Shedler,et al.  Simulation of Nonhomogeneous Poisson Processes by Thinning , 1979 .

[8]  R. Atkinson Optimizing the Learning of a Second-Language Vocabulary. , 1972 .

[9]  Steven H Strogatz,et al.  Education of a model student , 2012, Proceedings of the National Academy of Sciences.

[10]  Clara E. Bussenius,et al.  Memory : A Contribution to Experimental Psychology , 2017 .

[11]  Andrew Heathcote,et al.  The form of the forgetting curve and the fate of memories , 2011 .

[12]  Floyd B. Hanson,et al.  Applied stochastic processes and control for jump-diffusions - modeling, analysis, and computation , 2007, Advances in design and control.

[13]  P. Grambsch Survival and Event History Analysis: A Process Point of View by AALEN, O. O., BORGAN, O., and GJESSING, H. K. , 2009 .

[14]  Geoffrey R. Loftus,et al.  Evaluating forgetting curves. , 1985 .

[15]  H. Pashler,et al.  Distributed practice in verbal recall tasks: A review and quantitative synthesis. , 2006, Psychological bulletin.

[16]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[17]  Shana K. Carpenter,et al.  The Wickelgren Power Law and the Ebbinghaus Savings Function , 2007, Psychological science.

[18]  Thorsten Joachims,et al.  Unbounded Human Learning: Optimal Scheduling for Spaced Repetition , 2016, KDD.

[19]  John R Anderson,et al.  Using a model to compute the optimal schedule of practice. , 2008, Journal of experimental psychology. Applied.

[20]  Roland J. Baddeley,et al.  Does adaptive training work , 2009 .

[21]  A. W. Melton The situation with respect to the spacing of repetitions and memory , 1970 .

[22]  Hamid R. Rabiee,et al.  RedQueen: An Online Algorithm for Smart Broadcasting in Social Networks , 2016, WSDM.

[23]  Edward Vul,et al.  PSYCHOLOGICAL SCIENCE Research Article Spacing Effects in Learning A Temporal Ridgeline of Optimal Retention , 2022 .

[24]  F. N. Dempster,et al.  Spacing effects and their implications for theory and practice , 1989 .