Detecting Diligence with Online Behaviors on Intelligent Tutoring Systems

The current study introduces a model for measuring student diligence using online behaviors during intelligent tutoring system use. This model is validated using a full academic year dataset to test its predictive validity against long-term academic outcomes including end-of-year grades and total work completed by the end of the year. The model is additionally validated for robustness to time-sample length as well as data sampling frequency. While the model is shown to be predictive and robust to time-sample length, the results are inconclusive for robustness in data sampling frequency. Implications for research on interventions, and understanding the influence of self-control, motivation, metacognition, and cognition are discussed.

[1]  Kenneth R. Koedinger,et al.  Learning is Not a Spectator Sport: Doing is Better than Watching for Learning from a MOOC , 2015, L@S.

[2]  P. Pintrich.  A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ). , 1991 .

[3]  Angela L. Duckworth,et al.  Unpacking Self-Control. , 2015, Child development perspectives.

[4]  Angela L. Duckworth,et al.  Measurement Matters , 2015, Educational researcher.

[5]  B. Zimmerman.  Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.

[6]  Tamar Szabó Gendler,et al.  Situational Strategies for Self-Control , 2016, Perspectives on Psychological Science.

[7]  P. Pintrich,et al.  An Achievement Goal Theory Perspective on Issues in Motivation Terminology, Theory, and Research. , 2000, Contemporary educational psychology.

[8]  K. Koedinger,et al.  Automated, Unobtrusive, Action-by-Action Assessment of Self-Regulation During Learning With an Intelligent Tutoring System , 2010 .

[9]  Eric M. VanEpps,et al.  Mind-sets matter: a meta-analytic review of implicit theories and self-regulation. , 2013, Psychological bulletin.

[10]  Francesina R. Jackson.  Outliers: The Story of Success , 2009 .

[11]  Richard D. Roberts,et al.  Empirical identification of the major facets of Conscientiousness , 2009 .

[12]  Martin Ebner,et al.  MOOCs Completion Rates and Possible Methods to Improve Retention - A Literature Review , 2014 .

[13]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[14]  John S. Kinnebrew,et al.  A Contextualized, Differential Sequence Mining Method to Derive Students' Learning Behavior Patterns , 2013, EDM 2013.

[15]  Ryan Shaun Joazeiro de Baker,et al.  Detecting Student Misuse of Intelligent Tutoring Systems , 2004, Intelligent Tutoring Systems.

[16]  Gregory M. Walton,et al.  Ego Depletion—Is It All in Your Head? , 2010, Psychological science.

[17]  Albert T. Corbett,et al.  The Knowledge-Learning-Instruction Framework: Bridging the Science-Practice Chasm to Enhance Robust Student Learning , 2012, Cogn. Sci..

[18]  R. Baumeister,et al.  High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. , 2004, Journal of personality.

[19]  D. Wood.  Self-theories: Their Role in Motivation, Personality and Development. By Carol S. Dweck. Psychology Press, Hove, 1999. pp. 195. £29.95 (hb). , 2000 .

[20]  Albert T. Corbett,et al.  Cognitive Tutor: Applied research in mathematics education , 2007, Psychonomic bulletin & review.

[21]  Vincent Aleven,et al.  Fine-Grained Assessment of Motivation over Long Periods of Learning with an Intelligent Tutoring System: Methodology, Advantages, and Preliminary Results , 2013 .

[22]  A. Elliot,et al.  On the measurement of achievement goals: critique, illustration, and application , 2008 .

[23]  Angela L. Duckworth,et al.  Domain-specific impulsivity in school-age children. , 2013, Developmental science.

[24]  Kathleen D. Vohs,et al.  Self-regulation and the executive function of the self , 2003 .

[25]  Vive Kumar,et al.  Supporting Self-Regulated Learning with gStudy Software: The Learning Kit Project ** , 2006 .

[26]  Sidney K D'Mello,et al.  The Academic Diligence Task (ADT): Assessing Individual Differences in Effort on Tedious but Important Schoolwork. , 2014, Contemporary educational psychology.

[27]  Timothy J. Nokes-Malach,et al.  Goal Orientation, Self-Efficacy, and "Online Measures" in Intelligent Tutoring Systems , 2014, CogSci.

[28]  W. Mischel,et al.  Delay of gratification in children. , 1989, Science.

[29]  Carole A. Ames,et al.  Achievement Goals in the Classroom: Students' Learning Strategies and Motivation Processes , 1988 .