Timing Matters: Approaches for Measuring and Visualizing Behaviours of Timing and Spacing of Work in Self-Paced Online Teacher Professional Development Courses

One feature of self-paced online courses is greater learner control over the timing of their work in a course. However, the greater timing flexibility that learners enjoy in such environments may play a different role in the learning process than has been previously observed in formal online or face-to-face courses. As such, the study of work timing merits further investigation. Toward this goal, this study forwards two measures that represent the timing of coursework: 1) the timing index, or the degree to which a participant completes 50% of their work, and 2) the spacing count, the frequency of work performed across the course timeframe. In this study, the authors demonstrate the use of these measures from a data set of 42 U.S. middle-school teachers who participated in a self-paced, online professional development course to support teacher implementation of a new blended-learning curriculum. Using the two measures, the authors identify timing behaviours of participants and examine the effects that timing has on teacher self-efficacy after completing the course. The two measures and visualizations demonstrated in this paper yield useful individual-level variables for course timing that can be used for further study on the effects on learning outcomes.

[1]  Joseph Jay Williams,et al.  Beyond Time-on-Task: The Relationship between Spaced Study and Certification in MOOCs , 2015, J. Learn. Anal..

[2]  Phillip L. Ackerman,et al.  What else do college students "do" while studying? An investigation of multitasking , 2014, Comput. Educ..

[3]  Susan Koons,et al.  Correlates and consequences of behavioral procrastination: The effects of academic procrastination, self-consciousness, self-esteem and self-handicapping. , 2000 .

[4]  Doug Rohrer,et al.  Interleaving Helps Students Distinguish among Similar Concepts , 2012 .

[5]  Il-Hyun Jo,et al.  Impact of Learner’s Time Management Strategies on Achievement in an e-learning Environment: A Learning Analytics Approach , 2013 .

[6]  Neil Mercer,et al.  The Seeds of Time: Why Classroom Dialogue Needs a Temporal Analysis , 2008 .

[7]  J. Carroll A Model of School Learning , 1963, Teachers College Record: The Voice of Scholarship in Education.

[8]  Edward Vul,et al.  PSYCHOLOGICAL SCIENCE Research Article Spacing Effects in Learning A Temporal Ridgeline of Optimal Retention , 2022 .

[9]  Gustaf Neumann,et al.  Practice and Repetition during Exam Preparation in Blended Learning Courses: Correlations with Learning Results , 2014, J. Learn. Anal..

[10]  Kimberly A. Lawless,et al.  Massive Open Online Courses (MOOCs) and the Technologies that Support Learning with Them , 2015 .

[11]  Harry P. Bahrick,et al.  Perceptions of past research. , 1992 .

[12]  Aaron S. Benjamin,et al.  What makes distributed practice effective? , 2010, Cognitive Psychology.

[13]  Lawrence P. Gallagher,et al.  What Makes Professional Development Effective? Strategies That Foster Curriculum Implementation , 2007 .

[14]  T. Wubbels,et al.  COLLEGE TEACHING IN LEGAL EDUCATION: Teaching Method, Students' Time-on-Task, and Achievement , 1999 .

[15]  J. Greene,et al.  Predictors of Retention and Achievement in a Massive Open Online Course , 2015 .

[16]  Joseph R. Ferrari,et al.  Procrastination as a Self-Handicap for Men and Women: A Task-Avoidance Strategy in a Laboratory Setting ☆ , 2000 .

[17]  Olivier Le Bohec,et al.  Procrastination, participation, and performance in online learning environments , 2011, Comput. Educ..

[18]  J. Lemke The Long and the Short of It: Comments on Multiple Timescale Studies of Human Activity , 2001 .

[19]  Melody Wiseheart,et al.  Spacing in a simulated undergraduate classroom: Long-term benefits for factual and higher-level learning , 2015 .

[20]  Kimberly A. Lawless,et al.  'Spread Index:' A Metric for Identifying When Work is Completed and Quantifying Procrastination in Self-Paced, Online Teacher Professional Development Courses , 2016 .

[21]  Andrew D. Ho,et al.  Changing “Course” , 2014 .

[22]  Barbara Means,et al.  Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies , 2009 .

[23]  C. Wolters,et al.  Understanding Procrastination from a Self-Regulated Learning Perspective. , 2003 .

[24]  Shana K. Carpenter,et al.  Using Spacing to Enhance Diverse Forms of Learning: Review of Recent Research and Implications for Instruction , 2012 .

[25]  Chien-Wen Shen,et al.  Learning in massive open online courses: Evidence from social media mining , 2015, Comput. Hum. Behav..

[26]  John Dunlosky,et al.  Improving Students’ Learning With Effective Learning Techniques: Promising Directions From Cognitive and Educational Psychology , 2012 .

[27]  S. Brownlow,et al.  Putting off until tomorrow what is better done today: Academic procrastination as a function of motivation toward college work. , 2000 .

[28]  Kamden K. Strunk,et al.  Development and validation of a 2 × 2 model of time-related academic behavior: Procrastination and timely engagement , 2013 .

[29]  Marek Hatala,et al.  Does Time-on-task Estimation Matter? Implications on Validity of Learning Analytics Findings , 2016, J. Learn. Anal..

[30]  N. Karweit Time-on-Task Reconsidered: Synthesis of Research on Time and Learning. , 1984 .

[31]  J. Ferrari,et al.  Identity orientation and decisional strategies , 1996 .

[32]  Kimberly A. Lawless,et al.  'Spacing Count:' A Metric for Identifying the Degree to Which Work Is Spaced out and Distributed over Time in Distance Learning and Online Professional Development Courses , 2016 .

[33]  Brian Clifton,et al.  Advanced Web Metrics with Google Analytics , 2008 .

[34]  Patrick R. Lowenthal,et al.  In Search of Quality: Using Quality Matters to Analyze the Quality of Massive, Open, Online Courses (MOOCs) , 2015 .

[35]  Guillaume Durand,et al.  Challenges to Research in MOOCs , 2014 .

[36]  J. Broadbent,et al.  Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review , 2015, Internet High. Educ..

[37]  郭金鈤,et al.  大規模開放式線上課程學習行為研究-以社交媒體資料探勘為例;Learning in Massive Open Online Courses:Evidence from Social Media Mining , 2015 .

[38]  Doug Rohrer Student Instruction Should Be Distributed Over Long Time Periods , 2015 .

[39]  Shirley Williams,et al.  MOOCs: A systematic study of the published literature 2008-2012 , 2013 .

[40]  Simon A. Fraser Does Time-on-task Estimation Matter? Implications for the Validity of Learning Analytics Findings , 2016 .

[41]  Wolff-Michael Roth Learning Science: A Singular Plural Perspective , 2006 .

[42]  Gregory Schraw,et al.  Doing the Things We Do: A Grounded Theory of Academic Procrastination. , 2007 .

[43]  Robert E. Slavin,et al.  Measuring Time-On-Task: Issues of Timing, Sampling and Definition. , 1980 .

[44]  Joseph R. Ferrari,et al.  Procrastinators and perfect behavior: An exploratory factor analysis of self-presentation, self-awareness, and self-handicapping components. , 1992 .

[45]  Judith Ramsay,et al.  Massive open online courses (MOOCs): Insights and challenges from a psychological perspective , 2015, Br. J. Educ. Technol..

[46]  Cheryl L. Meyer Academic Procrastination and Self-Handicapping: Gender Differences in Response to Noncontingent Feedback , 2000 .

[47]  Hiroshi Kato,et al.  Procrastination and other learning behavioral types in e-learning and their relationship with learning outcomes , 2015 .

[48]  John Dunlosky,et al.  Optimizing schedules of retrieval practice for durable and efficient learning: how much is enough? , 2011, Journal of experimental psychology. General.

[49]  J. J. Donovan,et al.  A meta-analytic review of the distribution of practice effect: Now you see it, now you don't. , 1999 .

[50]  Scott W. Brown,et al.  Completion, Time-in-intervention, and Movement: Relationships between Dimensions of Participation in oTPD and Knowledge Growth , 2016 .

[51]  A. Lachner,et al.  Procrastination and self-efficacy: Tracing vicious and virtuous circles in self-regulated learning , 2014 .

[52]  Robert F. Boruch,et al.  Moving Through MOOCs , 2014 .

[53]  J. Willems Flexible Learning: Implications of “when‐ever”, “where‐ever” and “what‐ever” , 2005 .

[54]  R. Klassen,et al.  Procrastination and Motivation of Undergraduates with Learning Disabilities: A Mixed–Methods Inquiry , 2008 .

[55]  Karen Buro,et al.  Academic procrastination: The pattern and correlates of behavioural postponement , 2006 .

[56]  A. C. Butler,et al.  The critical role of retrieval practice in long-term retention , 2011, Trends in Cognitive Sciences.

[57]  Frank N. Dempster,et al.  The Spacing Effect: Research and Practice. , 1990 .

[58]  Luc Paquette,et al.  A Longitudinal Study on Learner Career Advancement in MOOCs , 2014, J. Learn. Anal..