Identifying engagement patterns with video annotation activities: A case study in professional development

The rapid growth of blended and online learning models in higher education has resulted in a parallel increase in the use of audio-visual resources among students and teachers. Despite the heavy adoption of video resources, there have been few studies investigating their effect on learning processes and even less so in the context of academic development. This paper uses learning analytic techniques to examine how academic teaching staff engage with a set of prescribed videos and video annotations in a professional development course. The data was collected from two offerings of the course at a large research-intensive university in Australia. The data was used to identify patterns of activity and transition states as users engaged with the course videos and video annotations. Latent class analysis and hidden Markov models were used to characterise the evolution of engagement throughout the course. The results provide a detailed description of the evolution of learner engagement that can be readily translated into action aimed at increasing the quality of the learning experience.

[1]  Philip H. Winne,et al.  How Software Technologies Can Improve Research on Learning and Bolster School Reform , 2006 .

[2]  J. H. Ward.  Hierarchical Grouping to Optimize an Objective Function , 1963 .

[3]  Marek Hatala,et al.  Analytics of communities of inquiry: Effects of learning technology use on cognitive presence in asynchronous online discussions , 2015, Internet High. Educ..

[4]  Geraldine Clarebout,et al.  Regulation of tool-use within a blended course: Student differences and performance effects , 2013, Comput. Educ..

[5]  Philip H. Winne,et al.  Studying as self-regulated learning. , 1998 .

[6]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[7]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[8]  Steve Drew,et al.  The literature landscape of blended learning in higher education: the need for better understanding of academic blended practice , 2013 .

[9]  Xiangming Mu,et al.  Towards effective video annotation: An approach to automatically link notes with video content , 2010, Comput. Educ..

[10]  Marcelo Worsley,et al.  Programming Pluralism: Using Learning Analytics to Detect Patterns in the Learning of Computer Programming , 2014, Journal of the Learning Sciences.

[11]  Sasha A. Barab,et al.  Hypermedia navigation: Profiles of hypermedia users , 1997 .

[12]  David Bargeron,et al.  Annotations for Streaming Video on the Web: System Design and Usage Studies , 1999, Comput. Networks.

[13]  Philip H. Winne,et al.  Examining trace data to explore self-regulated learning , 2007 .

[14]  Shane Dawson,et al.  The pairing of lecture recording data with assessment scores: a method of discovering pedagogical impact , 2013, LAK '13.

[15]  Meg Colasante,et al.  Using video annotation to reflect on and evaluate physical education pre-service teaching practice , 2011 .

[16]  Jim E. Greer,et al.  The who, what, when, and why of lecture capture , 2011, LAK.

[17]  Philip H. Winne,et al.  Exploring students’ calibration of self reports about study tactics and achievement , 2002 .

[18]  Ulrik Schroeder,et al.  Video-Based Learning: A Critical Analysis of The Research Published in 2003-2013 and Future Visions , 2014 .

[19]  Dorit Maor,et al.  Exploring Learning Analytics as Indicators of Study Behaviour , 2012 .

[20]  B. Zimmerman.  Investigating Self-Regulation and Motivation: Historical Background, Methodological Developments, and Future Prospects , 2008, American Educational Research Journal.