Uncovering student learning profiles with a video annotation tool: reflective learning with and without instructional norms

This study explores the types of learning profiles that evolve from student use of video annotation software for reflective learning. The data traces from student use of the software were analysed across four undergraduate courses with differing instructional conditions. That is, the use of graded or non-graded self-reflective annotations. Using hierarchical cluster analysis, four profiles of students emerged: minimalists, task-oriented, disenchanted, and intensive users. Students enrolled in one of the courses where grading of the video annotation software was present, were exposed to either another graded course (annotations graded) or non-graded course (annotations not graded) in their following semester of study. Further analysis revealed that in the presence of external factors (i.e., grading), more students fell within the task-oriented and intensive clusters. However, when the external factor is removed, most students exhibited the disenchanted and minimalist learning behaviors. The findings provide insight into how students engage with the different features of a video annotation tool when there are graded or non-graded annotations and, most importantly, that having experience with one course where there are external factors influencing students’ use of the tool is not sufficient to sustain their learning behaviour in subsequent courses where the external factor is removed.

[1]  Hendrik Drachsler,et al.  Translating Learning into Numbers: A Generic Framework for Learning Analytics , 2012, J. Educ. Technol. Soc..

[2]  P. Pintrich,et al.  Motivational and self-regulated learning components of classroom academic performance. , 1990 .

[3]  Michail N. Giannakos,et al.  Collecting and making sense of video learning analytics , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[4]  Jim E. Greer,et al.  The who, what, when, and why of lecture capture , 2011, LAK.

[5]  Shane Dawson,et al.  Using technology to encourage self-directed learning: The Collaborative Lecture Annotation System (CLAS) , 2012 .

[6]  Frank J. Bernieri,et al.  Setting limits on children's behavior: The differential effects of controlling vs. informational styles on intrinsic motivation and creativity , 1984 .

[7]  David Metcalf,et al.  Blended eLearning: Integrating Knowledge, Performance Support, and Online Learning , 2002 .

[8]  Dragan Gasevic,et al.  Analytics of the effects of video use and instruction to support reflective learning , 2014, LAK.

[9]  R. Hulsman,et al.  Reflective teaching of medical communication skills with DiViDU: assessing the level of student reflection on recorded consultations with simulated patients. , 2009, Patient education and counseling.

[10]  R. Ryan,et al.  Relation of reward contingency and interpersonal context to intrinsic motivation: A review and test using cognitive evaluation theory. , 1983 .

[11]  J. McKenzie,et al.  Students’ engagement with technologies: Implications for university practice , 2011 .

[12]  Shane Dawson,et al.  The Collaborative Lecture Annotation System (CLAS): A New TOOL for Distributed Learning , 2013, IEEE Transactions on Learning Technologies.

[13]  Charles R. Graham,et al.  A framework for institutional adoption and implementation of blended learning in higher education , 2013, Internet High. Educ..

[14]  Steve Drew,et al.  The literature landscape of blended learning in higher education: the need for better understanding of academic blended practice , 2013 .

[15]  Geraldine Clarebout,et al.  Regulation of tool-use within a blended course: Student differences and performance effects , 2013, Comput. Educ..

[16]  Jean Hartley,et al.  Case study research , 2004 .

[17]  Philip H. Winne,et al.  How Software Technologies Can Improve Research on Learning and Bolster School Reform , 2006 .

[18]  Geraldine Clarebout,et al.  Tool-use in a blended undergraduate course: In Search of user profiles , 2011, Comput. Educ..

[19]  Robert M. Gonyea.  Self‐reported data in institutional research: Review and recommendations , 2005 .

[20]  G. Gibbs,et al.  Conditions Under Which Assessment Supports Students’ Learning , 2005 .

[21]  English Emmenegger Patrick.  Dunning, Thad (2012): Natural Experiments in the Social Sciences: A Design­Based Approach. Cambridge: , 2012 .

[22]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[23]  Edward Cutrell,et al.  VidWiki: enabling the crowd to improve the legibility of online educational videos , 2014, CSCW.

[24]  Walter L. Leite,et al.  A Reliability Generalization Study of the Marlowe-Crowne Social Desirability Scale , 2002 .

[25]  David Bargeron,et al.  Annotations for Streaming Video on the Web: System Design and Usage Studies , 1999, Comput. Networks.

[26]  Philip H. Winne,et al.  Examining trace data to explore self-regulated learning , 2007 .

[27]  Christopher P. Cerasoli,et al.  Intrinsic motivation and extrinsic incentives jointly predict performance: a 40-year meta-analysis. , 2014, Psychological bulletin.

[28]  Chun-Yi Lee,et al.  Exploring problem solving patterns and their impact on learning achievement in a blended learning environment , 2011, Comput. Educ..

[29]  N. Vaughan.  Blended Learning in Higher Education , 2007 .

[30]  Steven E. Higgins,et al.  Effects of traditional, blended and e-learning on students' achievement in higher education , 2013, J. Comput. Assist. Learn..

[31]  K. Eisenhardt.  Building theories from case study research , 1989, STUDI ORGANIZZATIVI.

[32]  Johannes Magenheim,et al.  Integration of a Video Annotation Tool into a Coactive Learning and Working Environment , 2010, Key Competencies in the Knowledge Society.

[33]  Patricia A. Alexander,et al.  Interrelationship of Knowledge, Interest, and Recall: Assessing a Model of Domain Learning , 1995 .

[34]  Daniel C. Moos,et al.  Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? , 2008 .

[35]  Meg Colasante,et al.  Using video annotation to reflect on and evaluate physical education pre-service teaching practice , 2011 .

[36]  D. Perkins.  The Fingertip Effect: How Information-Processing Technology Shapes Thinking , 1985 .

[37]  M. Hannafin,et al.  Video Annotation Tools , 2009 .

[38]  J. H. Ward.  Hierarchical Grouping to Optimize an Objective Function , 1963 .

[39]  Thad Dunning,et al.  Natural Experiments in the Social Sciences , 2012 .

[40]  Sasha A. Barab,et al.  Hypermedia navigation: Profiles of hypermedia users , 1997 .

[41]  Michail N. Giannakos,et al.  Making Sense of Video Analytics: Lessons Learned from Clickstream Interactions, Attitudes, and Learning Outcome in a Video-Assisted Course. , 2015 .

[42]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[43]  Thomas M. Duffy,et al.  Online learning: Learner characteristics and their approaches to managing learning , 2009 .

[44]  Kevin R. Guidry,et al.  Engaging online learners: The impact of Web-based learning technology on college student engagement , 2010, Comput. Educ..

[45]  Philip H. Winne,et al.  Exploring students’ calibration of self reports about study tactics and achievement , 2002 .

[46]  Ulrik Schroeder,et al.  Video-Based Learning: A Critical Analysis of The Research Published in 2003-2013 and Future Visions , 2014 .

[47]  Dorit Maor,et al.  Exploring Learning Analytics as Indicators of Study Behaviour , 2012 .

[48]  Meg Colasante,et al.  ‘mat’: A New Media Annotation Tool with an Interactive Learning Cycle for Application in Tertiary Education , 2009 .

[49]  Philip H. Winne,et al.  Learning Strategies, Study Skills, and Self-Regulated Learning in Postsecondary Education , 2013 .

[50]  Jane E. Klobas,et al.  A task-technology fit view of learning management system impact , 2009, Comput. Educ..

[51]  Xiangming Mu,et al.  Towards effective video annotation: An approach to automatically link notes with video content , 2010, Comput. Educ..

[52]  Yannick Prié,et al.  Leveraging Video Annotations in Video-based e-Learning , 2014, CSEDU.

[53]  Lázaro Rodríguez Ariza,et al.  Blended learning in higher education: Students' perceptions and their relation to outcomes , 2011, Comput. Educ..

[54]  D. Garrison,et al.  Blended learning: Uncovering its transformative potential in higher education , 2004, Internet High. Educ..

[55]  R. Yin,et al.  Case Study Research: Design and Methods (4th ed. , 2009 .

[56]  J. McKenzie,et al.  Students' experiences and expectations of technologies: An Australian study designed to inform planning and development decisions , 2013 .