Making Sense of Video Analytics: Lessons Learned from Clickstream Interactions, Attitudes, and Learning Outcome in a Video-Assisted Course.

Online video lectures have been considered an instructional media for various pedagogic approaches, such as the flipped classroom and open online courses. In comparison to other instructional media, online video affords the opportunity for recording student clickstream patterns within a video lecture. Video analytics within lecture videos may provide insights into student learning performance and inform the improvement of video-assisted teaching tactics. Nevertheless, video analytics are not accessible to learning stakeholders, such as researchers and educators, mainly because online video platforms do not broadly share the interactions of the users with their systems. For this purpose, we have designed an open-access video analytics system for use in a video-assisted course. In this paper, we present a longitudinal study, which provides valuable insights through the lens of the collected video analytics. In particular, we found that there is a relationship between video navigation (repeated views) and the level of cognition/thinking required for a specific video segment. Our results indicated that learning performance progress was slightly improved and stabilized after the third week of the video-assisted course. We also found that attitudes regarding easiness, usability, usefulness, and acceptance of this type of course remained at the same levels throughout the course. Finally, we triangulate analytics from diverse sources, discuss them, and provide the lessons learned for further development and refinement of video-assisted courses and practices.

[1]  Michail N. Giannakos,et al.  Educational webcasts' acceptance: Empirical examination and the role of experience , 2013, Br. J. Educ. Technol..

[2]  Dave McAlpine,et al.  'Streaming' Best Practices: Using Digital Video-Teaching Segments in the FL/ESL Methods Course , 2002 .

[3]  Shane Dawson,et al.  The Collaborative Lecture Annotation System (CLAS): A New TOOL for Distributed Learning , 2013, IEEE Transactions on Learning Technologies.

[4]  Michael J. Hannafin,et al.  Guidelines for using locus of instructional control in the design of computer-assisted instruction , 1984 .

[5]  Margaret M Maag.  Podcasting and MP3 Players: Emerging Education Technologies , 2006, Computers, informatics, nursing : CIN.

[6]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[7]  Chris Evans,et al.  The effectiveness of m-learning in the form of podcast revision lectures in higher education , 2008, Comput. Educ..

[8]  Tanja Jadin,et al.  Learning with E-lectures: The Meaning of Learning Strategies , 2009, J. Educ. Technol. Soc..

[9]  Eric W. T. Ngai,et al.  Empirical examination of the adoption of WebCT using TAM , 2007, Comput. Educ..

[10]  Gregory D. Abowd,et al.  Lessons learned from eClass: Assessing automated capture and access in the classroom , 2004, TCHI.

[11]  Kathy Robinson,et al.  Podcasts are not for everyone , 2012, Br. J. Educ. Technol..

[12]  Wolfgang Effelsberg,et al.  Social Video: A Collaborative Video Annotation Environment to Support E-Learning , 2013 .

[13]  A. Röhl,et al.  The Flipped Classroom: An Opportunity to Engage Millennial Students through Active Learning Strategies. , 2013 .

[14]  James D. Foley,et al.  Evaluating a Web Lecture Intervention in a Human–Computer Interaction Course , 2006, IEEE Transactions on Education.

[15]  Simon B. Heilesen.  What is the academic efficacy of podcasting? , 2010, Comput. Educ..

[16]  Nian-Shing Chen,et al.  The Open Educational Resources (OER) Movement: Free Learning for All Students , 2012, 2012 IEEE 12th International Conference on Advanced Learning Technologies.

[17]  Rob Van Zanten,et al.  Purpose and preference in educational podcasting , 2012, Br. J. Educ. Technol..

[18]  P. Robert-Jan Simons,et al.  Streaming video to enhance students' reflection in dance education , 2009, Comput. Educ..

[19]  Michail N. Giannakos,et al.  Open Service for Video Learning Analytics , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[20]  Gary R. Morrison,et al.  EXPERIMENTAL RESEARCH METHODS , 2003 .

[21]  Milos Ljubojevic,et al.  Using supplementary video in multimedia instruction as a teaching tool to increase efficiency of learning and quality of experience , 2014 .

[22]  Volker Hegelheimer,et al.  Integrating CALL into the classroom: the role of podcasting in an ESL listening strategies course , 2007, ReCALL.

[23]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[24]  Michail N. Giannakos,et al.  Analytics on video-based learning , 2013, LAK '13.

[25]  Krzysztof Z. Gajos,et al.  Understanding in-video dropouts and interaction peaks inonline lecture videos , 2014, L@S.

[26]  Armando Fox,et al.  From MOOCs to SPOCs , 2013, CACM.

[27]  Francis Donkor,et al.  Assessment of learner acceptance and satisfaction with video-based instructional materials for teaching practical skills at a distance , 2011 .

[28]  Chih-Ming Chen,et al.  Effects of Different Video Lecture Types on Sustained Attention, Emotion, Cognitive Load, and Learning Performance , 2015, IIAI-AAI.

[29]  Jorge Aguilera,et al.  Video-sharing educational tool applied to the teaching in renewable energy subjects , 2014, Comput. Educ..

[30]  Michail N. Giannakos,et al.  Exploring the video-based learning research: A review of the literature , 2013, Br. J. Educ. Technol..

[31]  Tomoko Traphagan,et al.  Impact of class lecture webcasting on attendance and learning , 2010 .

[32]  Claire Jarvis,et al.  Acknowledging the ‘forgotten’ and the ‘unknown’: The role of video podcasts for supporting field-based learning , 2009 .

[33]  Ruimin Shen,et al.  Analyzing Student Viewing Patterns in Lecture Videos , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[34]  In Lee,et al.  Learners' acceptance of e-learning in South Korea: Theories and results , 2009, Comput. Educ..

[35]  Sungmin Park,et al.  Educational usages of podcasting , 2008, Br. J. Educ. Technol..

[36]  Flora McMartin,et al.  Costs, Culture, and Complexity: An Analysis of Technology Enhancements in a Large Lecture Course at UC Berkeley , 2003 .