Video and learning: a systematic review (2007--2017)

Video materials have become an integral part of university learning and teaching practice. While empirical research concerning the use of videos for educational purposes has increased, the literature lacks an overview of the specific effects of videos on diverse learning outcomes. To address such a gap, this paper presents preliminary results of a large-scale systematic review of peer-reviewed empirical studies published from 2007-2017. The study synthesizes the trends observed through the analysis of 178 papers selected from the screening of 2531 abstracts. The findings summarize the effects of manipulating video presentation, content and tasks on learning outcomes, such as recall, transfer, academic achievement, among others. The study points out the gap between large-scale analysis of fine-grained data on video interaction and experimental findings reliant on established psychological instruments. Narrowing this gap is suggested as the future direction for the research on video-based learning.

[2]  Wolfgang Schnotz,et al.  Effects of animation's speed of presentation on perceptual processing and learning , 2010 .

[3]  Zhongzhou Chen,et al.  Comparing the use of multimedia animations and written solutions in facilitating problem solving , 2013 .

[4]  Richard E. Mayer,et al.  e-Learning and the Science of Instruction , 2016 .

[5]  David Richard Moore,et al.  E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning , 2006 .

[6]  Selen Türkay,et al.  The effects of whiteboard animations on retention and subjective experiences when learning advanced physics topics , 2016, Comput. Educ..

[7]  E. Rose,et al.  The Flipped Classroom in Emergency Medicine Using Online Videos with Interpolated Questions. , 2016, The Journal of emergency medicine.

[8]  Chantal Levesque-Bristol,et al.  Verbal and behavioral cues: creating an autonomy-supportive classroom , 2014 .

[10]  Vincent Aleven,et al.  Pause, predict, and ponder: use of narrative videos to improve cultural discussion and learning , 2008, CHI.

[11]  Sridhar Iyer,et al.  Comparison of English versus Hindi Medium Students for Programming Abilities Acquired through Video-Based Instruction , 2012, 2012 IEEE Fourth International Conference on Technology for Education.

[12]  Christoph Meinel,et al.  Implementation and Evaluation of Digital E-Lecture Annotation in Learning Groups to Foster Active Learning , 2015, IEEE Transactions on Learning Technologies.

[13]  Manjula D. Sharma,et al.  Conceptual change through vicarious learning in an authentic physics setting , 2007 .

[14]  Qing Chen,et al.  VisMOOC: Visualizing video clickstream data from massive open online courses , 2015, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[15]  Thomas Schildhauer,et al.  Video and Online Learning: Critical Reflections and Findings from the Field , 2015 .

[16]  Tamara van Gog,et al.  Showing a model's eye movements in examples does not improve learning of problem-solving tasks , 2016, Comput. Hum. Behav..

[17]  Michail N. Giannakos,et al.  Exploring the video-based learning research: A review of the literature , 2013, Br. J. Educ. Technol..

[18]  Halimah Badioze Zaman,et al.  Different Visualization Types in Multimedia Learning: A Comparative Study , 2011, IVIC.

[19]  Daniel J. Hoppe,et al.  The use of video before arthroscopic shoulder surgery to enhance patient recall and satisfaction: a randomized-controlled study. , 2014, Journal of shoulder and elbow surgery.

[20]  M. M. King,et al.  Designing Effective E-Learning Environments - Should We Use Still Pictures, Animations or Interactivity? , 2009 .

[21]  Bongshin Lee,et al.  A Comparative Evaluation on Online Learning Approaches using Parallel Coordinate Visualization , 2016, CHI.

[22]  Silke Schworm,et al.  Does personalization matter? The role of social cues in instructional explanations , 2012, Intell. Decis. Technol..

[23]  Cristina Pomales-García,et al.  E-training: Can young and older users be accommodated with the same interface? , 2010, Comput. Educ..

[24]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[25]  Liz Jones,et al.  The use of lecture recordings in higher education: A review of institutional, student, and lecturer issues , 2015, Education and Information Technologies.

[26]  David W. Dinehart,et al.  Pre- and Post-Class Student Viewing Behaviors for Recorded Videos in an Inverted Sophomore Mechanics Course , 2016 .

[27]  Cheryl I. Johnson,et al.  A Testing Effect with Multimedia Learning , 2009 .

[28]  Robert K. Atkinson,et al.  Enhancing Learning from Different Visualizations by Self-Explanation Prompts , 2013 .

[29]  L. Major,et al.  Using video to support in-service teacher professional development: the state of the field, limitations and possibilities , 2017 .

[30]  Manjula D. Sharma,et al.  Raising cognitive load with linear multimedia to promote conceptual change , 2008 .

[31]  T. B. Garland,et al.  Rotational perspective and learning procedural tasks from dynamic media , 2013, Comput. Educ..

[32]  Halimah Badioze Zaman,et al.  3-D versus 2-D Animation in Multimedia Application: Is the Extra Effort Worth It? , 2011, ICDIPC.

[33]  Stephen Wee Hun Lim,et al.  Observing the Testing Effect using Coursera Video-Recorded Lectures: A Preliminary Study , 2016, Front. Psychol..

[34]  Annie Lang,et al.  The limited capacity model of mediated message processing , 2000 .

[35]  K. Nielson,et al.  Memory modulation in the classroom: Selective enhancement of college examination performance by arousal induced after lecture , 2012, Neurobiology of Learning and Memory.

[36]  Stephen Twigg,et al.  A randomized controlled pilot trial comparing the impact of access to clinical endocrinology video demonstrations with access to usual revision resources on medical student performance of clinical endocrinology skills , 2013, BMC Medical Education.

[37]  Geza Kovacs,et al.  Effects of In-Video Quizzes on MOOC Lecture Viewing , 2016, L@S.

[38]  T. Khan,et al.  A study assessing the impact of different teaching modalities for pharmacy students in a Cardio-Pulmonary Resuscitation (CPR) course. , 2013, Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society.

[39]  Insook Han,et al.  Multimedia case-based learning to enhance pre-service teachers' knowledge integration for teaching with technologies , 2013 .

[40]  R. M. Rias,et al.  Modality effects in multimedia learning: A case study , 2011, 2011 3rd International Congress on Engineering Education (ICEED).

[41]  R. Mayer,et al.  Increased interestingness of extraneous details in a multimedia science presentation leads to decreased learning. , 2008, Journal of experimental psychology. Applied.

[42]  Angela Carbone,et al.  Systematic review methodology in higher education , 2012 .

[43]  Dongsik Kim,et al.  Effects of WOE Presentation Types Used in Pre-training on the Cognitive Load and Comprehension of Content in Animation-Based Learning Environments , 2016, J. Educ. Technol. Soc..

[44]  T. Gog,et al.  Development of an instrument for measuring different types of cognitive load , 2013, Behavior Research Methods.

[45]  Patrick Jermann,et al.  Your click decides your fate: Inferring Information Processing and Attrition Behavior from MOOC Video Clickstream Interactions , 2014, Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs.

[46]  Noah L. Schroeder.  A Preliminary Investigation of the Influences of Refutation Text and Instructional Design , 2016, Technology, Knowledge and Learning.

[47]  Xiaoting Wang,et al.  Identifying the Potential of Danmaku Video from Eye Gaze Data , 2016, 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT).

[48]  Ismo Hakala,et al.  The effect of time and place dependence when utilizing video lectures , 2009, 2009 EAEEIE Annual Conference.

[49]  George Siemens,et al.  Expanding the scope of learning analytics data: preliminary findings on attention and self-regulation using wearable technology , 2017, LAK.

[50]  Stephan Schwan,et al.  Extending social cue based principles of multimedia learning beyond their immediate effects , 2014 .

[51]  Michael E. Lantz,et al.  Effectiveness of clickers: Effect of feedback and the timing of questions on learning , 2014, Comput. Hum. Behav..

[52]  M. Chi,et al.  The ICAP Framework: Linking Cognitive Engagement to Active Learning Outcomes , 2014 .

[53]  Fred Paas,et al.  Effects of Subtitles, Complexity, and Language Proficiency on Learning From Online Education Videos , 2017, J. Media Psychol. Theor. Methods Appl..

[54]  Ulrik Schroeder,et al.  Video-Based Learning: A Critical Analysis of The Research Published in 2003-2013 and Future Visions , 2014 .

[55]  Robin H. Kay,et al.  Exploring the use of video podcasts in education: A comprehensive review of the literature , 2012, Comput. Hum. Behav..

[56]  Ömer Faruk Vural,et al.  The Impact of a Question-Embedded Video-based Learning Tool on E-learning * , 2013 .

[57]  Anastasios A. Economides,et al.  Learning Analytics and Educational Data Mining in Practice: A Systematic Literature Review of Empirical Evidence , 2014, J. Educ. Technol. Soc..

[58]  Suzanne K. Kearns,et al.  Guided Mental Practice: An Instructional Strategy for Asynchronous e-Learning of Pilot Safety Skills , 2010 .

[59]  Letitia M. Pohl,et al.  Instructional Videos in an Online Engineering Economics Course , 2015 .

[60]  Yan Tao,et al.  Effects of Different Video Types about Procedural Knowledge on Cognitive Load, Learning Flow, and Performance , 2015, 2015 International Conference of Educational Innovation through Technology (EITT).

[61]  Robert K. Atkinson,et al.  Using animations and visual cueing to support learning of scientific concepts and processes , 2011, Comput. Educ..

[62]  Patrick Jermann,et al.  MOOC Video Interaction Patterns: What Do They Tell Us? , 2015, EC-TEL.

[63]  Dragan Gasevic,et al.  Uncovering student learning profiles with a video annotation tool: reflective learning with and without instructional norms , 2016, Educational Technology Research and Development.

[64]  Katharina Scheiter,et al.  Can differences in learning strategies explain the benefits of learning from static and dynamic visualizations? , 2011, Comput. Educ..

[65]  T. J. Ryan.  Assessment & Efficacy of an M-Learning Course in Industrial Hygiene and Occupational Safety , 2008, EIAT/IETA.

[66]  Sidney K. D'Mello,et al.  A Review and Meta-Analysis of Multimodal Affect Detection Systems , 2015, ACM Comput. Surv..

[67]  M. Leiner,et al.  Comparison of methods for teaching developmental milestones to pediatric residents , 2011, World journal of pediatrics : WJP.

[68]  Huifen Lin,et al.  Facilitating Learning from Animated Instruction: Effectiveness of Questions and Feedback as Attention-directing Strategies , 2011, J. Educ. Technol. Soc..

[69]  D. Leutner,et al.  Instructional animation versus static pictures: A meta-analysis , 2007 .

[70]  Ralf Rummer,et al.  Integrating written text and graphics as a desirable difficulty in long-term multimedia learning , 2016, Comput. Hum. Behav..

[71]  Thomas M. Duffy,et al.  Connecting online learners with diverse local practices: the design of effective common reference points for conversation , 2009 .

[72]  Richard E. Mayer,et al.  Creating retroactive and proactive interference in multimedia learning , 2007 .

[73]  Yanghee Kim,et al.  Effects of learner–instructor relationship-building strategies in online video instruction , 2015 .

[74]  Tobias Lauer,et al.  A study of algorithm animations on mobile devices , 2007, SIGCSE.

[75]  Albert D. Ritzhaupt,et al.  Effects of captions and time-compressed video on learner performance and satisfaction , 2015, Comput. Hum. Behav..

[76]  Pornsook Tantrarungroj,et al.  Effect of embedded streaming video strategy in an online learning environment on the learning of neuroscience , 2008 .

[77]  Michelene T. H. Chi,et al.  Observing Tutorial Dialogues Collaboratively: Insights About Human Tutoring Effectiveness From Vicarious Learning , 2008, Cogn. Sci..

[78]  Brian C. Nelson,et al.  Effects of visual cues and self-explanation prompts: empirical evidence in a multimedia environment , 2016, Interact. Learn. Environ..

[79]  Lorenzo Vigentini,et al.  Analytics of Learner Video Use , 2017 .

[80]  Guillaume Zufferey,et al.  Watching MOOCs together: investigating co-located MOOC study groups , 2014 .

[81]  Chi-Un Lei,et al.  Data-assisted instructional video revision via course-level exploratory video retention analysis , 2017, LAK.

[82]  Halimah Badioze Zaman,et al.  Looking at the effects of various multimedia approach in student learning: a case study , 2013, ICUIMC '13.

[83]  Marie-Luce Bourguet,et al.  Experimental study to elicit effective multimodal behaviour in pedagogical agents , 2016, DAA '16.

[84]  Jiahui Wang,et al.  Instructor presence in instructional video: Effects on visual attention, recall, and perceived learning , 2017, Comput. Hum. Behav..

[85]  Frank Fischer,et al.  Fostering the analytical competency of pre-service teachers in a computer-supported case-based learning environment: A matter of perspective? , 2012, Interact. Learn. Environ..

[86]  Glennys O'Brien,et al.  Analytical Thinking, Analytical Action: Using Prelab Video Demonstrations and e-Quizzes To Improve Undergraduate Preparedness for Analytical Chemistry Practical Classes , 2016 .

[87]  L. Major,et al.  Using video to support in-service teacher professional development: the state of the field, limitations and possibilities , 2017 .

[88]  Kenneth R. Koedinger,et al.  Learning is Not a Spectator Sport: Doing is Better than Watching for Learning from a MOOC , 2015, L@S.

[89]  Peter E. Doolittle,et al.  Revisiting the Seductive Details Effect in Multimedia Learning: Context-dependency of Seductive Details , 2015 .

[90]  Ludmila C. Ortegano-Layne,et al.  Do classroom exemplars promote the application of principles in teacher education? A comparison of videos, animations, and narratives , 2008 .

[91]  John C. Nesbit,et al.  Learning from Animated Concept Maps with Concurrent Audio Narration , 2011 .

[92]  Ting-Sheng Weng,et al.  Dancing mathematics: exploration and application of 3D calculus instruction , 2011 .

[93]  Mosa Allafi A-Rahman,et al.  Effects of multimedia characteristics on novice CAD learners’ practice performance , 2012 .

[95]  Pavlo D. Antonenko,et al.  Effects of segmenting, signalling, and weeding on learning from educational video , 2012 .

[96]  Maria T. Gallardo-Williams,et al.  Effectiveness of Student-Generated Video as a Teaching Tool for an Instrumental Technique in the Organic Chemistry Laboratory , 2016 .

[97]  R. Mayer,et al.  Interactive Multimodal Learning Environments , 2007 .

[98]  Steve Hand,et al.  The Effect of Mobile Phone Screen Size on Video Based Learning , 2008, J. Softw..

[99]  Wil M. P. van der Aalst,et al.  Learning Analytics on Coursera Event Data: A Process Mining Approach , 2015, SIMPDA.

[100]  Michail N. Giannakos,et al.  Making Sense of Video Analytics: Lessons Learned from Clickstream Interactions, Attitudes, and Learning Outcome in a Video-Assisted Course. , 2015 .

[101]  John Cosmas,et al.  Investigating the use and effectiveness of diverse types of materials in the delivery and support of lab sessions for multimedia subjects and students , 2013, Br. J. Educ. Technol..

[102]  Katharina Scheiter,et al.  Is spoken text always better? Investigating the modality and redundancy effect with longer text presentation , 2013, Comput. Hum. Behav..

[103]  Serkan Izmirli,et al.  The Effects of Captioning Videos on Academic Achievement and Motivation: Reconsideration of Redundancy Principle in Instructional Videos , 2016, J. Educ. Technol. Soc..

[104]  Annemieke Vermeyen,et al.  Comparing the efficiency and effectiveness of different learning media designs for the preparation of skills training in a blended learning context , 2011 .

[105]  Andreas Holzinger,et al.  Dynamic Media in Computer Science Education; Content Complexity and Learning Performance: Is Less More? , 2008, J. Educ. Technol. Soc..

[106]  Vanessa D. I. Pfeiffer,et al.  Comparing and combining traditional teaching approaches and the use of video clips for learning how to identify species in an aquarium , 2012 .

[107]  Mária Bernschütz,et al.  The impact of webinar-webcast system on learning performance , 2015, Education and Information Technologies.

[108]  Thomas Huk,et al.  The educational value of visual cues and 3D-representational format in a computer animation under restricted and realistic conditions , 2010 .

[109]  Krzysztof Z. Gajos,et al.  Understanding in-video dropouts and interaction peaks inonline lecture videos , 2014, L@S.

[110]  Sharon A Brown,et al.  A Framework for Developing a Coding Scheme for Meta-Analysis , 2003, Western journal of nursing research.

[111]  Gregory Schraw,et al.  Learning With Animation and Illusions of Understanding , 2013 .

[112]  Sean A Horan,et al.  A video-based learning activity is effective for preparing physiotherapy students for practical examinations. , 2013, Physiotherapy.

[113]  Jonathan S. A. Carriere,et al.  Examining the influence of saliency of peer-induced distractions on direction of gaze and lecture recall , 2016, Comput. Educ..

[114]  Justin Reich,et al.  Characterizing Video Use in the Catalogue of MITx MOOCs , 2014 .

[115]  M. Bruya,et al.  Outcomes of Teaching Baccalaureate Nursing Students About Mastitis Utilizing a Multimodal Teaching Tool , 2010, International journal of nursing education scholarship.

[116]  Eric Jamet,et al.  An eye-tracking study of cueing effects in multimedia learning , 2014, Comput. Hum. Behav..

[117]  Yu Zhao,et al.  Identifying learning strategies associated with active use of video annotation software , 2015, LAK.

[118]  Yvonne Kammerer,et al.  The effects of realism in learning with dynamic visualizations , 2009 .

[119]  Michael S. Trevisan,et al.  An Exploratory Study of the Effects of Time Compressed Animated Delivery Multimedia Technology on Student Learning in Reproductive Physiology , 2010 .

[120]  Gerald Cannon,et al.  A multi-method study to determine the effectiveness of, and student attitudes to, online instructional videos for teaching clinical nursing skills. , 2009, Nurse education today.

[121]  René F. Kizilcec,et al.  The instructor’s face in video instruction: Evidence from two large-scale field studies. , 2015, Journal of Educational Psychology.

[122]  I. Mello,et al.  Assessing the Impact of Voice-Over Screen-Captured Presentations Delivered Online on Dental Students' Learning. , 2016, Journal of dental education.

[123]  Rebecca Callaway,et al.  Optimizing Instructional Video for Preservice Teachers in an Online Technology Integration Course , 2014 .

[124]  Halimah Badioze Zaman,et al.  Investigating the redundancy effect in multimedia learning on a computer science domain , 2010, 2010 International Symposium on Information Technology.

[125]  Thierry Karsenti,et al.  The impact of online teaching videos on Canadian pre‐service teachers , 2011 .

[126]  Patrick Jermann,et al.  How Do In-video Interactions Reflect Perceived Video Difficulty? , 2015 .

[127]  Judith Uchidiuno,et al.  Characterizing ELL Students' Behavior During MOOC Videos Using Content Type , 2017, L@S.

[128]  Franziska J. Kößler,et al.  Learning Online: A Comparison of Different Media Types , 2015, Technology, Knowledge and Learning.

[129]  S. Izmirli,et al.  Effects of Modality and Pace on Achievement, Mental Effort, and Positive Affect in Multimedia Learning Environments , 2016 .

[130]  Halimah Badioze Zaman,et al.  Multimedia learning in computer science: The effect of fifferent modes of instruction on student understanding , 2008, 2008 International Symposium on Information Technology.

[131]  Myounghoon Jeon,et al.  “Not All Visual Media Are Helpful” , 2014 .

[132]  Linda Blake,et al.  The effects of video on cognitive load and social presence in multimedia-learning , 2008, Comput. Hum. Behav..

[133]  Pavlo D. Antonenko,et al.  Understanding metacomprehension accuracy within video annotation systems , 2016, Comput. Hum. Behav..

[134]  Ruth N. Schwartz,et al.  Effects of pacing and cognitive style across dynamic and non-dynamic representations , 2011, Comput. Educ..

[135]  Chuck Biddle,et al.  Audiovisual facilitation of clinical knowledge: a paradigm for dispersed student education based on Paivio's Dual Coding Theory. , 2008, AANA journal.

[136]  Markus Huff,et al.  The verbal facilitation effect in learning to tie nautical knots , 2012 .

[137]  Philip J. Guo,et al.  How video production affects student engagement: an empirical study of MOOC videos , 2014, L@S.

[138]  Julià Minguillón,et al.  Exploring the Effectiveness of Video Viewing in an Introductory x-MOOC of Algebra , 2015, CHANGEE/WAPLA/HybridEd@EC-TEL.

[139]  Xiangming Mu,et al.  Towards effective video annotation: An approach to automatically link notes with video content , 2010, Comput. Educ..

[140]  René F. Kizilcec,et al.  Showing face in video instruction: effects on information retention, visual attention, and affect , 2014, CHI.

[141]  Dong-Hee Shin,et al.  Effects of spatial ability and richness of motion cue on learning in mechanically complex domain , 2011, Comput. Hum. Behav..

[142]  S. Guttormsen Schär,et al.  Investigating Means to Reduce Cognitive Load from Animations , 2007 .

[143]  D. Schacter,et al.  Overcoming overconfidence in learning from video-recorded lectures: Implications of interpolated testing for online education , 2014 .