Effects of Subtitles, Complexity, and Language Proficiency on Learning From Online Education Videos

Open online education has become increasingly popular. In Massive Open Online Courses (MOOCs) videos are generally the most used method of teaching. While most MOOCs are offered in English, the global availability of these courses has attracted many non-native English speakers. To ensure not only the availability, but also the accessibility of open online education, courses should be designed to minimize detrimental effects of a language barrier, for example by providing subtitles. However, with many conflicting research findings it is unclear whether subtitles are beneficial or detrimental for learning from a video, and whether this depends on characteristics of the learner and the video. We hypothesized that the effect of 2nd language subtitles on learning outcomes depends on the language proficiency of the student, as well as the visual-textual information complexity of the video. This three-way interaction was tested in an experimental study. No main effect of subtitles was found, nor any interaction. However, the student’s language proficiency and the complexity of the video do have a substantial impact on learning outcomes.

[1]  Iva Baltova,et al.  Multisensory language teaching in a multidimensional curriculum : The use of authentic bimodal video in core French , 1999 .

[2]  A. Baddeley.  Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[3]  Hedieh Najafi,et al.  A Comparison of Learner Intent and Behaviour in Live and Archived MOOCs. , 2014 .

[4]  Jeffrey N. Rouder,et al.  Default Bayes factors for ANOVA designs , 2012 .

[5]  R. Mayer,et al.  A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory , 1998 .

[6]  吉島 茂,et al.  文化と言語の多様性の中のCommon European Framework of Reference for Languages: Learning, teaching, assessment (CEFR)--それは基準か? (第10回明海大学大学院応用言語学研究科セミナー 講演) , 2008 .

[7]  Justin Reich,et al.  Evaluating Geographic Data in MOOCs , 2013 .

[8]  J. Chung,et al.  The Effects of Using Video Texts Supported with Advance Organizers and Captions on Chinese College Students' Listening Comprehension: An Empirical Study , 1999 .

[9]  Ian J Deary,et al.  Stability and change in intelligence from age 11 to ages 70, 79, and 87: the Lothian Birth Cohorts of 1921 and 1936. , 2011, Psychology and aging.

[10]  Andrew J. Elliot,et al.  Short-term and long-term consequences of achievement goals: Predicting interest and performance over time. , 2000 .

[11]  Greg McVerry.  Applying the Science of Learning: Evidence-Based Principles for the Design of MultimediaInstruction , 2019 .

[12]  Tim Van der Zee,et al.  Explaining Student Behavior at Scale: The Influence of Video Complexity on Student Dwelling Time , 2016, L@S.

[13]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[14]  Susan M. Gass,et al.  Factors Influencing the Use of Captions by Foreign Language Learners: An Eye‐Tracking Study , 2013 .

[15]  Paul Ginns.  Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects , 2006 .

[16]  R. Mayer,et al.  Cognitive constraints on multimedia learning: When presenting more material results in less understanding. , 2001 .

[17]  R. Mayer,et al.  Verbal redundancy in multimedia learning: When reading helps listening , 2002 .

[18]  Yoav Bergner,et al.  Who does what in a massive open online course? , 2014, Commun. ACM.

[19]  R. Mayer,et al.  Nine Ways to Reduce Cognitive Load in Multimedia Learning , 2003 .

[20]  Abdolmajid Hayati,et al.  The effect of films with and without subtitles on listening comprehension of EFL learners , 2011, Br. J. Educ. Technol..

[21]  Henry L. Roediger,et al.  Repeated retrieval during learning is the key to long-term retention , 2007 .

[22]  Gregg C. Vanderheiden,et al.  Web Content Accessibility Guidelines (WCAG) 2.0 , 2008 .

[23]  Thomas J. Garza,et al.  Evaluating the Use of Captioned Video Materials in Advanced Foreign Language Learning , 1991 .

[24]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[25]  Paul Markham,et al.  Captioned Videotapes and Second‐Language Listening Word Recognition , 1999 .

[26]  Florian Schmidt-Weigand,et al.  A closer look at split visual attention in system- and self-paced instruction in multimedia learning , 2010 .

[27]  Wim Van Den Noortgate,et al.  Captioned video for L2 listening and vocabulary learning: A meta-analysis , 2013 .

[28]  Robert Vanderplank,et al.  The value of teletext sub-titles in language learning , 1988 .

[29]  Youmei Liu.  Educational Paradigm Shift in the 21st Century E-Learning , 2013 .

[30]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[31]  Richard E. Mayer,et al.  Multimedia learning in an interactive self-explaining environment: What works in the design of agent , 2003 .

[32]  E. Krupinski,et al.  Eye-movement study and human performance using telepathology virtual slides: implications for medical education and differences with experience. , 2006, Human pathology.

[33]  Mark Bullen,et al.  What is Instructional Design , 2014 .

[34]  Erol Özçelik,et al.  Why does signaling enhance multimedia learning? Evidence from eye movements , 2010, Comput. Hum. Behav..

[35]  Jan-Louis Kruger,et al.  Attention distribution and cognitive load in a subtitled academic lecture: L1 vs. L2 , 2014 .

[36]  Richard K. Lowe,et al.  An Eye Tracking Comparison of External Pointing Cues and Internal Continuous Cues in Learning with Complex Animations , 2010 .

[37]  J. Sweller.  Element Interactivity and Intrinsic, Extraneous, and Germane Cognitive Load , 2010 .

[38]  Kirsten R. Butcher.  Learning from Text with Diagrams: Promoting Mental Model Development and Inference Generation. , 2006 .

[39]  T. J. McCarthy,et al.  The Effects of Native Language vs. Target Language Captions on Foreign Language Students' DVD Video Comprehension , 2001 .

[40]  R. Mayer.  Applying the science of learning: evidence-based principles for the design of multimedia instruction. , 2008, The American psychologist.

[41]  Richard D. Morey,et al.  Baysefactor: Computation of Bayes Factors for Common Designs , 2018 .

[42]  R. Mayer,et al.  A coherence effect in multimedia learning: The case for minimizing irrelevant sounds in the design of multimedia instructional messages. , 2000 .

[43]  Richard E. Mayer,et al.  Multimedia Learning: The Promise of Multimedia Learning , 2001 .

[44]  Martine Danan,et al.  Captioning and Subtitling: Undervalued Language Learning Strategies , 2004 .

[45]  P. Chapman,et al.  Visual Search of Driving Situations: Danger and Experience , 1998, Perception.

[46]  R. Mayer,et al.  Learning Science in Virtual Reality Multimedia Environments: Role of Methods and Media , 2002 .

[47]  Lynne M. Reder,et al.  Models of recognition: A review of arguments in favor of a dual-process account , 2006, Psychonomic bulletin & review.

[48]  R. Mayer,et al.  Does the modality principle for multimedia learning apply to science classrooms , 2007 .

[49]  Min Liu,et al.  Understanding MOOCs as an Emerging Online Learning Tool: Perspectives From the Students , 2013 .

[50]  Slava Kalyuga,et al.  Managing split-attention and redundancy in multimedia instruction , 1999 .

[51]  T. Baguley.  Standardized or simple effect size: what should be reported? , 2009, British journal of psychology.

[52]  N. Charness,et al.  Visual Span in Expert Chess Players: Evidence From Eye Movements , 2001, Psychological science.

[53]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[54]  Philip J. Guo,et al.  How video production affects student engagement: an empirical study of MOOC videos , 2014, L@S.