Examining the learning effects of live streaming video game instruction over Twitch

Abstract Technology facilitates advances in learning and drives learning paradigms. One recent innovation is Twitch™, an online streaming platform often used for video game tutorials but also enables amateur online instruction ( Hamilton, Garretson, & Kerne, 2014 )). Twitch represents a unique learning paradigm that is not perfectly represented in previous technologies because of its “ground-up” evolution and the opportunity for novice instructors to educate mass audiences in real-time over the Internet while enabling interaction between teachers and learners and among learners. The purpose of this research is to empirically examine the efficacy of Twitch as a learning platform by manipulating each of the key characteristics of Twitch and to understand the conditions in which novice instructors may be beneficial. Drawing from Cognitive Load Theory, we demonstrate the worked-example effect in the Twitch environment by manipulating teacher-learner-learner interactions, live versus recorded streaming, and expert-versus novice-based instruction. Based on a laboratory experiment involving 350 participants, we found that learning performance under novice instructors was at least as good as that of experts. However, an exploratory analysis of learner personalities revealed that extroverts benefit only when learner-learner interaction is enabled. Surprisingly, those who are highly agreeable and less neurotic benefited more from novice instructors.

[1]  Aaron Sams,et al.  Flip Your Classroom: Reach Every Student in Every Class Every Day , 2012 .

[2]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[3]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[4]  Edward L. Thorndike,et al.  Learning without awareness of what is being learned or intent to learn it. , 1934 .

[5]  Wen Qu,et al.  Using gameplay data to examine learning behavior patterns in a serious game , 2017, Comput. Hum. Behav..

[6]  Mitsutoshi Okazaki,et al.  Revised NEO Personality Inventory(NEO-PI-R)を用いたてんかん患者におけるパーソナリティ傾向に関する検討 , 2018 .

[7]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[8]  Alexander Serebrenik,et al.  StackOverflow and GitHub: Associations between Software Development and Crowdsourced Knowledge , 2013, 2013 International Conference on Social Computing.

[9]  Jay F. Nunamaker,et al.  User Acceptance of Knowledge-Based System Recommendations: Explanations, Arguments, and Fit , 2015, Decis. Support Syst..

[10]  Eric T. G. Wang,et al.  Understanding knowledge sharing in virtual communities: An integration of social capital and social cognitive theories , 2006, Decis. Support Syst..

[11]  Pamela J. Hinds,et al.  Bothered by abstraction: the effect of expertise on knowledge transfer and subsequent novice performance. , 2001, The Journal of applied psychology.

[12]  Michele D. Dickey Engaging by design: How engagement strategies in popular computer and video games can inform instructional design , 2005 .

[13]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[14]  Peter Duffy,et al.  Engaging the YouTube Google-Eyed Generation: Strategies for Using Web 2.0 in Teaching and Learning. , 2008 .

[15]  John Sweller,et al.  Efficiency in Learning: Evidence-Based Guidelines to Manage Cognitive Load , 2005 .

[16]  Kent A. Kiehl,et al.  Neural correlates of the processing of another’s mistakes: A possible underpinning for social and observational learning , 2008, NeuroImage.

[17]  Richard E. Clark,et al.  Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching , 2006 .

[18]  E. Mazur,et al.  Peer Instruction: Ten years of experience and results , 2001 .

[19]  Samy A. Azer,et al.  Can “YouTube” help students in learning surface anatomy? , 2012, Surgical and Radiologic Anatomy.

[20]  H. Simon,et al.  Perception in chess , 1973 .

[21]  Herbert A Simon,et al.  The understanding process: Problem isomorphs , 1976, Cognitive Psychology.

[22]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[23]  A. Baddeley Working memory: theories, models, and controversies. , 2012, Annual review of psychology.

[24]  Kerry Shephard,et al.  Questioning, promoting and evaluating the use of streaming video to support student learning , 2003, Br. J. Educ. Technol..

[25]  P. Chandler,et al.  Assimilating complex information , 2002 .

[26]  Charalambos Vrasidas,et al.  Factors influencing interaction in an online course , 1999 .

[27]  Mark R. Lehto,et al.  User acceptance of YouTube for procedural learning: An extension of the Technology Acceptance Model , 2013, Comput. Educ..

[28]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[29]  L. Squire Memory systems of the brain: A brief history and current perspective , 2004, Neurobiology of Learning and Memory.

[30]  Lara Lomicka,et al.  A Case Study of Learner Interaction in Technology-Enhanced Language Learning Environments , 2000 .

[31]  Mike Moore,et al.  Distance Education: A Systems View , 1995 .

[32]  Wu He,et al.  Examining students' online interaction in a live video streaming environment using data mining and text mining , 2013, Comput. Hum. Behav..

[33]  Ben Shneiderman,et al.  Engagement Theory: A Framework for Technology-Based Teaching and Learning. , 1998 .

[34]  Karin Sonnleitner,et al.  From Sage on the Stage to Guide on the Side , 2016 .

[35]  Cristina Hava Muntean,et al.  An analysis of flip-classroom pedagogy in first year undergraduate mathematics for computing , 2014, 2014 IEEE Frontiers in Education Conference (FIE) Proceedings.

[36]  Robin H. Kay,et al.  Exploring the use of video podcasts in education: A comprehensive review of the literature , 2012, Comput. Hum. Behav..

[37]  Yu-Chun Kuo A Case Study of Learner Interaction in Web-based Learning , 2013 .

[38]  J. Sweller,et al.  The Use of Worked Examples as a Substitute for Problem Solving in Learning Algebra , 1985 .

[39]  Andruid Kerne,et al.  Streaming on twitch: fostering participatory communities of play within live mixed media , 2014, CHI.

[40]  Reinoud Achterkamp,et al.  The influence of vicarious experience provided through mobile technology on self-efficacy when learning new tasks , 2016, Comput. Hum. Behav..

[41]  Embry-Riddle Aeronautical,et al.  The Flipped Classroom: A Survey of the Research , 2013 .

[42]  C. Eriksen,et al.  Discrimination and learning without awareness: a methodological survey and evaluation. , 1960, Psychological review.

[43]  L. Squire,et al.  Parallel brain systems for learning with and without awareness. , 1994, Learning & memory.

[44]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[45]  Joseph Macey,et al.  Content structure is king: An empirical study on gratifications, game genres and content type on Twitch , 2017, Comput. Hum. Behav..

[46]  Kurt Kraiger,et al.  Transforming Our Models of Learning and Development: Web-Based Instruction as Enabler of Third-Generation Instruction , 2008, Industrial and Organizational Psychology.

[47]  J. Sweller COGNITIVE LOAD THEORY, LEARNING DIFFICULTY, AND INSTRUCTIONAL DESIGN , 1994 .

[48]  Jay F. Nunamaker,et al.  Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness , 2006, Inf. Manag..

[49]  Cheri Speier,et al.  The influence of information presentation formats on complex task decision-making performance , 2006, Int. J. Hum. Comput. Stud..

[50]  D. Jonassen,et al.  Communication patterns in computer mediated versus face-to-face group problem solving , 2001 .

[51]  Slava Kalyuga,et al.  Relative effectiveness of animated and static diagrams: An effect of learner prior knowledge , 2008, Comput. Hum. Behav..

[52]  J. Seaman,et al.  Teaching, Learning, and Sharing: How Today's Higher Education Faculty Use Social Media. , 2011 .

[53]  Curtis J. Bonk,et al.  Applying collaborative and e-learning tools to military distance learning: A research framework , 2000 .

[54]  A. Röhl,et al.  The Flipped Classroom: An Opportunity to Engage Millennial Students through Active Learning Strategies. , 2013 .

[55]  Yong Zhao,et al.  Features of CMC technologies and their impact on language learners' online interaction , 2003, Comput. Hum. Behav..

[56]  Ashish Amresh,et al.  Evaluating the effectiveness of flipped classrooms for teaching CS1 , 2013, 2013 IEEE Frontiers in Education Conference (FIE).

[57]  John Sweller,et al.  Cognitive Load Theory , 2020, Encyclopedia of Education and Information Technologies.

[58]  Jinwoo Kim,et al.  Getting closer and experiencing together: Antecedents and consequences of psychological distance in social media-enhanced real-time streaming video , 2012, Comput. Hum. Behav..