On gamifying the transcription of digital video lectures

Abstract Games can be used to exploit the computational power of humans to perform tasks that are difficult for computers. One of these difficult tasks is the transcription of video lectures. Indeed, the characteristics of the speech that occur in video lectures are not well suited for speech recognition technologies. In this paper we propose ALGA, an ALtruistic GAme, designed to involve students in the production of transcripts. Players challenge each other by listening to short, and randomly selected, pieces of the audio stream, and by submitting the corresponding transcription. When two players (unknown to each other) submit the same version, the transcript of the audio chunk is considered correct and the players gain points. To motivate players, ALGA provides the final transcript to all the players and maintains a high-score list for every video lecture. The evaluation shows that the accuracy of the obtained transcripts is higher than the one obtained by speech recognition technologies and also shows that participants like the game approach. Hence, ALGA can be considered a reasonable, feasible and affordable solution to produce transcripts from video lectures.

[1]  D. Gentile,et al.  Violent Video Games as Exemplary Teachers: A Conceptual Analysis , 2008 .

[2]  Tsung-Yu Liu,et al.  Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation , 2010, Comput. Educ..

[3]  Mariano Alcañiz Raya,et al.  Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project , 2010, Comput. Educ..

[4]  Fengfeng Ke,et al.  Computer-game-based tutoring of mathematics , 2013, Comput. Educ..

[5]  Martin Ebner,et al.  Successful implementation of user-centered game based learning in higher education: An example from civil engineering , 2007, Comput. Educ..

[6]  Masood Masoodian,et al.  Supporting Collaborative Transcription of Recorded Speech with a 3D Game Interface , 2010, KES.

[7]  W. Richards Adrion,et al.  Student reactions to classroom lecture capture , 2012, ITiCSE '12.

[8]  Mike Wald.  Concurrent Collaborative Captioning , 2013 .

[9]  Chris Callison-Burch,et al.  Cheap, Fast and Good Enough: Automatic Speech Recognition with Non-Expert Transcription , 2010, NAACL.

[10]  Simon Egenfeldt-Nielsen,et al.  What Makes a Good Learning Game?: Going beyond edutainment , 2011, ELERN.

[11]  Chi-Chang Chen,et al.  An online game approach for improving students' learning performance in web-based problem-solving activities , 2012, Comput. Educ..

[12]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[13]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[14]  Richard N. Van Eck.  Six Ideas in Search of a Discipline , 2007 .

[15]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[16]  Sang-Kyun Kim,et al.  An Effective News Anchorperson Shot Detection Method Based on Adaptive Audio/Visual Model Generation , 2005, CIVR.

[17]  Kevin C. Almeroth,et al.  Fast Caption Alignment for Automatic Indexing of Audio , 2010, Int. J. Multim. Data Eng. Manag..

[18]  Marian Aleson-Carbonell,et al.  Serious games and learning effectiveness: The case of It's a Deal! , 2012, Comput. Educ..

[19]  Mike Wald.  Crowdsourcing correction of speech recognition captioning errors , 2011, W4A.

[20]  Siobhan O'Donovan,et al.  A case study in the gamification of a university-level games development course , 2013, SAICSIT '13.

[21]  Ángel Fidalgo Blanco,et al.  Gamification in MOOC: challenges, opportunities and proposals for advancing MOOC model , 2014, TEEM '14.

[22]  Ian N. Toppin.  Video lecture capture (VLC) system: A comparison of student versus faculty perceptions , 2011, Education and Information Technologies.

[23]  Marco Furini,et al.  Fast play: a novel feature for digital consumer video devices , 2008, IEEE Transactions on Consumer Electronics.

[24]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[25]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[26]  Janne Paavilainen,et al.  Social game studies at CHI 2011 , 2011, CHI EA '11.

[27]  Joaquim A. Jorge,et al.  Improving participation and learning with gamification , 2013, Gamification.

[28]  Andruid Kerne,et al.  Motivating Play through Score , 2009 .

[29]  Milena M. Head,et al.  Competition as an element of gamification for learning: an exploratory longitudinal investigation , 2013, Gamification.

[30]  Yu-Ling Lin,et al.  Digital educational game value hierarchy from a learners' perspective , 2014, Comput. Hum. Behav..

[31]  Seiji Isotani,et al.  A systematic mapping on gamification applied to education , 2014, SAC.

[32]  Michael Riegler,et al.  PictureSort: gamification of image ranking , 2014, GamifIR '14.

[33]  Marco Furini,et al.  Enhancing learning accessibility through fully automatic captioning , 2012, W4A.

[34]  Shin Saito,et al.  Introducing game elements in crowdsourced video captioning by non-experts , 2014, W4A.

[35]  Keith A. Johnson,et al.  Acoustic and Auditory Phonetics , 1997, Phonetica.

[36]  Marco Furini,et al.  An automatic caption alignment mechanism for off-the-shelf speech recognition technologies , 2012, Multimedia Tools and Applications.

[37]  Alexandru Iosup,et al.  An experience report on using gamification in technical higher education , 2014, SIGCSE.

[38]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[39]  Kenton O'Hara,et al.  Gamification. using game-design elements in non-gaming contexts , 2011, CHI Extended Abstracts.

[40]  Alexander H. Waibel,et al.  Strategies for automatic segmentation of audio data , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[41]  Haoqi Zhang,et al.  An Iterative Dual Pathway Structure for Speech-to-Text Transcription , 2011, Human Computation.

[42]  V. Ghini,et al.  An audio-video summarization scheme based on audio and video analysis , 2006, CCNC 2006. 2006 3rd IEEE Consumer Communications and Networking Conference, 2006..

[43]  John R. Kender,et al.  Lecture videos for e-learning: current research and challenges , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[44]  Marco Furini,et al.  Secure, Portable, and Customizable Video Lectures for E-learning on the Move , 2009, Informatica.

[45]  Julián Moreno,et al.  Digital Competition Game to Improve Programming Skills , 2012, J. Educ. Technol. Soc..