The effect of using Kahoot! for learning - A literature review

Abstract Kahoot! is a game-based learning platform used to review students' knowledge, for formative assessment or as a break from traditional classroom activities. It is among the most popular game-based learning platforms, with 70 million monthly active unique users and used by 50% of US K-12 students. Since the platform was released in 2013, many studies have been published on the effect of using Kahoot! in the classroom, but so far, no systematic analysis of the results. This article presents the results of a literature review on the effect of using Kahoot! for learning and, more specifically, on how Kahoot! affects learning performance, classroom dynamics, students' and teachers' attitudes and perceptions, and students' anxiety. The literature review includes 93 studies, and the main conclusion is that Kahoot! can have a positive effect on learning performance, classroom dynamics, students' and teachers' attitudes, and students’ anxiety. However, there are also studies where Kahoot! has little or no effect. The main challenges mentioned by students include technical problems such as unreliable internet connections, hard to read questions and answers on a projected screen, not being able to change answer after submission, stressful time-pressure for giving answers, not enough time to answer, afraid of losing, and hard to catch up if an incorrect answer had been given. Further, the main challenges mentioned by teachers include getting the difficulty level of questions and answers right, problems related to network connectivity, scoring based on how quickly the students answer reducing student reflection and cause some students to guess without thinking, that some students can have a problem with failing a quiz, and some teachers find it challenging to use the technology.

[1]  J. Guardia,et al.  Innovation in the teaching-learning process: the case of Kahoot! , 2019, On the Horizon.

[2]  Hsiu-Ting Hung,et al.  Language Teaching and Technology Forum: The Integration of a Student Response System in Flipped Classrooms. , 2017 .

[3]  Maya Stoyanova,et al.  Gamification in 11th Grade Mathematics Lessons – One Possible Interactive Approach , 2016 .

[4]  Danielle Cadieux Boulden,et al.  Implementing Digital Tools to Support Student Questioning Abilities: A Collaborative Action Research Report , 2017 .

[5]  Mike Sharples,et al.  The design of personal mobile technologies for lifelong learning , 2000, Comput. Educ..

[6]  Michael J. Prince,et al.  Does Active Learning Work? A Review of the Research , 2004 .

[7]  Carolyn M. Plump,et al.  Using Kahoot! in the Classroom to Create Engagement and Active Learning: A Game-Based Technology Solution for eLearning Novices , 2017 .

[8]  Rebeca Cordero-Gutiérrez,et al.  Kahoot, win the learning race , 2018, TEEM.

[9]  Bruno Filipe Pereira de Sousa,et al.  Engaging Students in the Evaluation Process Using Co-Creation and Technology Enhanced Learning , 2018, CC-TEL/TACKLE@EC-TEL.

[10]  Vittorio Midoro,et al.  Web 2.0-Based E-Learning , 2012 .

[11]  S. Wichadee,et al.  Enhancement of Performance and Motivation through Application of Digital Games in an English Language Class. , 2018 .

[12]  Uwe Nestmann,et al.  A case study of flipped classroom for automata theory in secondary education , 2018, WiPSCE.

[13]  Susi Susanti,et al.  FUN ACTIVITIES IN TEACHING ENGLISH BY USING KAHOOT , 2018 .

[14]  Julio Villena-Román,et al.  From MOOCs to SPOCs... and from SPOCs to Flipped Classroom , 2017, EC-TEL.

[15]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[16]  Robin H. Kay,et al.  Examining the benefits and challenges of using audience response systems: A review of the literature , 2009, Comput. Educ..

[17]  Yvonne Steinert,et al.  Interactive lecturing: strategies for increasing participation in large group presentations , 1999 .

[18]  R. Burnstein,et al.  Using Wireless Keypads in Lecture Classes , 2001 .

[19]  Alf Inge Wang,et al.  The Effect of Digitizing and Gamifying Quizzing in Classrooms , 2016 .

[20]  Kanika Aggarwal Khandelwal,et al.  Effective Teaching Behaviors in the College Classroom: A Critical Incident Technique from Students' Perspective. , 2009 .

[21]  Thomas W. Malone,et al.  What makes things fun to learn? heuristics for designing instructional computer games , 1980, SIGSMALL '80.

[22]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[23]  Nina Sarkar,et al.  Engaging Digital Natives through Social Learning , 2017 .

[24]  Elizabeth Pluskwik,et al.  Effectiveness of Gamification Activities in a Project-based Learning Classroom , 2018 .

[25]  Norhasyimah Hamzah,et al.  Implementation of The Gamification Concept Using KAHOOT! Among TVET Students: An Observation , 2018, Journal of Physics: Conference Series.

[26]  Zeynep Turan,et al.  Game-Based Versus to Non-Game-Based: The Impact of Student Response Systems on Students'Achievements, Engagements and Test Anxieties , 2018, Informatics Educ..

[27]  Philip M. Tan,et al.  Enhancing Learning and Engagement through Gamification of Student Response Systems , 2017 .

[28]  Herb Shon,et al.  A Review of Poll Everywhere Audience Response System , 2011 .

[29]  Luiz Roberto Marim,et al.  Kahoot, A New and Cheap Way to Get Classroom-Response Instead of Using Clickers , 2016 .

[30]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[31]  THE EFFECTIVENESS OF USING KAHOOT AS A MEDIA IN TEACHING READING , 2018, E-LINK JOURNAL.

[32]  Antigoni Parmaxi,et al.  Teaching Turkish in low tech contexts: opportunities and challenges , 2016 .

[33]  Ewa Zarzycka-Piskorz,et al.  KAHOOT IT OR NOT? CAN GAMES BE MOTIVATING IN LEARNING GRAMMAR? , 2016 .

[34]  Nafiye Çigdem Aktekin,et al.  Let’s Kahoot! Anatomy , 2018 .

[35]  Nataliia V. Iaremenko,et al.  ENHANCING ENGLISH LANGUAGE LEARNERS’ MOTIVATION THROUGH ONLINE GAMES , 2017 .

[36]  Josip Slisko,et al.  Software Socrative and Smartphones as Tools For Implementation of Basic Processes of Active Physics Learning in Classroom: An Initial Feasibility Study With Prospective Teachers , 2013 .

[37]  Alf Inge Wang,et al.  The wear out effect of a game-based student response system , 2015, Comput. Educ..

[38]  M. Nkhoma,et al.  GAMIFYING A FLIPPED FIRST YEAR ACCOUNTING CLASSROOM USING KAHOOT! , 2018, International Journal of Information System and Engineering.

[39]  Alf Inge Wang,et al.  Lecture quiz: a mobile game concept for lectures , 2007, ICSE 2007.

[40]  Roslina Ibrahim,et al.  Fun elements in educational game design to boost students learning experience , 2018 .

[41]  N. Chen,et al.  Learner Satisfaction toward using IRS in Synchronous Sessions of an Online Course , 2018, ICFET '18.

[42]  V. Basili Software modeling and measurement: the Goal/Question/Metric paradigm , 1992 .

[43]  Hsiu-Ting Hung,et al.  Clickers in the flipped classroom: bring your own device (BYOD) to promote student learning , 2017, Interact. Learn. Environ..

[44]  E. Lógó,et al.  The Effect of the Kahoot Quiz on the Student's Results in the Exam , 2019, Periodica Polytechnica Social and Management Sciences.

[45]  Papia Bawa Using Kahoot to Inspire , 2018, Journal of Educational Technology Systems.

[46]  Yungwei Hao,et al.  Investigation of the effects of an online instant response system on students in a middle school of a rural area , 2019, Comput. Hum. Behav..

[47]  Eugene Judson,et al.  Learning from Past and Present: Electronic Response Systems in College Lecture Halls , 2002 .

[48]  Edison Gerardo Llerena Medina,et al.  Kahoot! A Digital Tool for Learning Vocabulary in a language classroom , 2017 .

[49]  Tore Dybå,et al.  Empirical studies of agile software development: A systematic review , 2008, Inf. Softw. Technol..

[50]  Adam R. Lucas Using Peer Instruction and I-Clickers to Enhance Student Participation in Calculus , 2009 .

[51]  Jennifer M. Krause,et al.  Plickers: A Formative Assessment Tool for K–12 and PETE Professionals , 2017 .

[52]  William C. Bessler,et al.  The use of an electronic response system in teaching biology , 1971 .

[53]  Budiati Budiati ICT (INFORMATION AND COMMUNICATION TECHNOLOGY) USE: KAHOOT PROGRAM FOR ENGLISH STUDENTS’ LEARNING BOOSTER , 2017 .

[54]  Halise Sibe Çetin Implementation of the Digital Assessment Tool Kahoot in Elementary School , 2018 .

[55]  Thomas W. Malone,et al.  Toward a Theory of Intrinsically Motivating Instruction , 1981, Cogn. Sci..

[56]  Eric Mazur,et al.  Catalyzing learner engagement using cutting-edge classroom response systems in higher education , 2013 .

[57]  Renate Motschnig,et al.  Effects of Introducing a Game-Based Student Response System into a Flipped, Person-Centered Classroom on Object-Oriented Design , 2018, ICWL.

[58]  Alexandra Moutinho,et al.  Implementing active learning through pedagogical coaching in Control Systems lectures , 2018, 2018 3rd International Conference of the Portuguese Society for Engineering Education (CISPEE).

[59]  Joseph Casanova,et al.  An Instructional Experiment in Organic Chemistry, The Use of a Student Response System. , 1971 .

[60]  Huseyin Bicen,et al.  Perceptions of Students for Gamification Approach: Kahoot as a Case Study , 2018, Int. J. Emerg. Technol. Learn..

[61]  S. Tsymbal GAMIFIED TRAINING SESSIONS AS MEANS OF ENHANCING STUDENTS’ MOTIVATION IN LEARNING ENGLISH , 2018, Psychological journal.

[62]  Ian McGraw,et al.  A self-transcribing speech corpus: collecting continuous speech with an online educational game , 2009, SLaTE.

[63]  Ferit Karakoyun,et al.  Gamification in Biology Teaching: A Sample of Kahoot Application , 2017 .

[64]  B. Klimova,et al.  Computer Game-Based Foreign Language Learning: Its Benefits and Limitations , 2018 .

[65]  Susan G. Bryant,et al.  Fun With Pharmacology: Winning Students Over With Kahoot! Game-Based Learning. , 2018, The Journal of nursing education.

[66]  Alf Inge Wang,et al.  Improvement of a Lecture Game Concept - Implementing Lecture Quiz 2.0 , 2011, CSEDU.

[67]  Sherlock A. Licorish,et al.  “ Go Kahoot ! ” Enriching Classroom Engagement , Motivation and Learning Experience with Games , 2017 .

[68]  M. Rasic,et al.  Influence of gamification on student motivation in the educational process in courses of different fields , 2018, 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[69]  Yen-ju Hou Integration of Kahoot into EFL Classroom , 2018, HCI.

[70]  Péter László Sasvári,et al.  The Use of Gamification in Higher Education: An Empirical Study , 2017 .

[71]  J. Butler,et al.  Use of teaching methods within the lecture format. , 1992, Medical teacher.

[72]  Anastasios A. Economides,et al.  Mobile-based assessment: A literature review of publications in major referred journals from 2009 to 2018 , 2018, Comput. Educ..

[73]  Colette Lyng,et al.  Transforming classroom questioning using emerging technology. , 2018, British journal of nursing.

[74]  Brent Bridgeman,et al.  Measuring Learning Outcomes in Higher Education , 2012 .

[75]  C. Tsihouridis,et al.  Assessing the Learning Process Playing with Kahoot - A Study with Upper Secondary School Pupils Learning Electrical Circuits , 2017, ICL.

[76]  Christos Douligeris,et al.  Let's learn with Kahoot! , 2018, 2018 IEEE Global Engineering Education Conference (EDUCON).

[77]  Paul Dervan,et al.  Increasing in-class student engagement using Socrative (an online Student Response System) , 2014 .

[78]  Muhd Al-Aarifin Ismail,et al.  Kahoot: A Promising Tool for Formative Assessment in Medical Education , 2017 .

[79]  Jamaluddin Badusah,et al.  Learning English Is Fun via Kahoot : Students ’ Attitude , Motivation and Perceptions , 2017 .

[80]  Y.-H. Wang The effectiveness of integrating teaching strategies into IRS activities to facilitate learning , 2017, J. Comput. Assist. Learn..

[81]  Quintin I. Cutts,et al.  Maximising Dialogue in Lectures using Group Response Systems , 2004, CATE.

[82]  Zehra Jamil,et al.  Preclinical medical students' perspective on technology enhanced assessment for learning. , 2018, JPMA. The Journal of the Pakistan Medical Association.

[83]  Panagiotis Fotaris,et al.  Climbing up the leaderboard: an empirical study of applying Gamification techniques to a computer programming class , 2016 .

[84]  Z. Yan,et al.  Diverse delivery methods and strong psychological benefits: A review of online formative assessment , 2017, J. Comput. Assist. Learn..

[85]  Hairong Mu,et al.  Incorporating the advantages of clickers and mobile devices to teach Economics to non-economists , 2015 .

[86]  Jane E Caldwell,et al.  Clickers in the large classroom: current research and best-practice tips. , 2007, CBE life sciences education.

[87]  F. Kinder,et al.  Gaming Strategies in Nursing Education , 2018, Teaching and Learning in Nursing.

[88]  Pao-Ta Yu,et al.  Develop the Interactive Feedback Portfolio System with iBeacon Technology Applied in Flipped Classroom Learning Activities , 2018, ICBL.

[89]  Jorge Bernal,et al.  Results of the use of Kahoot! gamification tool in a course of Chemistry , 2018, Proceedings of the 4th International Conference on Higher Education Advances (HEAd'18).

[90]  Miguel García Iruela,et al.  How Gamification Impacts on Vocational Training Students , 2018, AIED.

[91]  Derya Orhan Göksün,et al.  Comparing success and engagement in gamified learning experiences via Kahoot and Quizizz , 2019, Comput. Educ..

[92]  Mehmet Asmalı Integrating Technology into ESP Classes: Use of Student Response System in English for Specific Purposes Instruction. , 2018 .

[93]  Nurul Nisa Omar THE EFFFECTIVENESS OF KAHOOT APPLICATION TOWARDS STUDENTS’ GOOD FEEDBACK PRACTICE , 2017 .

[94]  Yanawut Chaiyo,et al.  The effect of Kahoot, Quizizz and Google Forms on the student's perception in the classrooms response system , 2017, 2017 International Conference on Digital Arts, Media and Technology (ICDAMT).

[95]  Maria Ranieri,et al.  Game-based student response system: Revisiting its potentials and criticalities in large-size classes: , 2018 .

[96]  Daniela Tuparova,et al.  Impact of Motivation, Gamification and Learning Style on Students' Interest in Maths Classes - A Study in 11 High School Grade , 2017, ICL.

[97]  Sherlock A. Licorish,et al.  Students’ perception of Kahoot!’s influence on teaching and learning , 2018, Research and Practice in Technology Enhanced Learning.

[98]  Maria J Grant,et al.  A typology of reviews: an analysis of 14 review types and associated methodologies. , 2009, Health information and libraries journal.

[99]  William Billingsley,et al.  Research trends in student response systems: a literature review , 2015, Int. J. Learn. Technol..

[100]  C. Chien,et al.  Analysis the Effectiveness of Three Online Vocabulary Flashcard Websites on L2 Learners' Level of Lexical Knowledge. , 2015 .

[101]  Pedro J. Blázquez Tobías,et al.  Student Assessment of the Use of Kahoot in the Learning Process of Science and Mathematics , 2019, Education Sciences.

[102]  Ozlem Baydas,et al.  The examination of the gamification process in undergraduate education: a scale development study , 2019, Technology, Pedagogy and Education.

[103]  Yi-Hsuan Wang,et al.  The Effectiveness of Using Cloud-Based Cross-Device IRS to Support Classical Chinese Learning , 2017, J. Educ. Technol. Soc..

[104]  Arthur C. Graesser,et al.  Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments , 2010, Int. J. Hum. Comput. Stud..

[105]  Alf Inge Wang,et al.  An Evaluation of a Mobile Game Concept for Lectures , 2008, 2008 21st Conference on Software Engineering Education and Training.

[106]  Kyoko Johns,et al.  Engaging and Assessing Students with Technology: A Review of Kahoot! , 2015 .

[107]  N. Avshenyuk,et al.  GAMIFICATION IN HIGHER EDUCATION: EXPERIENCE OF POLAND AND UKRAINE , 2018, Advanced Education.

[108]  R. Asa’d,et al.  Improving problem solving skills in introductory physics using Kahoot! , 2018, Physics Education.

[109]  J. Hargis,et al.  ANALYZING THE EFFICACY OF THE TESTING EFFECT USING KAHOOTTM ON STUDENT PERFORMANCE , 2017 .

[110]  Nuno Veiga,et al.  The Use of New Learning Technologies in Higher Education Classroom: A Case Study , 2018, Int. J. Eng. Pedagog..

[111]  H. Zainol Abidin,et al.  Students' perceptions on game-based classroom response system in a computer programming course , 2017, 2017 IEEE 9th International Conference on Engineering Education (ICEED).

[112]  Andreas Lieberoth,et al.  The effect of points and audio on concentration, engagement, enjoyment, learning, motivation, and classroom dynamics using Kahoot! , 2016 .

[113]  Teresa Parra-Santos,et al.  Gamification for formative assessment in the framework of engineering learning , 2018, TEEM.