The Impact of Gamification on Learning Outcomes of Computer Science Majors

Gamification is the use of game elements in domains other than games. Gamification use is often suggested for difficult activities because it enhances users’ engagement and motivation level. Due to such benefits, the use of gamification is also proposed in education environments to improve students’ performance, engagement, and satisfaction. Computer science in higher education is a tough area of study and thus needs to utilize various already explored benefits of gamification. This research develops an empirical study to evaluate the effectiveness of gamification in teaching computer science in higher education. Along with the learning outcomes, the effect of group size on students’ satisfaction level is also measured. Furthermore, the impact of gamification over time is analyzed throughout a semester to observe its effectiveness as a long-term learning technique. The analysis, covering both learning outcome and students’ satisfaction, suggests that gamification is an effective tool to teach tough courses at higher education level; however, group size should be taken into account for optimal classroom size and better learning experience.

[1]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[2]  Martin Valcke,et al.  Gamification through leaderboards: An empirical study in engineering education , 2019, Comput. Appl. Eng. Educ..

[3]  Tovi Grossman,et al.  GamiCAD: a gamified tutorial system for first time autocad users , 2012, UIST.

[4]  Avishalom Tor,et al.  Ranks and Rivals: A Theory of Competition , 2006, Personality & social psychology bulletin.

[5]  Robert Jensen,et al.  Cool to Be Smart or Smart to Be Cool? Understanding Peer Pressure in Education , 2017 .

[6]  David R. Millen,et al.  Removing gamification from an enterprise SNS , 2012, CSCW.

[7]  Patricia Kristine Sheridan,et al.  Gamification as a Strategy for Promoting Deeper Investigation in a Reverse Engineering Activity , 2012 .

[8]  Hamid R. Rabiee,et al.  Continuous-Time User Modeling in Presence of Badges , 2017, ACM Trans. Knowl. Discov. Data.

[9]  Rebeca P. Díaz Redondo,et al.  A social gamification framework for a K-6 learning platform , 2013, Comput. Hum. Behav..

[10]  J. Artur Serrano,et al.  Gamification Strategy on Prevention of STDs for Youth , 2013, MedInfo.

[11]  Rick Raymer,et al.  Gamification: Using Game Mechanics to Enhance eLearning , 2011, ELERN.

[12]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[13]  Juho Hamari,et al.  Demographic differences in perceived benefits from gamification , 2014, Comput. Hum. Behav..

[14]  Alessandro De Gloria,et al.  A Gamified Short Course for Promoting Entrepreneurship among ICT Engineering Students , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[15]  Katrien Verbert,et al.  How to Use Gamified Dashboards and Learning Analytics for Providing Immediate Student Feedback and Performance Tracking in Higher Education , 2017, WWW.

[16]  Geoff R. Goehle Gamification and Web-based Homework , 2013 .

[17]  Hamid R. Rabiee,et al.  Continuous-Time User Modeling in the Presence of Badges: A Probabilistic Approach , 2017 .

[18]  Jay F. Nunamaker,et al.  An experimental investigation of the effects of group size in an electronic meeting environment , 1990, IEEE Trans. Syst. Man Cybern..

[19]  Robb Lindgren,et al.  Using badges for shaping interactions in online learning environments , 2012, 2012 IEEE International Professional Communication Conference.

[20]  L K Carden Smith,et al.  Positive peer pressure: the effects of peer monitoring on children's disruptive behavior. , 1984, Journal of applied behavior analysis.

[21]  Manuel J. Fonseca,et al.  Improving student creativity with gamification and virtual worlds , 2013, Gamification.

[22]  Milena M. Head,et al.  Competition as an element of gamification for learning: an exploratory longitudinal investigation , 2013, Gamification.

[23]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[24]  Jan Marco Leimeister,et al.  Gamification , 2013, Business & Information Systems Engineering.

[25]  Pablo Gil,et al.  Short Project-Based Learning with MATLAB Applications to Support the Learning of Video-Image Processing , 2017, Journal of Science Education and Technology.

[26]  J. McGonigal Reality Is Broken: Why Games Make Us Better and How They Can Change the World , 2011 .

[27]  E. Deci,et al.  Extrinsic Rewards and Intrinsic Motivation in Education: Reconsidered Once Again , 2001 .

[28]  David Fonseca,et al.  Mixed-methods research: a new approach to evaluating the motivation and satisfaction of university students using advanced visual technologies , 2014, Universal Access in the Information Society.

[29]  Deborah I. Fels,et al.  Gamification in theory and action: A survey , 2015, Int. J. Hum. Comput. Stud..

[30]  Torsten Reiners,et al.  Operationalising gamification in an educational authentic environment , 2012 .

[31]  Susanne Robra-Bissantz,et al.  One for all and all for one - towards a framework for collaboration support systems , 2017, Education and Information Technologies.

[32]  George D. Kuh Assessing What Really Matters to Student Learning Inside The National Survey of Student Engagement , 2001 .

[33]  David W. Johnson,et al.  Conflict in the Classroom: Controversy And Learning , 1979 .

[34]  Fiona Fui-Hoon Nah,et al.  Gamification of Education Using Computer Games , 2013, HCI.

[35]  Paul Denny,et al.  Empirical Support for a Causal Relationship Between Gamification and Learning Outcomes , 2018, CHI.

[36]  FoxJesse,et al.  Assessing the effects of gamification in the classroom , 2015 .

[37]  Elena Karahanna,et al.  Time Flies When You're Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage , 2000, MIS Q..

[38]  Regan L. Mandryk,et al.  Gamifying behaviour that leads to learning , 2013, Gamification.

[39]  Mohamed Shehab,et al.  Investigating temporal access in a flipped classroom: procrastination persists , 2017, International Journal of Educational Technology in Higher Education.

[40]  Star Muir,et al.  The Science of Learning and the Art of Teaching , 2015 .

[41]  Paul Denny,et al.  The effect of virtual achievements on student engagement , 2013, CHI.

[42]  I FelsDeborah,et al.  Gamification in theory and action , 2015 .

[43]  Jorge Gonçalves,et al.  Gamification of Mobile Experience Sampling Improves Data Quality and Quantity , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[44]  Felipe Soares de Oliveira,et al.  PBLMaestro: A virtual learning environment for the implementation of problem-based learning approach in Computer education , 2016, 2016 IEEE Frontiers in Education Conference (FIE).

[45]  G. Orosz,et al.  Are Competition and Extrinsic Motivation Reliable Predictors of Academic Cheating? , 2013, Front. Psychol..

[46]  Zhijiang Dong,et al.  Engaging Computer Science Students through Gamification in an Online Social Network Based Collaborative Learning Environment , 2013 .

[47]  Eric Sanchez,et al.  Classcraft: from gamification to ludicization of classroom management , 2016, Education and Information Technologies.

[48]  Scott Nicholson A User-Centered Theoretical Framework for Meaningful Gamification , 2012 .

[49]  Brent Bridgeman,et al.  Measuring Learning Outcomes in Higher Education , 2012 .

[50]  Christine E. DeMars,et al.  Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions , 2005 .

[51]  Aldo Gordillo,et al.  The city as a learning gamified platform , 2013, 2013 IEEE Frontiers in Education Conference (FIE).

[52]  Tim Olds,et al.  “Active Team” a social and gamified app-based physical activity intervention: randomised controlled trial study protocol , 2017, BMC Public Health.

[53]  I. Gabe Zichermann Ii. Joselin Linder,et al.  Game-Based Marketing: Inspire Customer Loyalty Through Rewards, Challenges, and Contests , 2010 .

[54]  Eva Hammar Chiriac Group work as an incentive for learning – students’ experiences of group work , 2014, Front. Psychol..

[55]  Abraham P. Buunk,et al.  Social Comparison in the Classroom: A Review , 2008 .

[56]  Inés Gil-Jaurena,et al.  Teachers’ roles in light of massive open online courses (MOOCs): Evolution and challenges in higher distance education , 2018, International Review of Education.

[57]  E. Deci,et al.  The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior , 2000 .

[58]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[59]  Hongbiao Yin,et al.  What motivates Chinese undergraduates to engage in learning? Insights from a psychological approach to student engagement research , 2018 .

[60]  Yigal Attali,et al.  Gamification in assessment: Do points affect test performance? , 2015, Comput. Educ..

[61]  Byron Reeves,et al.  Total Engagement: Using Games and Virtual Worlds to Change the Way People Work and Businesses Compete , 2009 .

[62]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[63]  Mange Manyama,et al.  Improving gross anatomy learning using reciprocal peer teaching , 2016, BMC Medical Education.

[64]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[65]  Eva Hammar Chiriac,et al.  Assessment of knowledge and abilities when working in groups : An intervention study in everyday classroom practice , 2014 .

[66]  Zachary Fitz-Walter,et al.  Exploring the opportunities and challenges of using mobile sensing for gamification and achievements , 2011, UbiComp 2011.

[67]  Tenneille Terrell Lamberth,et al.  Gamification in science education: The relationship of educational games to motivation and achievement , 2013 .

[68]  Darryl Charles,et al.  Game-based feedback for educational multi-user virtual environments , 2011, Br. J. Educ. Technol..

[69]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[70]  Katheryn R. Christy,et al.  Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women's math performance , 2014, Comput. Educ..

[71]  Luis Antonio Hernández Ibáñez,et al.  Evaluating user experience in joint activities between schools and museums in virtual worlds , 2014, Universal Access in the Information Society.