CMX: The Effects of an Educational MMORPG on Learning and Teaching Computer Programming

Computer programming has for decades posed several difficulties for students of all educational levels. A number of teaching approaches have been proposed over the years but none seems to fulfil the needs of students nowadays. Students use computers mainly for playing games and the Internet and as quite a few researchers state this aspect of computers should be taken into account in the way we educate them. Towards this direction, this paper aims to examine the effects of using an educational Massive Multiplayer Online Role Playing Game (MMORPG) on teaching and learning computer programming. The educational features of an MMORPG called CMX are presented along with a design framework that was devised taking into account previous work in designing educational games. The effects of CMX on teaching and learning computer programming are assessed through a study with first-year undergraduate students. Seventy six students used CMX over a period of five weeks for learning various procedural programming concepts. Students evaluated various aspects of CMX by filling in a questionnaire that was based on an evaluation framework, which was devised in accordance with the design framework of CMX. Moreover, the results of a midterm exam that took place prior to using CMX and students’ accomplishments in the context of CMX were recorded and analyzed. The results show that the majority of the students was entertained by playing the game while learning, and felt motivated to continue based on the game's scenario due to the variety of activities included. In regards to the students’ performance, a pre-test and a post-test were carried out in the experimental group, i.e., the participants of this study, and the control group, i.e., students of the course that continued to get taught the same concepts and performed the same assignments as the experimental group, but traditionally. The pre-test and post-test analysis of the performance results for both groups showed that the majority of the students in the experimental group increased their performance in computer programming. Furthermore, students stated they had a positive attitude in regards to re-using CMX in the future in order to learn additional programming concepts. The positive results of this study pave the way for CMX being used in the classroom and expanding the game's functionalities that will further increase students’ performance and support teachers in delivering the required knowledge. Moreover, the work reported in this paper offers game designers and teachers methodological and empirical results for game-based learning in such a difficult domain as is computer programming. What is more, the design and evaluation frameworks presented are general enough that they can be easily adjusted and/or extended for designing and assessing educational games in other domains as well.

[1]  Tiffany Barnes,et al.  Game2Learn: building CS1 learning games for retention , 2007, ITiCSE.

[2]  Michele D. Dickey.  Game design and learning: a conjectural analysis of how massively multiple online role-playing games (MMORPGs) foster intrinsic motivation , 2007 .

[3]  Azizah Jaafar,et al.  Educational games (EG) design framework: Combination of game design, pedagogy and content modeling , 2009, 2009 International Conference on Electrical Engineering and Informatics.

[4]  Christopher J. Ferguson,et al.  Call of (civic) duty: Action games and civic behavior in a large sample of youth , 2011, Comput. Hum. Behav..

[5]  Kevin Keeker,et al.  What's my method?: a game show on games , 2004, CHI EA '04.

[6]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[7]  Melissa A. Federoff,et al.  HEURISTICS AND USABILITY GUIDELINES FOR THE CREATION AND EVALUATION OF FUN IN VIDEO GAMES , 2002 .

[8]  S. Loewen.  The role of feedback , 2011 .

[9]  Alexander von Eye,et al.  Information technology use and creativity: Findings from the Children and Technology Project , 2012, Comput. Hum. Behav..

[10]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[11]  Melissa Terlecki,et al.  Sex Differences and Similarities in Video Game Experience, Preferences, and Self-Efficacy: Implications for the Gaming Industry , 2011 .

[12]  Maja Matijasevic,et al.  MMORPG Player actions: Network performance, session patterns and latency requirements analysis , 2009, Multimedia Tools and Applications.

[13]  Sujing Zhang,et al.  EFM: A Model for Educational Game Design , 2008, Edutainment.

[14]  Robert Moser,et al.  A fantasy adventure game as a learning environment: why learning to program is so difficult and what can be done about it , 1997, ITiCSE '97.

[15]  Stelios Xinogalos,et al.  Integrating Learning Analytics in an Educational MMORPG for Computer Programming , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[16]  Patrice Torguet,et al.  Experimental Feedback on Prog&Play: A Serious Game for Programming Practice , 2011, Comput. Graph. Forum.

[17]  K. Kiili.  Content creation challenges and flow experience in educational games: The IT-Emperor case , 2005, Internet High. Educ..

[18]  Stéphane Natkin,et al.  User model in multiplayer mixed reality entertainment applications , 2006, ACE '06.

[19]  Tiffany Barnes,et al.  Experimental evaluation of teaching recursion in a video game , 2009, SIGGRAPH 2009.

[20]  Weinan Zhao,et al.  The relationship between video game use and a performance-based measure of persistence , 2013, Comput. Educ..

[21]  Sara de Freitas,et al.  A framework for developing serious games to meet learner needs , 2006 .

[22]  Gwo-Jen Hwang,et al.  A Learning Style Perspective to Investigate the Necessity of Developing Adaptive Learning Systems , 2013, J. Educ. Technol. Soc..

[23]  Christoph Klimmt,et al.  Explaining the enjoyment of playing video games: the role of competition , 2003, ICEC.

[24]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[25]  Stelios Xinogalos,et al.  Towards optimizing server performance in an educational MMORPG for teaching computer programming , 2013 .

[26]  Wen-Chih Chang,et al.  Introductory C Programming Language Learning with Game-Based Digital Learning , 2008, ICWL.

[27]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[28]  Fred D. Davis.  A technology acceptance model for empirically testing new end-user information systems : theory and results , 1985 .

[29]  Daniel M. Johnson,et al.  Player-Centered Game Environments: Assessing Player Opinions, Experiences, and Issues , 2004, ICEC.

[30]  Shalom M. Fisch,et al.  Making educational computer games "educational" , 2005, IDC '05.

[31]  Valerie J. Shute,et al.  Video gameplay, personality and academic performance , 2012, Comput. Educ..

[32]  J. Gee.  Learning by design: Games as learning machines , 2004 .

[33]  Gary B. Wills,et al.  A Conceptual Framework for Serious Games , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[34]  Atsusi Hirumi,et al.  The effects of modern mathematics computer games on mathematics achievement and class motivation , 2010, Comput. Educ..

[35]  Stelios Xinogalos,et al.  Designing Educational Games for Computer Programming: A Holistic Framework. , 2014 .

[36]  C. S. Green,et al.  Learning, Attentional Control, and Action Video Games , 2012, Current Biology.

[37]  Stelios Xinogalos,et al.  Towards a new massive multiplayer online role playing game for introductory programming , 2013, BCI '13.

[38]  Robert D. Macredie,et al.  Teaching Introductory Programming: A Quantitative Evaluation of Different Approaches , 2015, TOCE.

[39]  Etienne Wenger,et al.  Communities of Practice: Learning, Meaning, and Identity , 1998 .

[40]  Daniel M. Johnson,et al.  Effective affective user interface design in games , 2003, Ergonomics.

[41]  J. Paul Gibson,et al.  RoboCode & problem-based learning: a non-prescriptive approach to teaching programming , 2006, ITICSE '06.

[42]  Franca Garzotto,et al.  Investigating the educational effectiveness of multiplayer online games for children , 2007, IDC.

[43]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.