Challenges in the evaluation of educational computer games

Computer games have been used for educational purposes nowadays. The implementations of educational computer games bring some challenges and issues that need to be highlighted. There are three challenges in evaluating educational computer games which are the evaluation criteria, the evaluators and the evaluation process. Evaluation criteria have been identified and it consists of five issues which are Interface, Educational, Content, Playability and Multimedia. The evaluators are real and surrogate users. The third challenge is regarding evaluation process and one of the suitable processes is by implementing formative evaluation in order to develop a comprehensive and practical educational computer games.

[1]  Dimitris Grammenos,et al.  Game over: learning by dying , 2008, CHI.

[2]  Burkhard Wünsche,et al.  Evaluation of game engines for simulated surgical training , 2007, GRAPHITE '07.

[3]  Mark John Taylor,et al.  Using animation to support the teaching of computer game development techniques , 2008, Comput. Educ..

[4]  Tammy S. Sugarman,et al.  Play to Win! Using Games in Library Instruction to Enhance Student Learning , 2005 .

[5]  K. Kiili.  Content creation challenges and flow experience in educational games: The IT-Emperor case , 2005, Internet High. Educ..

[6]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[7]  Shumin Zhai,et al.  Learning shape writing by game playing , 2007, CHI Extended Abstracts.

[8]  Chien Chou,et al.  Gender differences in Taiwan high school students' computer game playing , 2007, Comput. Hum. Behav..

[9]  Scott P. Robertson,et al.  The development of an interactive game-based tool for learning surgical management algorithms via computer. , 2002, American journal of surgery.

[10]  Kursat Cagiltay,et al.  A descriptive study of Turkish high school students' game-playing characteristics and their considerations concerning the effects of games , 2008, Comput. Hum. Behav..

[11]  Lee M. Sherlock.  When social networking meets online games: the activity system of grouping in world of warcraft , 2007, SIGDOC '07.

[12]  Yao-Ting Sung,et al.  Designing multimedia games for young children's taxonomic concept development , 2008, Comput. Educ..

[13]  Fred Percival,et al.  A Handbook of Game Design , 1982 .

[14]  Vian Ahmed,et al.  Use of a simulation game in delivering blended lifelong learning in the construction industry - Opportunities and Challenges , 2008, Comput. Educ..

[15]  Christine Brown,et al.  Computer game development as a literacy activity , 2009, Comput. Educ..

[16]  Martin R. Gibbs,et al.  Evaluating a distributed physical leisure game for three players , 2007, OZCHI '07.

[17]  A. Jaafar,et al.  Playability Heuristics Evaluation (PHE) approach for Malaysian educational games , 2008, 2008 International Symposium on Information Technology.

[18]  Azizah Jaafar,et al.  Notice of RetractionConceptual Framework for a Heuristics Based Methodology for Interface Evaluation of Educational Games , 2009, 2009 International Conference on Computer Technology and Development.

[19]  Cathy S. Greenblat,et al.  Designing Games and Simulations: An Illustrated Handbook , 1987 .

[20]  Magy Seif El-Nasr,et al.  Fun & games: on the process of game design , 2006, DIS '06.

[21]  Martin Ebner,et al.  Successful implementation of user-centered game based learning in higher education: An example from civil engineering , 2007, Comput. Educ..

[22]  Colin Tattersall,et al.  Re-purposing existing generic games and simulations for e-learning , 2007, Comput. Hum. Behav..

[23]  Melissa A. Federoff,et al.  HEURISTICS AND USABILITY GUIDELINES FOR THE CREATION AND EVALUATION OF FUN IN VIDEO GAMES , 2002 .

[24]  Charlotte Wiberg,et al.  Master of the game: assessing approachability in future game design , 2008, CHI Extended Abstracts.

[25]  Joohyeon Lee,et al.  Key factors of heuristic evaluation for game design: Towards massively multi-player online role-playing game , 2007, Int. J. Hum. Comput. Stud..

[26]  Goknur Kaplan Akilli,et al.  Games and Simulations: A New Approach in Education , 2009 .

[27]  Azizah Jaafar,et al.  Conceptual Framework for a Heuristics Based Methodology for Interface Evaluation of Educational Games , 2010, Comput. Inf. Sci..

[28]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[29]  James Noble,et al.  Video game values: Human-computer interaction and games , 2007, Interact. Comput..

[30]  Thomas W. Malone,et al.  What Makes Things Fun to Learn? A Study of Intrinsically Motivating Computer Games. , 1981 .

[31]  C. Douglas Wetzel,et al.  The Effectiveness of Games for Educational Purposes: A Review of Recent Research , 1992 .

[32]  Chuck Clanton,et al.  An interpreted demonstration of computer game design , 1998, CHI Conference Summary.

[33]  Diane Magrane,et al.  Educational games in an obstetrics and gynecology core curriculum. , 2005, American journal of obstetrics and gynecology.

[34]  Chin-Lung Hsu,et al.  Consumer behavior in online game communities: A motivational factor perspective , 2007, Comput. Hum. Behav..

[35]  Brigid Barron,et al.  Continuing motivation for game design , 2007, CHI Extended Abstracts.

[36]  Thomas W. Malone,et al.  Heuristics for designing enjoyable user interfaces: Lessons from computer games , 1982, CHI '82.

[37]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[38]  Kamran Sedig,et al.  Toward operationalization of 'flow' in mathematics learnware , 2007, Comput. Hum. Behav..

[39]  James Minogue,et al.  Investigating the impact of video games on high school students' engagement and learning about genetics , 2009, Comput. Educ..

[40]  Janet C. Read,et al.  Design in evaluation: reflections on designing for children's technology , 2007, BCS HCI.

[41]  R. Ramli,et al.  Remote Usability Evaluation System (e-RUE) , 2009, 2009 Second International Conference on Computer and Electrical Engineering.

[42]  Azizah Jaafar,et al.  Heuristics evaluation in computer games , 2010, 2010 International Conference on Information Retrieval & Knowledge Management (CAMP).

[43]  Iván Martínez-Ortiz,et al.  Educational game design for online education , 2008, Comput. Hum. Behav..

[44]  Raija Hämäläinen,et al.  Designing and evaluating collaboration in a virtual game environment for vocational learning , 2008, Comput. Educ..

[45]  Rebekah Shultz Colby,et al.  A Pedagogy of Play: Integrating Computer Games into the Writing Classroom , 2008 .

[46]  John V. Dempsey,et al.  Instructional Gaming: Implications for Instructional Technology. , 1994 .

[47]  Hakan Tüzün,et al.  The effects of computer games on primary school students' achievement and motivation in geography learning , 2009, Comput. Educ..

[48]  David Pinelle,et al.  Using genres to customize usability evaluations of video games , 2008, Future Play.

[49]  K. Kiili.  Digital game-based learning: Towards an experiential gaming model , 2005, Internet High. Educ..

[50]  David Gibson,et al.  Games And Simulations in Online Learning: Research and Development Frameworks , 2006 .

[51]  Chris Crawford,et al.  The Art of Computer Game Design , 1984 .

[52]  Randy J. Pagulayan,et al.  User-centered design in games , 2012 .

[53]  Judy Robertson,et al.  Computer game design: Opportunities for successful learning , 2008, Comput. Educ..

[54]  Tzu-Hua Wang,et al.  Web-based quiz-game-like formative assessment: Development and evaluation , 2008, Comput. Educ..

[55]  Serkan Çankaya,et al.  The effects of educational computer games on students’ attitudes towards mathematics course and educational computer games , 2009 .

[56]  Wendy A. Kellogg,et al.  Games for virtual team building , 2008, DIS '08.

[57]  B. D. Coller,et al.  Effectiveness of using a video game to teach a course in mechanical engineering , 2009, Comput. Educ..

[58]  Roope Raisamo,et al.  Design and evaluation of a tactile memory game for visually impaired children , 2007, Interact. Comput..

[59]  Joohyeon Lee,et al.  RETRACTED: Key factors of heuristic evaluation for game design: Towards massively multi-player online role-playing game , 2007 .

[60]  Derek P. Robertson,et al.  Learning gains from using games consoles in primary classrooms: a randomized controlled study , 2009 .

[61]  Shaowen Bardzell,et al.  Making user engagement visible: a multimodal strategy for interactive media experience research , 2008, CHI Extended Abstracts.

[62]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[63]  Serhat Aydin,et al.  Students’ conceptions about browser-game-based learning in mathematics education: TTNetvitamin case , 2009 .

[64]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[65]  Martin Oliver,et al.  How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? , 2006, Comput. Educ..

[66]  Pilar Lacasa,et al.  Bringing Commercial Games into the Classroom , 2008 .

[67]  Manfred Tscheligi,et al.  Evaluating user experiences in games , 2008, CHI Extended Abstracts.

[68]  Yıldız Turgut,et al.  Young learners’ language learning via computer games , 2009 .

[69]  Fengfeng Ke,et al.  A case study of computer gaming for math: Engaged learning from gameplay? , 2008, Comput. Educ..

[70]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.