Computer Gaming and Interactive Simulations for Learning: A Meta-Analysis

Substantial disagreement exists in the literature regarding which educational technology results in the highest cognitive gain for learners. In an attempt to resolve this dispute, we conducted a meta-analysis to decipher which teaching method, games and interactive simulations or traditional, truly dominates and under what circumstances. It was found that across people and situations, games and interactive simulations are more dominant for cognitive gain outcomes. However, consideration of specific moderator variables yielded a more complex picture. For example, males showed no preference while females showed a preference for the game and interactive simulation programs. Also, when students navigated through the programs themselves, there was a significant preference for games and interactive simulations. However, when teachers controlled the programs, no significant advantage was found. Further, when the computer dictated the sequence of the program, results favored those in the traditional teaching method over the games and interactive simulations. These findings are discussed in terms of their implications for exiting theoretical positions as well as future empirical research.

[1]  J Reis,et al.  Interactive Multimedia Preventive Alcohol Education: A Technology Application in Higher Education , 2000, Journal of drug education.

[2]  Ronghua Ouyang,et al.  A meta-analysis: effectiveness of computer-assisted instruction at the level of elementary education (k--6) , 1993 .

[3]  Conrad Gail Bills,et al.  Effects of Structure and Interactivity on Internet-Based Instruction , 1997 .

[4]  James Laffey,et al.  Supporting Learning and Behavior of At-Risk Young Children , 2003 .

[5]  John T. Stasko,et al.  Do algorithm animations assist learning?: an empirical study and analysis , 1993, INTERCHI.

[6]  Ximena López,et al.  Beyond Nintendo: design and assessment of educational video games for first and second grade students , 2003, Comput. Educ..

[7]  Janis Sue Lowe,et al.  Computer-Based Education , 2001 .

[8]  Claire M. Fletcher-Flinn,et al.  The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis , 1995 .

[9]  H. Schwid,et al.  Use of a computerized advanced cardiac life support simulator improves retention of advanced cardiac life support guidelines better than a textbook review. , 1999, Critical care medicine.

[10]  Lloyd P. Rieber,et al.  Seriously considering play: Designing interactive learning environments based on the blending of microworlds, simulations, and games , 1996 .

[11]  Nick Hammond,et al.  The PsyCLE project: Developing a psychology computer-based learning environment , 1996 .

[12]  Harold F. O'Neil,et al.  Meta-analytic studies of findings on computer-based instruction. , 1994 .

[13]  Tammy VanDeGrift,et al.  Active and cooperative learning techniques for the computer science classroom , 2002 .

[14]  Marc Prensky,et al.  The Motivation of Gameplay or, the REAL 21 st century learning revolution , 2002 .

[15]  Danielle J. Ford,et al.  The Place for the Computer Is in the Laboratory: An Investigation of the Effect of Computer Probeware on Student Learning , 2002 .

[16]  Chen-Lin C. Kulik,et al.  Effectiveness of Computer-Based Education in Secondary Schools. , 1985 .

[17]  Ronald L. Vansickle.  A Quantitative Review of Research on Instructional Simulation Gaming: A Twenty-Year Perspective , 1986 .

[18]  Susan Martin Gould,et al.  Using computer-based assessments to evaluate interactive multimedia nutrition education among low-income predominantly Hispanic participants. , 2002, Journal of nutrition education and behavior.

[19]  Steve Pettifer,et al.  Transfer of route learning from virtual to real environments. , 2003, Journal of experimental psychology. Applied.

[20]  David F. Jackson,et al.  Case Studies of Microcomputer and Interactive Video Simulations in Middle School Earth Science Teaching , 1997 .

[21]  J. Siemer,et al.  Evaluating intelligent tutoring with gaming-simulations , 1995, Winter Simulation Conference Proceedings, 1995..

[22]  Theresa Pesl Murphrey,et al.  Evaluation of a Computer-Based, Asynchronous Activity on Student Learning of Leadership Concepts. , 2002 .

[23]  Alice W. Ryan.  Meta-Analysis of Achievement Effects of Microcomputer Applications in Elementary Schools , 1991 .

[24]  Martin Predavec,et al.  Evaluation of E-Rat, a computer-based rat dissection, in terms of student learning outcomes , 2001 .

[25]  Rauf Yildiz,et al.  The cognitive impact of multimedia simulations on 14 year old students , 1996, Br. J. Educ. Technol..

[26]  Glenn D. Blank,et al.  Adapting multimedia for diverse student learning styles , 2003 .

[27]  A. McFarlane,et al.  Report on the educational use of games , 2002 .

[28]  J. McGrenere,et al.  Design : Educational Electronic Multi-Player Games A Literature Review , 1996 .

[29]  Linda McGarvey.  Microcomputer Use in Kindergarten and at Home: Design of the Study and Effects of Computer Use on School Readiness. , 1986 .

[30]  Y. Kafai.  The Educational Potential of Electronic Games: From Games-to-Teach to Games-to-Learn , 2001 .

[31]  James P. Bliss,et al.  The Effectiveness of Virtual Reality for Administering Spatial Navigation Training to Firefighters , 1997, Presence: Teleoperators & Virtual Environments.

[32]  Yasmin B. Kafai,et al.  Minds In Play: Computer Game Design as a Context for Children''s , 1994 .

[33]  Edwin P. Christmann,et al.  A Meta-Analytic Comparison of the Effects of Computer-Assisted Instruction on Elementary Students' , 2003 .

[34]  Jong Hoon Kim,et al.  Learning by Computer Simulation Does Not Lead to Better Test Performance on Advanced Cardiac Life Support Than Textbook Study. , 2002, The journal of education in perioperative medicine : JEPM.

[35]  Harold F. O'Neil,et al.  Technology assessment in education and training , 1994 .

[36]  K ProulxViera,et al.  Using the WWW as the delivery mechanism for interactive, visulaization-based instructional modules , 1997 .

[37]  Michael B. Cowen,et al.  Designing an Instructional Simulation for a Program Entry Panel , 1993 .

[38]  Gerard George,et al.  Technology-Assisted Instruction in Business Schools: Measured Effects on Student Attitudes, Expectations and Performance , 1996 .

[39]  Jenny Pange,et al.  Teaching Probabilities and Statistics to Preschool Children , 2003 .

[40]  David H. Jonassen,et al.  Designing structured hypertext and structuring access to hypertext , 1988 .

[41]  Byung-Soon Choi,et al.  The Effectiveness of Using Computer Simulated Experiments on Junior High Students' Understanding of the Volume Displacement Concept , 1987 .

[42]  Adam Bickford.  Analysis of 2004 MAP Results for eMINTS Students , 2005 .

[43]  R. Clark.  Media will never influence learning , 1994 .

[44]  Elissa L. Perry,et al.  The role of work, play, and fun in microcomputer software training , 1997, DATB.

[45]  S. Järvelä,et al.  The Interaction of Motivational Orientation and Knowledge-Seeking Inquiry in Computer-Supported Collaborative Learning , 1999 .

[46]  C. Douglas Wetzel,et al.  The Effectiveness of Games for Educational Purposes: A Review of Recent Research , 1992 .

[47]  Adam Rifkin.  eText: an interactive environment for learning parallel programming , 1994, SIGCSE '94.

[48]  Miky Ronen,et al.  Simulation - a bridge between theory and reality: the case of electric circuits , 2001, J. Comput. Assist. Learn..

[49]  Elliot Soloway.  No one is making money in educational software , 1998, CACM.

[50]  Antonella De Angeli,et al.  Evaluating the Educational Impact of a Tutoring Hypermedia for Children , 2003 .

[51]  Thomas Andre,et al.  Using a computer simulation before dissection to help students learn anatomy , 2000 .

[52]  Synnöve Kekkonen-Moneta,et al.  E-Learning in Hong Kong: comparing learning outcomes in online multimedia and lecture versions of an introductory computing course , 2002, Br. J. Educ. Technol..

[53]  P. Jeffries,et al.  Intravenous catheter training system: computer-based education versus traditional learning methods. , 2003, American journal of surgery.

[54]  Sule Bayraktar,et al.  A Meta-analysis of the Effectiveness of Computer-Assisted Instruction in Science Education , 2000 .

[55]  A. Georges L. Romme.  Learning Outcomes of Microworlds for Management Education , 2003 .

[56]  June Lee,et al.  Effectiveness of Computer-Based Instructional Simulation: A Meta Analysis. , 1999 .

[57]  J. Stanley,et al.  Book Review: Taxonomy of Educational Objectives, The Classification of Educational Goals, Handbook I: Cognitive Domain , 1957 .

[58]  J. H. Baxter,et al.  Interactive multimedia and concrete three-dimensional modelling , 1999, J. Comput. Assist. Learn..

[59]  Jenny Schwarz,et al.  Students can learn medicine with computers , 1992 .

[60]  Catherine Weir,et al.  Evaluation of the teaching of statistical concepts by interactive experience with Monte Carlo simulations , 1991 .

[61]  M. Prensky.  The motivation of gameplay , 2002 .

[62]  Armando Baltra.  Language Learning through Computer Adventure Games , 1990 .

[63]  Ricardo Jiménez-Peris,et al.  Using the WWW as the delivery mechanism for interactive, visualization-based instructional modules (report of the ITiCSE 1997 working group on visualization) , 1997, ITiCSE-WGR.

[64]  Herbert J. Walberg,et al.  Learner-Control Effects: A Review of Reviews and a Meta-Analysis , 1996 .

[65]  Dale E. Berger,et al.  Implementing Educational Software and Evaluating Its Academic Effectiveness: Part I. , 1988 .

[66]  Tamar Levine,et al.  Classroom Environment in Computer‐integrated Science Classes: effects of gender and computer ownership , 1996 .

[67]  John Coverdale,et al.  Learning by doing: teaching critical appraisal of randomized trials by performing an in-class randomized trial. , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[68]  Keith A. Willoughby,et al.  In-Class Simulation Games: Assessing Student Learning , 2003, J. Inf. Technol. Educ..

[69]  Martyn Wild,et al.  Motivation and interface design: maximising learning opportunities , 1998, J. Comput. Assist. Learn..

[70]  David Ginat,et al.  Simulation game for teaching communications protocols , 1997, SIGCSE '97.

[71]  Mário Rui Gomes,et al.  Modeling reality with simulation games for a cooperative learning , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[72]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based education in colleges , 1986 .

[73]  G. Andrews,et al.  Privacy and the computerised medical record , 1992, The Medical journal of Australia.

[74]  Robert D. Hess,et al.  School-Relevant Effects of Educational Uses of Microcomputers in Kindergarten Classrooms and Homes , 1987 .

[75]  JoAnne Brewster,et al.  Teaching Abnormal Psychology in a Multimedia Classroom , 1996 .

[76]  Valerie J. Shute,et al.  A Large-Scale Evaluation of an Intelligent Discovery World: Smithtown , 1990, Interact. Learn. Environ..

[77]  Tony Manninen,et al.  Contextual Virtual Interaction as Part of Ubiquitous Game Design and Development , 2002, Personal and Ubiquitous Computing.

[78]  Gavan Lintern,et al.  Rehearsal versus Map Study as Preparation for a Flight Navigation Exercise , 1999, Hum. Factors.

[79]  Antonio Rizzo,et al.  New Active Tools for Supporting Narrative Structures , 2002, Personal and Ubiquitous Computing.

[80]  Marios C. Angelides,et al.  Evaluating intelligent tutoring with gaming-simulations , 1995, WSC '95.

[81]  Lawrence J. Najjar,et al.  Using a wearable computer for continuous learning and support , 1999, Mob. Networks Appl..

[82]  G R Norman,et al.  Do virtual computer models hinder anatomy learning? , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[83]  Karen Littleton,et al.  The mediating effect of task presentation on collaboration and children’s acquisition of scientific reasoning , 2000 .

[84]  John Kirriemuir Ceangal.  The relevance of video games and gaming consoles to the Higher and Further Education learning experience , 2002 .

[85]  John J. Hirschbuhl,et al.  Does interactive multimedia promote achievement and higher level thinking skills for today's science students? , 1999, Br. J. Educ. Technol..

[86]  James B. Schreiber,et al.  Efficacy of educational technology in elementary and secondary classrooms: a meta-analysis of the research literature from 1992--2002 , 2002 .

[87]  Max M. North,et al.  Immersive visualization tool for pedagogical practices of computer science concepts: a pilot study , 2004 .

[88]  Parshotam Dass,et al.  Improving Students’ Self-Efficacy in Strategic Management: The Relative Impact of Cases and Simulations , 2000 .

[89]  Christian Wagner,et al.  Personal computer adventure games: their structure, principles, and applicability for training , 1997, DATB.