Assessment for Game-Based Learning

Looking at the historical synopsis of games, an antagonism between games and work is noticeable. However, another important question is present: How can a game be beneficial for life? Games are classified as fully recreational games, serious games for informal context, serious games for formal context, and as assessment games. However, the implementation of assessment features into game-based learning environments is only in its early stages because it adds a very time-consuming step to the design process. Basically, assessment for game-based learning is distinguished between game scoring, external, and embedded assessment. Strength and weaknesses of assessment methodologies are discussed. The chapter concludes that intelligent assessment of game-based learning will be the challenges for the twenty-first century instructional designers and serious games developers.

[1]  Katie Salen,et al.  Gaming literacies: A game design study in action , 2007 .

[2]  G. Calleja.  Digital games as designed experience : reframing the concept of immersion , 2007 .

[3]  Robert D. Macredie,et al.  Games and the Design of Human‐Computer Interfaces , 1994 .

[4]  J. Huizinga.  Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[5]  Graham J Hitch,et al.  Children's working-memory processes: a response-timing analysis. , 2003, Journal of experimental psychology. General.

[6]  Paul Kearney,et al.  Games for Learning and Learning from Games , 2007, Informatica.

[7]  C. Sennersten,et al.  Dissecting Play - Investigating the Cognitive and Emotional Motivations and Affects of Computer Gameplay 1 , 2008 .

[8]  Elisheva F. Gross,et al.  The impact of home computer use on children's activities and development. , 2000, The Future of children.

[9]  Kristian Kiili,et al.  Foundation for problem-based gaming , 2007, Br. J. Educ. Technol..

[10]  R. Jayakanthan,et al.  Application of computer games in the field of education , 2002, Electron. Libr..

[11]  Hitendra K. Pillay,et al.  Cognition and Recreational Computer Games: Implications for Educational Technology , 1999 .

[12]  John Rice,et al.  New media resistance: Barriers to implementation of computer video games in the classroom , 2007 .

[13]  Diana G. Oblinger,et al.  The Next Generation of Educational Engagement , 2004 .

[14]  Gregory K. W. K. Chung,et al.  Issues in the Computer-based Assessment of Collaborative Problem Solving , 2003 .

[15]  Dirk Ifenthaler,et al.  Understanding models for learning and instruction , 2008 .

[16]  James W. Pellegrino,et al.  Knowing What Students Know. , 2003 .

[17]  L. Ruberg.  FROM Association for the Advancement of Computing in Education ( AACE ) , 2012 .

[18]  Herberg Rosenstingl,et al.  Towards a Positive Assessment Policy for Computer and Console Games , 2008 .

[19]  Maja Pivec,et al.  Informal discussion forums: Can we harness the same passion in class , 2007 .

[20]  Dirk Ifenthaler,et al.  Bridging the Gap between Expert-Novice Differences , 2010 .

[21]  P. Attewell,et al.  Computers and Young Children: Social Benefit or Social Problem? , 2003 .

[22]  Sue Bennett,et al.  The 'digital natives' debate: A critical review of the evidence , 2008, Br. J. Educ. Technol..

[23]  Marc Prensky,et al.  Don't bother me, Mom, I'm learning! , 2006 .

[24]  B. Moore.  Neurocognitive outcomes in survivors of childhood cancer. , 2005, Journal of pediatric psychology.

[25]  Alessandro Antonietti,et al.  The Difference Between Playing Games With and Without the Computer: A Preliminary View , 2003, The Journal of psychology.

[26]  Jennifer Jenson,et al.  How Content Matters: Rethinking Educational Games , 2006 .

[27]  Kinshuk,et al.  Multiple perspectives on problem solving and learning in the digital age , 2011 .

[28]  Christian Sebastian Loh.  Designing Online Games Assessment as : Information Trails , 2007 .

[29]  Richard De Lisi,et al.  Computer experience and gender differences in undergraduate mental rotation performance , 1996 .

[30]  David Gibson,et al.  Games And Simulations in Online Learning: Research and Development Frameworks , 2006 .

[31]  Simon Egenfeldt-Nielsen.  Overview of research on the educational use of video games , 2006 .

[32]  R. Riding,et al.  Cognitive style, working memory and learning behaviour and attainment in school subjects. , 2003, The British journal of educational psychology.

[33]  Dirk Ifenthaler,et al.  Bridging the gap between expert-novice differences : the model-based feedback approach , 2009, CELDA 2009.

[34]  Paul J. Sticha,et al.  Evaluation of a Spatial Data Management System for Basic Skills Education , 1986 .

[35]  Jeffrey Chin,et al.  Assessment in Simulation and Gaming , 2009 .

[36]  Janet Allison Dowey.  Computer games for dental health education in primary schools , 1987 .

[37]  Maja Pivec,et al.  The Training Room- A web-based multiuser teaching tool , 2008 .

[38]  Dirk Ifenthaler.  Model-based feedback for improving expertise and expert performance , 2009 .

[39]  Lucy A. Joyner,et al.  Accounting for User Needs and Motivations in Game Design , 2003 .

[40]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[41]  D. Benner,et al.  Historisches Wörterbuch der Pädagogik , 2010 .

[42]  Dirk Ifenthaler,et al.  Alternative Assessment Strategies for Complex Problem Solving in Game-Based Learning Environments , 2011 .

[43]  R. Ferdig.  Learning and Teaching with Electronic Games , 2009 .

[44]  P. Schrader,et al.  The acquisition of skill and expertise in massively multiplayer online games , 2008 .

[45]  Michael C. Heil,et al.  THE EFFECTS OF PREVIOUS COMPUTER EXPERIENCE ON AIR TRAFFIC-SELECTION AND TRAINING (AT-SAT) TEST PERFORMANCE. , 2000 .

[46]  Goknur Kaplan Akilli,et al.  Games and Simulations: A New Approach in Education , 2009 .

[47]  Joseph Betz.  Computer Games: Increase Learning in an Interactive Multidisciplinary Environment , 1995 .

[48]  M. Pépin,et al.  Effect of Playing a Video Game on a Measure of Spatial Visualization , 1986, Perceptual and motor skills.

[49]  Steve W. J. Kozlowski,et al.  Current issues and future directions in simulation-based training in North America , 2008 .

[50]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[51]  Steven L. Kent.  The Ultimate History of Video Games: From Pong to Pokemon--the Story behind the Craze That Touched Our Lives and Changed the World , 2001 .

[52]  Seonju Ko,et al.  An Empirical Analysis of Children's Thinking and Learning in a Computer Game Context , 2002 .

[53]  Rikke Magnussen.  Teacher roles in learning games - When games become situated in schools , 2007, DiGRA Conference.

[54]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[55]  Anne-Marie Schleiner,et al.  Does Lara Croft Wear Fake Polygons? Gender and Gender-Role Subversion in Computer Adventure Games , 2001, Leonardo Music Journal.

[56]  Paul Pivec.  Movement Based Learning: An Analysis of Dance Dance Revolution , 2008 .

[57]  David M. Kennedy,et al.  Visual mapping: a tool for design, development and communication in the development of IT-rich learning environments , 2002, ASCILITE.

[58]  David J. Miller,et al.  Using a games console in the primary classroom: Effects of 'Brain Training' programme on computation and self-esteem , 2010, Br. J. Educ. Technol..

[59]  Dirk Ifenthaler,et al.  Planning and Assessing Navigation in Model-Centered Learning Environments. Why Learners Often Do Not Follow the Path Laid Out for Them , 2005 .

[60]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[61]  David Walsh,et al.  Video Game Violence and Public Policy , 2007 .

[62]  Clark Aldrich,et al.  Virtual Worlds, Simulations, and Games for Education: A Unifying View , 2009 .

[63]  David M. Kennedy,et al.  Making the Transition From Print: Integrating Concept Mapping and Online Communication With Traditional Distance Education Materials , 2002 .

[64]  Simon Egenfeldt-Nielsen,et al.  Third generation educational use of computer games , 2007 .

[65]  W. J. Woollard.  TTRB Review: Games and learning - a handbook from Futurelab , 2007 .

[66]  Melanie Zibit,et al.  Online Games for 21st Century Skills , 2007 .

[67]  Kurt Squire,et al.  Video games in education , 2003, Int. J. Intell. Games Simul..

[68]  Gregory K. W. K. Chung,et al.  An Exploratory Study to Examine the Feasibility of Measuring Problem-Solving Processes Using a Click-Through Interface , 2003 .

[69]  Torsten Reiners,et al.  Virtual Environment for Immersive Learning of Container Logistics , 2008 .

[70]  J. McGrenere,et al.  Design : Educational Electronic Multi-Player Games A Literature Review , 1996 .

[71]  Lucia Pannese,et al.  Games and learning come together to maximise effectiveness: The challenge of bridging the gap , 2007, Br. J. Educ. Technol..

[72]  Jan Johnson Yopp.  Behind the Message: Information Strategies for Communicators , 2005 .

[73]  Gloria Banner,et al.  Working memory, cognitive style, and behavioural predictors of GCSE exam success , 2008 .

[74]  A. McMahan.  Immersion, Engagement, and Presence: A Method for Analyzing 3-D Video Games , 2013 .

[75]  Vicki Belt.  Employability Skills: A Research and Policy Briefing , 2010 .

[76]  Maizatul Hayati Mohamad Yatim.  Usability and Fun Evaluation of a Game Authoring Tool , 2008 .

[77]  M. Posner.  Foundations of cognitive science , 1989 .

[78]  Katrin Becker,et al.  Digital game-based learning once removed: Teaching teachers , 2007, Br. J. Educ. Technol..

[79]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[80]  Mark Griffiths,et al.  Video games and health , 2005, BMJ : British Medical Journal.

[81]  James H. Wiebe,et al.  The impact of a computer-based adventure game on achievement and attitudes in geography , 1994 .

[82]  S. Freitas.  Learning in immersive worlds: A review of game-based learning , 2006 .

[83]  Paul Plass,et al.  Ludi publici : Untersuchungen zur Entstehung und Entwicklung der öffentlichen Spiele im republikanischen Rom , 2000, Journal of Roman Studies.

[84]  Pamela S. Schindler,et al.  Business research methods 12th ed. , 2014 .

[85]  Paul Kearney,et al.  Cognitive Callisthenics: Do FPS computer games enhance the player's cognitive abilities? , 2005, DiGRA Conference.

[86]  Roni Linser,et al.  BLACK BLIZZARD - DESIGNING ROLE-PLAY SIMULATIONS FOR EDUCATION , 2007 .

[87]  A. Baddeley.  The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[88]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[89]  Paul Kearney.  Cognitive Assessment of Movement-Based Computer Games , 2008 .

[90]  Maja Pivec,et al.  Collaborative Online Roleplay for Adult Learners. , 2010 .

[91]  R. Wilton.  The Psychology of Learning and Motivation: Advances in Research and Theory. Vol 4. , 1972 .

[92]  Michael J. Lawson,et al.  Computer Adventure Games as Problem-Solving Environments , 2002 .

[93]  Ana Paiva,et al.  Empathic Characters in Computer-based Personal and Social Education , 2004 .

[94]  Sugata Mitra,et al.  Children and the Internet: experiments with minimally invasive education in India , 2001, Br. J. Educ. Technol..

[95]  Debbie Denise Reese,et al.  First steps and beyond: Serious games as preparation for future learning , 2007 .

[96]  Joel E. Foreman.  Game-Based Learning: How to Delight and Instruct in The 21st Century. , 2004 .

[97]  Simon Egenfeldt-Nielsen,et al.  Keep the monkey rolling: eye-hand coordination in Super Monkey Ball , 2003, DiGRA Conference.

[98]  J. Willett.  Chapter 9: Questions and Answers in the Measurement of Change , 1988 .

[99]  Irma Lindt.  Integrated Project on Pervasive Gaming , 2005 .

[100]  ELLEN WARTELLA.  New Generations – New Media , 2002 .

[101]  H. Forssberg,et al.  Training of Working Memory in Children With ADHD , 2002 .

[102]  P. Frensch,et al.  Effects of video game playing on measures of spatial performance: Gender effects in late adolescence. , 1994 .

[103]  Andrew R. A. Conway,et al.  Working memory capacity and its relation to general intelligence , 2003, Trends in Cognitive Sciences.

[104]  Maja Pivec,et al.  Playing to Learn: Guidelines for Designing Educational Games , 2008 .

[105]  John O. Willis,et al.  Wechsler Intelligence Scale for Children–Fourth Edition , 2014 .

[106]  Jean Piaget,et al.  Nachahmung, Spiel und Traum : die Entwicklung der Symbolfunktion beim Kinde , 1969 .

[107]  J. Gee,et al.  How Computer Games Help Children Learn , 2006 .

[108]  Staffan Björk,et al.  Describing Games: An Interaction-Centric Structural Framework , 2003, DiGRA Conference.

[109]  Traci Sitzmann.  A META-ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER-BASED SIMULATION GAMES , 2011 .

[110]  D. Gentile,et al.  The impact of video games on training surgeons in the 21st century. , 2007, Archives of surgery.

[111]  R. Caillois,et al.  Man, Play and Games , 1958 .

[112]  Geertje Bekebrede,et al.  Serious games and 'simulation Based E-Learning' for infrastructure management , 2006 .

[113]  J. Thomas Butler.  Games and simulations: Creative educational alternatives , 1988 .

[114]  Jaishree Odin.  E‐tivities: The Key to Active Online Learning , 2003 .

[115]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[116]  Walter Wager,et al.  Presenting questions, processing responses, and providing feedback in CAI , 1985 .

[117]  Sonja Ganguin.  Computerspiele und lebenslanges Lernen , 2010 .

[118]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[119]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[120]  Rocky Ross,et al.  Mental models , 2004, SIGA.

[121]  Sonja Ganguin.  Computerspiele und lebenslanges Lernen : eine Synthese von Gegensätzen , 2010 .

[122]  S. Pickering,et al.  Working memory skills and educational attainment: evidence from national curriculum assessments at 7 and 14 years of age , 2004 .

[123]  Feng S. Din,et al.  Playing Computer Games Versus Better Learning , 2000 .

[124]  Jochen Rick,et al.  Collaborative games: Lessons learned from board games , 2006 .

[125]  L. Santilli,et al.  Using an Interactive Computer Game to Increase Skill and Self-Efficacy Regarding Safer Sex Negotiation: Field Test Results , 1997, Health education & behavior : the official publication of the Society for Public Health Education.

[126]  Dirk Ifenthaler.  Using an Casual Path Model for the Design and dDevelopment of a Simulation Game for Teacher Education , 2009 .

[127]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[128]  Debbie Denise Reese,et al.  The Moment of Learning: Quantitative Analysis of Exemplar Gameplay Supports CyGaMEs Approach to Embedded Assessment. , 2010 .

[129]  Maja Pivec,et al.  Recursive Loops of Game-Based Learning: a Conceptual model. , 2007 .

[130]  Dirk Ifenthaler,et al.  Practical Solutions for the Diagnosis of Progressing Mental Models , 2008 .

[131]  Maria Klawe,et al.  A classroom study: electronic games engage children as researchers , 1995, CSCL.

[132]  R. Conrad,et al.  Acoustic confusions in immediate memory. , 1964 .

[133]  M. Schermer,et al.  On the argument that enhancement is “cheating” , 2008, Journal of Medical Ethics.

[134]  Gary J. Summers.  Today’s Business Simulation Industry , 2004 .

[135]  Eric Klopfer,et al.  Augmented Learning: Research and Design of Mobile Educational Games , 2008 .

[136]  D. Best,et al.  Is an arcade-style computer game an effective medium for providing drug education to schoolchildren? , 2000, Education and Health.

[137]  Richard J. Murnane,et al.  The New Division of Labor: How Computers Are Creating the Next Job Market , 2004 .

[138]  A. Ali.  Grid Technology , 2002, IEEE Students Conference, ISCON '02. Proceedings..

[139]  Maja Pivec,et al.  Immersed, but How? That Is the Question , 2009 .

[140]  Nicolas Nova.  Awareness Tools : Lessons from Quake-Like , 2001 .

[141]  John B. Willett,et al.  Questions and Answers in the Measurement of Change , 1988 .

[142]  Kathleen A. Hansen,et al.  Disaster at Harperville: The modding of Neverwinter Nights to teach journalism students the strategic steps in information gathering , 2006 .

[143]  Maja Pivec,et al.  Instructional Design: Sex Driven? , 2008 .

[144]  Lawrence G. Walters.  Sex, Lies and Videogames , 2006 .

[145]  Vered Aharonson,et al.  O1-03-02 Computer based cognitive training with mindfit® improved cognitive performances above the effect of classic computer games: Prospective, randomized, double-blind intervention study in the elderly , 2007, Alzheimer's & Dementia.

[146]  Friedrich Masendorf,et al.  Training Learning-Disabled Children's Spatial Ability by Computer Games , 1995 .

[147]  John G. Hedberg,et al.  Methods and technologies for learning , 2006, Br. J. Educ. Technol..

[148]  Dirk Ifenthaler,et al.  Intelligent Model-Based Feedback: Helping Learners to Monitor their Individual Learning Progress , 2012 .

[149]  Maja Pivec,et al.  Game-Based and Innovative Learning Approaches. A Symposium in conjunction with SIG-GLUE, Part 2 , 2006 .

[150]  Roni Linser,et al.  The Magic Circle - Game Design Principles and Online Role-play Simulations , 2008 .

[151]  Ruth Dirx.  Das Buch vom Spiel : das Spiel einst und jetzt , 1981 .

[152]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[153]  Joseph M. Ryan,et al.  The relationship between individual instructional characteristics and the overall assessment of teaching effectiveness across different instructional contexts , 1995 .

[154]  Brent D. Ruben,et al.  Simulations, Games, and Experience-Based Learning: The Quest for a New Paradigm for Teaching and Learning , 1999 .

[155]  J. Gee.  Learning by design: Games as learning machines , 2004 .

[156]  William E. Cashin,et al.  Disciplinary differences in what is taught and in students' perceptions of what they learn and of how they are taught , 1995 .

[157]  C. Bolzonella,et al.  Learning good eating habits playing computer games at school: A 2000 children evaluation , 2000 .

[158]  Punya Mishra,et al.  The Claims of Games: A Comprehensive Review and Directions for Future Research , 2007 .

[159]  D. Kolb.  Experiential Learning: Experience as the Source of Learning and Development , 1983 .

[160]  M. Ashcraft.  Fundamentals of Cognition , 1997 .

[161]  Hitendra K. Pillay,et al.  An Investigation of Cognitive Processes Engaged in by Recreational Computer Game Players , 2002 .

[162]  Maja Pivec,et al.  Misconceptions About Being Digital , 2010 .

[163]  William E. Cashin,et al.  Using global student rating items for summative evaluation. , 1992 .

[164]  Todor Ganchev,et al.  PlayMancer: A European Serious Gaming 3D Environment , 2008, EHST.

[165]  M. Prensky.  Do They Really Think Differently , 2001 .

[166]  J. Holland,et al.  Cognitive/attentional distraction in the control of conditioned nausea in pediatric cancer patients receiving chemotherapy. , 1987, Journal of consulting and clinical psychology.

[167]  S. Gathercole,et al.  Working Memory in the Classroom , 2006 .

[168]  Charlotte Sennersten,et al.  Eye movements in an Action Game Tutorial , 2004 .

[169]  P. Adams.  Teaching and Learning with SimCity 2000 , 1998 .

[170]  Ximena López,et al.  Beyond Nintendo: design and assessment of educational video games for first and second grade students , 2003, Comput. Educ..

[171]  Michael K. Thomas,et al.  Making learning fun: Quest Atlantis, a game without guns , 2005 .

[172]  Jim Bizzocchi,et al.  Game, Motivation, and Effective Learning: An Integrated Model for Educational Game Design , 2005, DiGRA Conference.

[173]  Henry Jenkins,et al.  From Barbie to Mortal Kombat: gender and computer games , 1998 .