Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives

The capabilities and possibilities of emerging game-based learning technologies bring about a new perspective of learning and instruction. This, in turn, necessitates alternative ways to assess the kinds of learning that is taking place in the virtual worlds or informal settings. accordingly, aligning learning and assessment is the core for creating a favorable and effective learning environment. The edited volume will cover the current state of research, methodology, assessment, and technology of game-based learning. There will be contributions from international distinguished researchers which will present innovative work in the areas of educational psychology, educational diagnostics, educational technology, and learning sciences. The edited volume will be divided into four major parts.

[1]  K. Squire,et al.  Replaying history: learning world history through playing civilization iii , 2004 .

[2]  J. Greeno THE SITUATIVITY OF KNOWING, LEARNING, AND RESEARCH , 1998 .

[3]  Diana G. Oblinger Games and Learning. , 2006 .

[4]  Miguel Nussbaum,et al.  Playability in Action Videogames: A Qualitative Design Model , 2002, Hum. Comput. Interact..

[5]  J. Bruner The act of discovery. , 1961 .

[6]  Jonathan Templin,et al.  Diagnostic Measurement: Theory, Methods, and Applications , 2010 .

[7]  Claudia Lampert,et al.  Der gespielte Ernst des Lebens: Bestandsaufnahme und Potenziale von Serious Games (for Health) , 2009 .

[8]  GNaschenweng Dragon Age: Origins , 2010 .

[9]  Clark N Quinn,et al.  Engaging Learning: Designing e-Learning Simulation Games , 2005 .

[10]  川島 隆太 Train your brain : 60 days to a better brain , 2007 .

[11]  Richard E. Ferdig,et al.  Handbook of Research on Effective Electronic Gaming in Education , 2009 .

[12]  Peter B. Henderson,et al.  Inductive reasoning , 2003, SGCS.

[13]  John G. Hedberg Methods and technologies for learning , 2006, Br. J. Educ. Technol..

[14]  Dirk Ifenthaler,et al.  Practical Solutions for the Diagnosis of Progressing Mental Models , 2008 .

[15]  Paulo Martins,et al.  Using Second Life in Programming's Communities of Practice , 2009, CRIWG.

[16]  Arnond Anantachai,et al.  ASSESSING WHAT PLAYERS LEARNED IN SERIOUS GAMES: IN SITU DATA COLLECTION, INFORMATION TRAILS, AND QUANTITATIVE ANALYSIS , 2007 .

[17]  John R. Anderson,et al.  Learning and Memory: An Integrated Approach , 1994 .

[18]  Katie Salen The ecology of games : connecting youth, games, and learning , 2008 .

[19]  Fengfeng Ke,et al.  A Qualitative Meta-Analysis of Computer Games as Learning Tools , 2009 .

[20]  William A. Sands,et al.  Computerized adaptive testing: From inquiry to operation. , 1997 .

[21]  B. Zimmerman,et al.  Motivation and Self-Regulated Learning: Theory, Research, and Applications , 2009 .

[22]  Michael Barnett,et al.  Electromagnetism Supercharged! Learning Physics with Digital Simulation Games , 2004, ICLS.

[23]  Richard Gunstone,et al.  Conceptual Change and Physics Instruction: A Longitudinal Study. , 1990 .

[24]  Jerry Duffy The Role of Virtual Reality Simulation in Full Scale Joint Military Exercises. , 1997 .

[25]  Robert J. Mislevy,et al.  Implications of Evidence‐Centered Design for Educational Testing , 2007 .

[26]  Tracy Fullerton,et al.  Game Design Workshop: Designing, Prototyping, and Playtesting Games , 2004 .

[27]  K. McGilly,et al.  Classroom lessons: Integrating cognitive theory and classroom practice. , 1994 .

[28]  James W Pellegrino,et al.  Technology and Testing , 2009, Science.

[29]  D. Gentner,et al.  The analogical mind : perspectives from cognitive science , 2001 .

[30]  D. Treagust,et al.  A Predict-Observe-Explain Teaching Sequence for Learning about Students' Understanding of Heat and Expansion Liquids. , 1995 .

[31]  P. G. Schrader,et al.  Learning in Technology: Reconceptualizing Immersive Environments. , 2008 .

[32]  Cornelis A.W. Glas,et al.  Statistical Tests of Conditional Independence Between Responses and/or Response Times on Test Items , 2010 .

[33]  Terry E. Duncan,et al.  Psychometric properties of the Intrinsic Motivation Inventory in a competitive sport setting: a confirmatory factor analysis. , 1989, Research quarterly for exercise and sport.

[34]  J. D. Fletcher,et al.  What Research Has to Say about Designing Computer Games for Learning. , 2007 .

[35]  Glenda A. Gunter,et al.  Taking educational games seriously: using the RETAIN model to design endogenous fantasy into standalone educational games , 2008 .

[36]  P. G. Schrader,et al.  The Hidden Literacies of Massively Multiplayer Online Games , 2010 .

[37]  Sarah Corona Berkin Image and Vision , 2001 .

[38]  Sonja Ganguin Computerspiele und lebenslanges Lernen , 2010 .

[39]  Ruth Wylie,et al.  The Self-Explanation Principle in Multimedia Learning , 2014 .

[40]  Alan Amory,et al.  Game object model version II: a theoretical framework for educational game development , 2007 .

[41]  James Paul Gee,et al.  What video games have to teach us about learning and literacy , 2007, CIE.

[42]  Aroutis Foster,et al.  The Process of Learning in a Simulation Strategy Game: Disciplinary Knowledge Construction , 2010 .

[43]  Gautam Biswas,et al.  LEARNING BY TEACHING: A NEW AGENT PARADIGM FOR EDUCATIONAL SOFTWARE , 2005, Appl. Artif. Intell..

[44]  Larry Cuban Oversold and Underused , 2001 .

[45]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[46]  David Walsh,et al.  Video Game Violence and Public Policy , 2007 .

[47]  R. Sawyer The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[48]  Panayiotis Zaphiris,et al.  Linking Pedagogical Theory of Computer Games to Their Usability , 2008 .

[49]  Daniel L. Schwartz,et al.  Interactive Metacognition: Monitoring and Regulating a Teachable Agent , 2009 .

[50]  Preeti Verghese,et al.  Where to look next? Eye movements reduce local uncertainty. , 2007, Journal of vision.

[51]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[52]  Elizabeth F. Churchill,et al.  Collaborative virtual environments: An introductory review of issues and systems , 1998, Virtual Reality.

[53]  David Williamson Shaffer,et al.  Studio Mathematics: The Epistemology and Practice of Design Pedagogy as a Model for Mathematics Learning. WCER Working Paper No. 2005-3. , 2005 .

[54]  David Palmer,et al.  The POE in the primary school: An evaluation , 1995 .

[55]  Christopher Alexander,et al.  The Timeless Way of Building , 1979 .

[56]  Elena Silva Measuring Skills for 21st-Century Learning , 2009 .

[57]  Richard Van Eck,et al.  Gaming and Cognition: Theories and Practice from the Learning Sciences , 2010 .

[58]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[59]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[60]  Michael K. Thomas,et al.  Making learning fun: Quest Atlantis, a game without guns , 2005 .

[61]  Dave Morris,et al.  Game architecture and design , 1999 .

[62]  Daniel O. Segall,et al.  Multidimensional adaptive testing , 1996 .

[63]  Takahiro Ishikawa,et al.  Passive driver gaze tracking with active appearance models , 2004 .

[64]  John V. Dempsey Instructional Gaming: Implications for Instructional Technology. , 1994 .

[65]  C. Dwyer,et al.  The Future of Assessment : Shaping Teaching and Learning , 2008 .

[66]  Ryan Shaun Joazeiro de Baker,et al.  Developing a generalizable detector of when students game the system , 2008, User Modeling and User-Adapted Interaction.

[67]  Bryan G. Behrenshausen,et al.  Serious Games for Transformative Learning : A Communication Perspective on the Radical Binarisation of Everyday Life , 2010 .

[68]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[69]  Constantine Caramanis,et al.  Robust Matrix Completion and Corrupted Columns , 2011, ICML.

[70]  R. Caillois,et al.  Man, Play and Games , 1958 .

[71]  Kurt Squire,et al.  Augmented Reality Simulations on Handheld Computers , 2007 .

[72]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[73]  M. Gick Problem-solving strategies , 1986 .

[74]  Frederik Cornillie,et al.  ReCALL special issue: Digital games for language learning: challenges and opportunities , 2012, ReCALL.

[75]  Jeffrey Mervis,et al.  Adding a T to the Three R's , 2009, Science.

[76]  Robert L. Goldstone,et al.  Transformational Play as a Curricular Scaffold: Using Videogames to Support Science Education , 2009 .

[77]  P H Harasym,et al.  Diagnostic reasoning strategies and diagnostic success , 2003, Medical education.

[78]  Rik Warren,et al.  Using a Computer Game for Research on Culture and Team Adaptability: Lessons Learned from A NATO Experiment , 2008 .

[79]  Xun Ge,et al.  Fostering 21st Century Skill Development by Engaging Students in Authentic Game Design Projects in a High School Computer Programming Class , 2011 .

[80]  Dirk Ifenthaler Using an Casual Path Model for the Design and dDevelopment of a Simulation Game for Teacher Education , 2009 .

[81]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[82]  Richard N. Van Eck Six Ideas in Search of a Discipline , 2007 .

[83]  S. Embretson Test design : developments in psychology and psychometrics , 1985 .

[84]  Katerina Zourou,et al.  Social networked game dynamics in web 2.0 language learning communities , 2013 .

[85]  J. Piaget,et al.  The Psychology of the Child , 1969 .

[86]  Mark Peterson Computer Games and Language Learning , 2013 .

[87]  Kimberly A. Lawless,et al.  Understanding Hypertext Navigation through Cluster Analysis , 1996 .

[88]  Valerie J. Shute,et al.  Games, Learning, and Assessment , 2012 .

[89]  Desirée Joosten-ten Brinke,et al.  Integrating Assessment into E-learning Courses , 2005 .

[90]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[91]  Dirk Ifenthaler,et al.  Automated Knowledge Visualization and Assessment , 2010 .

[92]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[93]  J. Hattie,et al.  The Power of Feedback , 2007 .

[94]  J. Sykes,et al.  Conceptualizing Digital Game-Mediated L2 Learning and Pedagogy: Game-Enhanced and Game-Based Research and Practice , 2012 .

[95]  David H. Jonassen,et al.  Learningwith media: Restructuring the debate , 1994 .

[96]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[97]  Daniel Wendel,et al.  The Simulation Cycle: Combining Games, Simulations, Engineering and Science Using StarLogo TNG , 2009 .

[98]  R. Almond,et al.  A BRIEF INTRODUCTION TO EVIDENCE-CENTERED DESIGN , 2003 .

[99]  P. Ekman Darwin, Deception, and Facial Expression , 2003, Annals of the New York Academy of Sciences.

[100]  Audrey B. Champagne,et al.  The National Science Education Standards. , 2000 .

[101]  Shree Durga,et al.  Productive Gaming and the Case for Historiographic Game-Play , 2009 .

[102]  A. Anastasi Evolving Concepts of Test Validation , 1986 .

[103]  Chris Dede,et al.  Making Learning Meaningful: An explatory study of using multi-user environments (MUVEs) in middle school science. , 2005 .

[104]  Joseph Wolfe,et al.  The Effectiveness of Business Games in Strategic Management Course Work , 1997 .

[105]  S. Barab,et al.  Eat Your Vegetables and Do Your Homework: A Design­ Based Investigation of Enjoyment and Meaning in Learning , 2005 .

[106]  M. Chi,et al.  The Nature of Expertise , 1988 .

[107]  Ellen J. Langer,et al.  A Mindful Education , 1993 .

[108]  A. Bandura Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[109]  Valerie J. Shute,et al.  TENSIONS, TRENDS, TOOLS, AND TECHNOLOGIES: TIME FOR AN EDUCATIONAL SEA CHANGE , 2006 .

[110]  Ann L. Brown,et al.  Training in Self-Explanation and Self-Regulation Strategies: Investigating the Effects of Knowledge Acquisition Activities on Problem Solving , 1995 .

[111]  Jonas Löwgren,et al.  Thoughtful Interaction Design: A Design Perspective on Information Technology , 2004 .

[112]  Ricardo A Tejeiro Salguero,et al.  Measuring problem video game playing in adolescents. , 2002, Addiction.

[113]  Frank Dignum Agents for games and simulations , 2011, Autonomous Agents and Multi-Agent Systems.

[114]  Robert J. Mills,et al.  Using a Computer-Tracking System as an Unobtrusive Software Data Collection Technique. , 2004 .

[115]  David H. Jonassen,et al.  Case-based reasoning and instructional design: Using stories to support problem solving , 2002 .

[116]  Elizabeth Bagley,et al.  When People Get in the Way: Promoting Civic Thinking Through Epistemic Gameplay , 2009, Int. J. Gaming Comput. Mediat. Simulations.

[117]  Y. Kafai,et al.  Children’s Participation in a Virtual Epidemic in the Science Classroom: Making Connections to Natural Infectious Diseases , 2006, Journal of science education and technology.

[118]  V. Shute Focus on Formative Feedback , 2008 .

[119]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[120]  Samuel Greiff,et al.  Measuring complex problem solving: the MicroDYN approach , 2009 .

[121]  J. Gee,et al.  How Computer Games Help Children Learn , 2006 .

[122]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[123]  R. Azevedo Theoretical, conceptual, methodological, and instructional issues in research on metacognition and self-regulated learning: A discussion , 2009 .

[124]  D. Bub,et al.  Video‐game training and naïve reasoning about object motion , 2009 .

[125]  James Paul Gee,et al.  Deep Learning Properties of Good Digital Games: How Far Can They Go? , 2009 .

[126]  Jody Clarke,et al.  Design for Scalability: A Case Study of the River City Curriculum , 2009 .

[127]  M. David Merrill,et al.  First principles of instruction , 2012 .

[128]  Russell G. Almond,et al.  Graphical Models and Computerized Adaptive Testing , 1999 .

[129]  Robert J. Mislevy,et al.  Variations in adaptive testing and their online leverage points , 2005 .

[130]  Jean-Claude Falmagne,et al.  The Assessment of Knowledge, in Theory and in Practice , 2006, ICFCA.

[131]  Scott N. Wilson,et al.  Serious Games for the Classroom : A Case Study of Designing and Developing a Massive Multiplayer Online Game , 2010 .

[132]  Steven M. Downing,et al.  Handbook of test development , 2006 .

[133]  Yasmin B. Kafai,et al.  Beyond Barbie and Mortal Kombat: New Perspectives on Gender and Gaming , 2008 .

[134]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[135]  S. Urbina,et al.  Psychological testing, 7th ed. , 1997 .

[136]  Chris Crawford Interactivity, Process, and Algorithm , 2010 .

[137]  M. Kane Current Concerns in Validity Theory , 2001 .

[138]  P. Schrader,et al.  The acquisition of skill and expertise in massively multiplayer online games , 2008 .

[139]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[140]  B. Hommel,et al.  The (b)link between creativity and dopamine: Spontaneous eye blink rates predict and dissociate divergent and convergent thinking , 2010, Cognition.

[141]  S. Herring,et al.  Situationally embodied curriculum: Relating formalisms and contexts , 2007 .

[142]  J. Wertsch Mind as action , 1998 .

[143]  Sara de Freitas,et al.  Using games and simulations for supporting learning , 2006 .

[144]  Luis de Marcos,et al.  Gamifying learning experiences: Practical implications and outcomes , 2013, Comput. Educ..

[145]  Lorrie A. Shepard,et al.  Commentary: Evaluating the Validity of Formative and Interim Assessment , 2009 .

[146]  Francis R. Bach,et al.  Structured Sparse Principal Component Analysis , 2009, AISTATS.

[147]  Chen-Lin C. Kulik,et al.  Effectiveness of computer-based instruction: An updated analysis. , 1991 .

[148]  S. Ghoshal,et al.  Social Capital, Intellectual Capital, and the Organizational Advantage , 1998 .

[149]  John V. Dempsey,et al.  Forty Simple Computer Games and What They Could Mean to Educators , 2002 .

[150]  Emmanuel J. Candès,et al.  The Power of Convex Relaxation: Near-Optimal Matrix Completion , 2009, IEEE Transactions on Information Theory.

[151]  R. Almond,et al.  Making Sense of Data From Complex Assessments , 2002 .

[152]  A. Krapp Interest, motivation and learning: An educational-psychological perspective , 1999 .

[153]  Michele D. Dickey Game design and learning: a conjectural analysis of how massively multiple online role-playing games (MMORPGs) foster intrinsic motivation , 2007 .

[154]  Kurt Squire,et al.  Video games in education , 2003, Int. J. Intell. Games Simul..

[155]  Richard Mayer,et al.  Multimedia Learning , 2001, Visible Learning Guide to Student Achievement.

[156]  Robert L. Linn,et al.  Comments on Atkinson and Geiser: Considerations for College Admissions Testing , 2009 .

[157]  Erin E. Barton,et al.  Providing Optimal Opportunities , 2009 .

[158]  Judith Good,et al.  Story creation in virtual game worlds , 2005, CACM.

[159]  Janet L. Kolodner,et al.  Case-Based Reasoning , 1989, IJCAI 1989.

[160]  J. Matias,et al.  Review on psychophysiological methods in game research , 2010 .

[161]  Bernard R. Gifford,et al.  Computer-Based Assessment in E-Learning: A Framework for Constructing "Intermediate Constraint" Questions and Tasks for Technology Platforms , 2006 .

[162]  Asha Iyer,et al.  Components of bottom-up gaze allocation in natural images , 2005, Vision Research.

[163]  D. Gentner Structure‐Mapping: A Theoretical Framework for Analogy* , 1983 .

[164]  Dirk Ifenthaler,et al.  Bridging the Gap between Expert-Novice Differences , 2010 .

[165]  K. Popper,et al.  Logik der Forschung , 1935 .

[166]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[167]  John S. Kinnebrew,et al.  A Contextualized, Differential Sequence Mining Method to Derive Students' Learning Behavior Patterns , 2013, EDM 2013.

[168]  M. Csíkszentmihályi Beyond boredom and anxiety , 1975 .

[169]  E. Mory Feedback research revisited. , 2004 .

[170]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[171]  Sasha A. Barab,et al.  A co-evolutionary model for supporting the emergence of authenticity , 2000 .

[172]  Marcus Childress,et al.  Using Massively Multiplayer Online Role‐Playing Games for Online Learning , 2006 .

[173]  Yoon Jeon Kim,et al.  Formative and Stealth Assessment , 2014 .

[174]  Diana G. Oblinger Simulations, Games, and Learning , 2006 .

[175]  Brian C. Nelson,et al.  Global channels of evidence for learning and assessment in complex game environments , 2011, Br. J. Educ. Technol..

[176]  P. Black,et al.  Developing the theory of formative assessment , 2009 .

[177]  K. Holyoak,et al.  Pragmatics in Analogical Mapping , 1996, Cognitive Psychology.

[178]  Hitendra K. Pillay,et al.  An Investigation of Cognitive Processes Engaged in by Recreational Computer Game Players , 2002 .

[179]  Dirk Ifenthaler,et al.  Relational, structural, and semantic analysis of graphical representations and concept maps , 2010 .

[180]  Daniel L. Schwartz,et al.  A time for telling , 1998 .

[181]  Dennis C. Frezzo,et al.  Using activity theory to understand the role of a simulation-based interactive learning environment in a computer networking course , 2009 .

[182]  D. Borsboom Educational Measurement (4th ed.) , 2009 .

[183]  Patricia M. Greenfield,et al.  Effect of video game practice on spatial skills in girls and boys , 1994 .

[184]  K. Squire Changing the Game: What Happens When Video Games Enter the Classroom? , 2005 .

[185]  Brett E. Shelton,et al.  Aligning game activity with educational goals: following a constrained design approach to instructional computer games , 2011 .

[186]  Aroutis Foster,et al.  Games, Claims, Genres, and Learning , 2009 .

[187]  Andrea Gregg,et al.  Learning From Doing: Lessons Learned From Designing and Developing an Educational Software Within a Heterogeneous Group , 2021, Int. J. Web Based Learn. Teach. Technol..

[188]  Robert J. Moore,et al.  The social side of gaming: a study of interaction patterns in a massively multiplayer online game , 2004, CSCW.

[189]  Patrick Griffin,et al.  Assessment and Teaching of 21st Century Skills , 2011 .

[190]  Marcia C. Linn,et al.  Internet Environments for Science Education , 2004 .

[191]  András Lörincz,et al.  Assisting Robotic Personal Agent and Cooperating Alternative Input Devices for Severely Disabled Children , 2005, CEEMAS.

[192]  Bernard Suits,et al.  The Grasshopper: Games, Life and Utopia , 1978 .

[193]  Gautam Biswas,et al.  Modeling and Measuring Self-Regulated Learning in Teachable Agent Environments , 2010, AAAI Fall Symposium: Cognitive and Metacognitive Educational Systems.

[194]  Robert J. Mislevy,et al.  Evidence-Centered Design of Epistemic Games: Measurement Principles for Complex Learning Environments. , 2010 .

[195]  Norbert M. Seel,et al.  Essentials of Computer-Based Diagnostics of Learning and Cognition , 2010 .

[196]  S. Messick The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[197]  C. Douglas Wetzel,et al.  The Effectiveness of Games for Educational Purposes: A Review of Recent Research , 1992 .

[198]  Valerie J. Shute,et al.  Modeling, Assessing, and Supporting Key Competencies Within Game Environments , 2010 .

[199]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[200]  Robert M. Capraro,et al.  Reporting Practices in Quantitative Teacher Education Research: One Look at the Evidence Cited in the AERA Panel Report , 2008 .

[201]  B. Skinner The phylogeny and ontogeny of behavior , 1966, Behavioral and Brain Sciences.

[202]  M. Lepper,et al.  Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. , 1996 .

[203]  Nick Yee,et al.  The Demographics, Motivations, and Derived Experiences of Users of Massively Multi-User Online Graphical Environments , 2006, PRESENCE: Teleoperators and Virtual Environments.

[204]  Douglas J. Navarick,et al.  Self-control and choice in humans: Effects of video game playing as a positive reinforcer , 1984 .

[205]  Douglas Thomas,et al.  The Play of Imagination , 2007, Games Cult..

[206]  Luis C. Moll Vygotsky and Education: Instructional Implications and Applications of Sociohistorical Psychology , 1991 .

[207]  H. Mandl,et al.  The effects of cooperative learning and feedback on e-learning in statistics , 2009 .

[208]  Christian Sebastian Loh Designing Online Games Assessment as : Information Trails , 2007 .

[209]  E. Loftus,et al.  Mind at Play; The Psychology of Video Games , 1983 .

[210]  Timothy Koschmann,et al.  Cscl : Theory and Practice of An Emerging Paradigm , 1996 .

[211]  Elizabeth Bagley,et al.  Epistemic network analysis : a Prototype for 21 st Century assessment of Learning , 2009 .

[212]  Staffan Björk,et al.  Patterns In Game Design , 2004 .

[213]  R. Linn Educational measurement, 3rd ed. , 1989 .

[214]  Pablo Moreno-Ger,et al.  Digital Games in eLearning Environments , 2009 .

[215]  R. Mayer,et al.  Personalized messages that promote science learning in virtual environments , 2004 .

[216]  Dirk Ifenthaler Model-based feedback for improving expertise and expert performance , 2009 .

[217]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[218]  R. Sawyer Introduction: the new science of learning , 2014 .

[219]  Daniel T. Hickey,et al.  Designing Assessments and Assessing Designs in Virtual Educational Environments , 2009 .

[220]  Mark S. Granovetter Economic Action and Social Structure: The Problem of Embeddedness , 1985, American Journal of Sociology.

[221]  Gautam Biswas,et al.  Measuring Self-Regulated Learning Skills through Social Interactions in a teachable Agent Environment , 2010, Res. Pract. Technol. Enhanc. Learn..

[222]  Dirk Ifenthaler,et al.  Alternative Assessment Strategies for Complex Problem Solving in Game-Based Learning Environments , 2011 .

[223]  Peggy A. Ertmer,et al.  Validity and Problem-Based Learning Research: A Review of Instruments Used to Assess Intended Learning Outcomes , 2016 .

[224]  Beryl Hesketh,et al.  Dilemmas in training for transfer and retention , 1997 .

[225]  Christopher G. Lasater,et al.  Design Patterns , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[226]  Joel E. Foreman Game-Based Learning: How to Delight and Instruct in The 21st Century. , 2004 .

[227]  T. Salthouse Expertise as the circumvention of human processing limitations. , 1991 .

[228]  C. Kennedy,et al.  Functional analysis and treatment of eye poking. , 1995, Journal of applied behavior analysis.

[229]  Dona M. Kagan,et al.  Teaching as Clinical Problem Solving: A Critical Examination of the Analogy and Its Implications , 1988 .

[230]  James Jaccard,et al.  Arbitrary metrics in psychology. , 2006, The American psychologist.

[231]  Michael Barnett,et al.  Using Video Games to Support Pre-Service Elementary Teachers Learning of Basic Physics Principles , 2011 .

[232]  Lloyd P. Rieber,et al.  Seriously considering play: Designing interactive learning environments based on the blending of microworlds, simulations, and games , 1996 .

[233]  Brian C. Nelson,et al.  A multi-user virtual environment for building and assessing higher order inquiry skills in science , 2010, Br. J. Educ. Technol..

[234]  Gregory K. W. K. Chung,et al.  Issues in the Computer-based Assessment of Collaborative Problem Solving , 2003 .

[235]  Anthony D. Pellegrini,et al.  Learning Through Play , 2008 .

[236]  Dirk Ifenthaler,et al.  Understanding models for learning and instruction , 2008 .

[237]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[238]  Banesh Hoffmann Multiple-choice tests , 1967 .

[239]  Robert J. Mislevy,et al.  An evidence centered design for learning and assessment in the digital world , 2010 .

[240]  Baltasar Fernández-Manjón,et al.  Instructor-Oriented Authoring Tools for Educational Videogames , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[241]  James W. Pellegrino,et al.  Knowing What Students Know. , 2003 .

[242]  Kara L. Orvis,et al.  Relationships Between Game Attributes and Learning Outcomes , 2009 .

[243]  Deb Roy,et al.  Speaking with your Sidekick: Understanding Situated Speech in Computer Role Playing Games , 2005, AIIDE.

[244]  Philip H. Winne,et al.  The weave of motivation and self-regulated learning. , 2008 .

[245]  Brian C. Nelson,et al.  A Multi-user virtual environment for building higher order inquiry skills in science , 2006 .

[246]  Cristina Conati,et al.  Probabilistic assessment of user's emotions in educational games , 2002, Appl. Artif. Intell..

[247]  Daniel L. Schwartz,et al.  Rethinking transfer: A simple proposal with multiple implica-tions , 1999 .

[248]  S. Messick Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[249]  Steven Andrew Culpepper,et al.  Assessing differential prediction of college grades by race/ethnicity with a multilevel model , 2009 .

[250]  M. Chi,et al.  The Content of Physics Self-Explanations , 1991 .

[251]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[252]  Robert J. Moore,et al.  Building an MMO With Mass Appeal , 2006 .

[253]  N. Webb,et al.  Productive Helping in Cooperative Groups , 2002 .

[254]  Randy F. Pausch,et al.  What HCI designers can learn from video game designers , 1994, CHI Conference Companion.

[255]  Russell G. Almond,et al.  Enhancing the Design and Delivery of Assessment Systems: A Four-Process Architecture , 2002 .

[256]  G. Lakoff,et al.  Philosophy in the flesh : the embodied mind and its challenge to Western thought , 1999 .

[257]  L. Vygotsky Mind in Society: The Development of Higher Psychological Processes: Harvard University Press , 1978 .

[258]  Christian Sebastian Loh,et al.  Researching and Developing Serious Games as Interactive Learning Instructions , 2009, Int. J. Gaming Comput. Mediat. Simulations.

[259]  J. Gee Video Games and Embodiment , 2008, Games Cult..

[260]  J. Minstrell Explaining the ’’at rest’’ condition of an object , 1982 .

[261]  John E. Hummel,et al.  Distributed representations of structure: A theory of analogical access and mapping. , 1997 .

[262]  Tim Stowell,et al.  A Frankenstein Approach to Open Source: The Construction of a 3D Game Engine as Meaningful Educational Process , 2010, IEEE Transactions on Learning Technologies.

[263]  Cheryl I. Johnson,et al.  Adding Instructional Features That Promote Learning in a Game-Like Environment , 2010 .

[264]  Fotis Liarokapis,et al.  An exploration from virtual to augmented reality gaming , 2006 .

[265]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[266]  Robert J. Torres Using Gamestar Mechanic Within a Nodal Learning Ecology to Learn Systems Thinking: A Worked Example , 2009 .

[267]  D. Perkins,et al.  Partners in Cognition: Extending Human Intelligence with Intelligent Technologies , 1991 .

[268]  Brett E. Shelton Designing instructional games for activity-goal alignment , 2007 .

[269]  Brian C. Nelson,et al.  Presence and Middle School Students' Participation in a Virtual Game Environment to Assess Science Inquiry , 2012, J. Educ. Technol. Soc..

[270]  Marcia C. Linn,et al.  Scaffolding knowledge integration through curricular depth , 2000 .

[271]  Klaus P. Jantke Patterns in digital game playing experience revisited : Beiträge zum tieferen Verständnis des Begriffs Pattern , 2008 .

[272]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[273]  J. Lave Cognition in practice , 1988 .

[274]  James Minogue,et al.  Investigating the impact of video games on high school students' engagement and learning about genetics , 2009, Comput. Educ..

[275]  Lars Konzack,et al.  Computer Game Criticism: A Method for Computer Game Analysis , 2002, CGDC Conf..

[276]  M. Peters,et al.  Transforming American Education: Learning Powered by Technology , 2011 .

[277]  Chris Dede,et al.  Assessment, Technology, and Change , 2010 .

[278]  Punya Mishra,et al.  The Claims of Games: A Comprehensive Review and Directions for Future Research , 2007 .

[279]  Dylan Wiliam,et al.  Standardized Testing and School Accountability , 2010 .

[280]  Robert A. Reiser,et al.  Trends and issues in instructional design and technology , 2002 .

[281]  Jeffrey Chin,et al.  Assessment in Simulation and Gaming , 2009 .

[282]  Kent J. Crippen,et al.  Promoting Self-Regulation in Science Education: Metacognition as Part of a Broader Perspective on Learning , 2006 .

[283]  John L. Sherry The effects of violent video games on aggression a meta-analysis , 2001 .

[284]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[285]  Gautam Biswas,et al.  Mining Student Behavior Models in Learning-by-Teaching Environments , 2008, EDM.

[286]  M. Csíkszentmihályi Flow: The Psychology of Optimal Experience , 1990 .

[287]  J. Bohannon Flunking Spore , 2008, Science.

[288]  Burr Settles,et al.  Active Learning , 2012, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[289]  Mark J. Gierl,et al.  Cognitive diagnostic assessment for education: Theory and applications. , 2007 .

[290]  David H. Jonassen,et al.  Modeling with Technology: Mindtools for Conceptual Change , 2005 .

[291]  Christian Sebastian Loh,et al.  Modding Neverwinter Nights Into Serious Games , 2009 .

[292]  Dedre Gentner,et al.  Learning by Analogical Bootstrapping , 2001 .

[293]  Gautam Biswas,et al.  Designing Learning by Teaching Agents: The Betty's Brain System , 2008, Int. J. Artif. Intell. Educ..

[294]  Friedrich L. Bauer,et al.  Formal Program Construction by Transformations-Computer-Aided, Intuition-Guided Programming , 1989, IEEE Trans. Software Eng..

[295]  Sasha A. Barab,et al.  Why educators should care about: Games , 2009 .

[296]  John C. Nesbit,et al.  Sequential Pattern Analysis of Learning Logs: Methodology and Applications , 2010 .

[297]  Caroline Pelletier Gaming in Context: How Young People Construct Their Gendered Identities in Playing and Making Games , 2008 .

[298]  Anna Strasser,et al.  A Functional View Toward Mental Representations , 2010 .

[299]  David H. Jonassen,et al.  Toward a design theory of problem solving , 2000 .

[300]  Sherry Turkle,et al.  Simulation and Its Discontents , 2009 .

[301]  Jesús García Laborda,et al.  Digital Games in Language Learning and Teaching , 2013 .

[302]  Begoña Gros,et al.  The impact of digital games in education , 2003, First Monday.

[303]  Valerie J. Shute,et al.  Where streams converge: Using evidence-centered design to assess quest to learn. , 2012 .

[304]  M. Honey,et al.  Learning Science through Computer Games and Simulations. , 2011 .

[305]  R. Mislevy Evidence and inference in educational assessment , 1994 .

[306]  Tony M. O'Driscoll,et al.  Learning in 3D: Adding a New Dimension to Enterprise Learning and Collaboration , 2010 .

[307]  Sally Brown,et al.  Assessment for Learning , 2005 .

[308]  J. Huizinga Homo Ludens: A Study of the Play-Element in Culture , 1938 .

[309]  D. Olson,et al.  The Handbook of education and human development : new models of learning, teaching, and schooling , 1996 .

[310]  J. Frederiksen,et al.  Inquiry, Modeling, and Metacognition: Making Science Accessible to All Students , 1998 .

[311]  P. Johnson-Laird Mental models , 1989 .

[312]  J. Novak,et al.  Educational Psychology: A Cognitive View , 1969 .

[313]  C. Reynolds,et al.  Measurement and assessment: an editorial view. , 2010, Psychological assessment.

[314]  J. Woodward Computers As Mindtools For Schools: Engaging Critical Thinking, 2nd Edition , 2000 .

[315]  A. diSessa Toward an Epistemology of Physics , 1993 .

[316]  Espen Aarseth Investigació sobre jocs: aproximacions metodològiques a l'anàlisi de jocs , 2007 .

[317]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[318]  Lennart E. Nacke,et al.  More than a feeling: Measurement of sonic user experience and psychophysiology in a first-person shooter game , 2010, Interact. Comput..

[319]  David Cristinacce,et al.  Automatic feature localisation with constrained local models , 2008, Pattern Recognit..

[320]  Kurt Squire,et al.  Mad City Mystery: Developing Scientific Argumentation Skills with a Place-based Augmented Reality Game on Handheld Computers , 2007 .

[321]  John B. Willett,et al.  Questions and Answers in the Measurement of Change , 1988 .

[322]  J. McGonigal Reality Is Broken: Why Games Make Us Better and How They Can Change the World , 2011 .

[323]  Lennart E. Nacke,et al.  Log Who's Playing: Psychophysiological Game Analysis Made Easy through Event Logging , 2008, Fun and Games.

[324]  H. Wass,et al.  A Developmental Perspective , 1985 .

[325]  Daniel L. Schwartz,et al.  Inventing to Prepare for Future Learning: The Hidden Efficiency of Encouraging Original Student Production in Statistics Instruction , 2004 .

[326]  D. Jonassen,et al.  Modeling for Meaningful Learning , 2006 .

[327]  Liz Ward,et al.  Putting it into practice. , 2009, Nursing times.

[328]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[329]  Guy Claxton Education for the Learning Age: A Sociocultural Approach to Learning to Learn , 2008 .

[330]  J. Shao,et al.  The jackknife and bootstrap , 1996 .

[331]  Kurt Squire,et al.  Design Principles of Next-Generation Digital Gaming for Education. , 2003 .

[332]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[333]  Walter Wager,et al.  Presenting questions, processing responses, and providing feedback in CAI , 1985 .

[334]  Gregory K. W. K. Chung,et al.  An Exploratory Study to Examine the Feasibility of Measuring Problem-Solving Processes Using a Click-Through Interface , 2003 .

[335]  Iván Martínez-Ortiz,et al.  Educational game design for online education , 2008, Comput. Hum. Behav..

[336]  K. VanLehn,et al.  Cognitive skill acquisition. , 1996, Annual review of psychology.

[337]  Yasmin B. Kafai,et al.  Investigating the ‘‘Why’’ in Whypox , 2009, Games Cult..

[338]  Haekyung Lee Students' perceptions of peer and self assessment in a higher education online collaborative learning environment , 2008 .

[339]  D. Gentile,et al.  The effects of violent video game habits on adolescent hostility, aggressive behaviors, and school performance. , 2004, Journal of adolescence.

[340]  M. Posner Foundations of cognitive science , 1989 .

[341]  Robert T Hays,et al.  The Effectiveness of Instructional Games: A Literature Review and Discussion , 2005 .

[342]  Tim Stowell,et al.  Utilizing Readily Available and Open Source Libraries to Create a 3D Game Engine , 2009, Int. J. Gaming Comput. Mediat. Simulations.

[343]  Clark C. Abt,et al.  Serious games , 2016, Springer International Publishing.

[344]  Cen Li,et al.  Applying the Hidden Markov Model Methodology for Unsupervised Learning of Temporal Data , 2002 .

[345]  Joost Raessens,et al.  Handbook of Computer Game Studies , 2005 .

[346]  J. Biggs,et al.  Teaching For Quality Learning At University , 1999 .

[347]  Robert J. Mislevy,et al.  Design Rationale for a Complex Performance Assessment , 2004 .

[348]  J. Michael Spector Mental Representations and Their Analysis: An Epistemological Perspective , 2010 .

[349]  Brett E. Shelton,et al.  The Design and Use of Simulation Computer Games in Education , 2007 .

[350]  Pratim Sengupta,et al.  Lowering the Learning Threshold: Multi-Agent-Based Models and Learning Electricity: Cognitive Tool for Scientific Inquiry , 2011 .

[351]  Patricia M. Greenfield,et al.  Two-dimensional representation of movement through three- dimensional space: The role of video game expertise☆ , 1994 .

[352]  Andrea A. diSessa,et al.  Relations between Types of Reasoning and Computational Representations , 2004, Int. J. Comput. Math. Learn..

[353]  David Gibson,et al.  Games And Simulations in Online Learning: Research and Development Frameworks , 2006 .

[354]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[355]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[356]  John K. Gilbert,et al.  Models of magnetism , 1998 .

[357]  Chris Crawford,et al.  The Art of Computer Game Design , 1984 .

[358]  L. E. Klopfer,et al.  Cognitive research and the design of science instruction , 1982 .

[359]  Fran C. Blumberg,et al.  Impasse-driven learning in the context of video games , 2008, Comput. Hum. Behav..

[360]  Dylan Wiliam,et al.  What Counts as Evidence of Educational Achievement? The Role of Constructs in the Pursuit of Equity in Assessment , 2010 .

[361]  Jody Clarke‐Midura,et al.  Technology Based Assessment for 21st Century Skills: Theoretical and Practical Implications from Modern Research , 2012 .

[362]  N. Webb Peer interaction and learning in small groups , 1989 .

[363]  K. Squire From Content to Context: Videogames as Designed Experience , 2006 .

[364]  Gyöngyvér Molnár,et al.  Playful fostering of 6- to 8-year-old students’ inductive reasoning , 2011 .

[365]  Jamie Kirkley,et al.  Creating next generation blended learning environments using mixed reality, Video Games and Simulations , 2005 .

[366]  Melanie Zibit,et al.  Online Games for 21st Century Skills , 2007 .

[367]  Dirk Ifenthaler,et al.  Computer-Based Diagnostics and Systematic Analysis of Knowledge , 2010 .

[368]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[369]  Dana Angluin,et al.  Finding Patterns Common to a Set of Strings , 1980, J. Comput. Syst. Sci..

[370]  B. Fraser Identifying the Salient Facets of a Model of Student Learning: A Synthesis of Meta Analyses. , 1987 .

[371]  Brian C. Nelson,et al.  Exploring Newtonian mechanics in a conceptually-integrated digital game: Comparison of learning and affective outcomes for students in Taiwan and the United States , 2011, Comput. Educ..

[372]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[373]  S. Embretson A cognitive design system approach to generating valid tests : Application to abstract reasoning , 1998 .

[374]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[375]  Michelle F. Wright,et al.  Computer Gaming and Interactive Simulations for Learning: A Meta-Analysis , 2006 .

[376]  B. Zimmerman,et al.  Self-regulated learning and academic achievement : theoretical perspectives , 2001 .

[377]  D. Norman,et al.  New technology and human error , 1989 .

[378]  Constance Steinkuehler,et al.  Learning in Massively Multiplayer Online Games , 2004, ICLS.

[379]  Jere Brophy,et al.  Connecting With the Big Picture , 2009 .

[380]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[381]  Jk Raine,et al.  Motivation by Design , 1988 .

[382]  Girlie Delacruz Games as Formative Assessment Environments: Examining the Impact of Explanations of Scoring and Incentives on Math Learning, Game Performance, and Help Seeking. CRESST Report 796. , 2011 .

[383]  Gautam Biswas,et al.  Technology support for complex problem solving: from SAD environments to AI , 2001 .

[384]  Valerie J. Shute,et al.  A Comparison of Learning Environments: All That Glitters , 1992 .

[385]  John Kirriemuir,et al.  Literature Review in Games and Learning , 2004 .

[386]  D. Gentner,et al.  Structure mapping in analogy and similarity. , 1997 .

[387]  P. Pintrich The role of goal orientation in self-regulated learning. , 2000 .

[388]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[389]  P. Vorderer,et al.  Serious games : mechanisms and effects , 2009 .

[390]  G. Kirkpatrick Between Art and Gameness: Critical Theory and Computer Game Aesthetics , 2007 .

[391]  Constance Steinkuehler Massively Multiplayer Online Video Gaming as Participation in a Discourse , 2006 .

[392]  Lars Schmidt-Thieme,et al.  Matrix and Tensor Factorization for Predicting Student Performance , 2011, CSEDU.

[393]  Jean Fisher,et al.  Dream Machines , 2000 .

[394]  B. D. Coller,et al.  Effectiveness of using a video game to teach a course in mechanical engineering , 2009, Comput. Educ..

[395]  Alan Levine,et al.  The 2009 Horizon Report , 2009 .

[396]  Maree Gosper,et al.  Technologies to transform assessment: a study of learning outcomes, assessment and technology use in an Australian university , 2010 .

[397]  Swen E. Gaudl,et al.  Taxonomic contributions to digital games science , 2010, 2010 2nd International IEEE Consumer Electronics Society's Games Innovations Conference.

[398]  M. Strauss,et al.  Construct validity: advances in theory and methodology. , 2009, Annual review of clinical psychology.

[399]  Stefan Sommer,et al.  Layered Design in an Instructional Simulation , 2007 .

[400]  Hitendra K. Pillay,et al.  Cognition and Recreational Computer Games: Implications for Educational Technology , 1999 .

[401]  Douglas J. Hacker,et al.  Handbook of Metacognition in Education , 2009 .