Learning from Social Collaboration: A Paradigm Shift in Evaluating Game-Based Learning

This chapter focuses on the challenge of evaluating game-based learning. It argues that linking gamebased learning with the characteristics of a specific game or game-produced engagement is challenging. It further proposes a framework in which the game-based learning process is approached by considering (business) simulation games as Computer-Supported Collaborative Learning (CSCL) environments and presents an approach on how learning can be approached and evaluated from this perspective. In addition, it highlights how simulation game mechanics appears to be a potential way to promote learners’ socio-emotional processes and give rise to social interaction and to structure collaboration among the learners in the game context. The proposed framework of this chapter takes into account both cognitive and socio-emotional perspectives of learning. The results of the chapter will present a contemporary view on the roles of sociability, collaboration and engagement in game-based learning.

[1]  Daniela Caballero,et al.  Collaboration within large groups in the classroom , 2011, Int. J. Comput. Support. Collab. Learn..

[2]  Pierre Tchounikine,et al.  Flexibility in macro-scripts for computer-supported collaborative learning , 2007, J. Comput. Assist. Learn..

[3]  Timo Lainema Redesigning the Traditional Business Gaming Process - Aiming to Capture Business Process Authenticity , 2004, J. Inf. Technol. Educ..

[4]  Brigid Barron When Smart Groups Fail , 2003 .

[5]  Paul A. Kirschner,et al.  The analysis of negotiation of common ground in CSCL , 2007 .

[6]  César A. Collazos,et al.  Collaborative Scenarios to Promote Positive Interdependence among Group Members , 2003, CRIWG.

[7]  Maarit Arvaja,et al.  Contextual perspective in analysing collaborative knowledge construction of two small groups in web-based discussion , 2007, Int. J. Comput. Support. Collab. Learn..

[8]  Raija Hämäläinen,et al.  Game Mechanics in the Design of a Collaborative 3D Serious Game , 2014 .

[9]  Hendrik H. Leemkuil,et al.  Review of educational use of games and simulations. , 2000 .

[10]  F. Fischer,et al.  Toward a Script Theory of Guidance in Computer-Supported Collaborative Learning , 2013, Educational psychologist.

[11]  Raija H. Hämäläinen,et al.  Theoretical and Pedagogical Perspectives on Orchestrating Creativity and Collaborative Learning. , 2011 .

[12]  James Laffey,et al.  Assessing Social Ability in Online Learning Environments , 2006 .

[13]  Andy Keenan,et al.  Sociability and social interaction on social networking websites , 2009 .

[14]  Gwo-Jen Hwang,et al.  A collaborative game-based learning approach to improving students' learning performance in science courses , 2013, Comput. Educ..

[15]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[16]  Sanna Järvelä,et al.  Group-level analysis on multiplayer game collaboration: how do the individuals shape the group interaction? , 2010, Interact. Learn. Environ..

[17]  Miguel Nussbaum,et al.  From MMORPG to a Classroom Multiplayer Presential Role Playing Game , 2010, J. Educ. Technol. Soc..

[18]  Brian G. Burton,et al.  Learning in 3D Virtual Environments: Collaboration and Knowledge Spirals , 2010 .

[19]  Robert J. Moore,et al.  Virtual “Third Places”: A Case Study of Sociability in Massively Multiplayer Games , 2007, Computer Supported Cooperative Work (CSCW).

[20]  Armin Weinberger,et al.  Scripts for Computer-Supported Collaborative Learning , 2003 .

[21]  Benjamin A. Clegg,et al.  Measuring Game Engagement , 2014 .

[22]  Heikki Lyytinen,et al.  Children's engagement during digital game-based learning of reading: The effects of time, rewards, and challenge , 2014, Comput. Educ..

[23]  Allyson Hadwin,et al.  The learning kit project: Software tools for supporting and researching regulation of collaborative learning , 2010, Comput. Hum. Behav..

[24]  Bob Gregory,et al.  Teaching Lean Manufacturing With Simulations and Games: A Survey and Future Directions , 2010 .

[25]  Marlene Scardamalia,et al.  Group-level formative feedback and metadiscourse , 2015, Int. J. Comput. Support. Collab. Learn..

[26]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[27]  Raija Hämäläinen,et al.  Challenge of supporting vocational learning: Empowering collaboration in a scripted 3D game - How does teachers' real-time orchestration make a difference? , 2012, Comput. Educ..

[28]  Z. Berge,et al.  Student barriers to online learning: A factor analytic study , 2005 .

[29]  Charles F. Petranek A Maturation in Experiential Learning: Principles of Simulation and Gaming , 1994 .

[30]  C. Tu,et al.  The Relationship of Social Presence and Interaction in Online Classes , 2002 .

[31]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[32]  S. Vosniadou,et al.  Designing learning environments to promote conceptual change in science , 2001 .

[33]  Sanna Järvelä,et al.  Supporting Small-Group Learning Using Multiple Web 2.0 Tools: A Case Study in the Higher Education Context. , 2012 .

[34]  Mohamed Khalifa,et al.  Supporting Social Interaction in Virtual Communities: Role of Social Presence , 2006, AMCIS.

[35]  Bram de Wever,et al.  Scripting the role of assessor and assessee in peer assessment in a wiki environment: Impact on peer feedback quality and product improvement , 2015, Comput. Educ..

[36]  Rob Nadolski,et al.  Scripted collaboration in serious gaming for complex learning: Effects of multiple perspectives when acquiring water management skills , 2011, Br. J. Educ. Technol..

[37]  Aphrodite Tsalgatidou,et al.  Multilevel Petri Nets for Modeling and Simulating Organizational Dynamic Behavior , 1996 .

[38]  Jan-Willem Strijbos,et al.  Developing the role concept for computer-supported collaborative learning: An explorative synthesis , 2010, Comput. Hum. Behav..

[39]  Jan H. G. Klabbers The Emerging Field of Simulation & Gaming: Meanings of a Retrospect , 2001 .

[40]  Miguel Nussbaum,et al.  A framework for the design and integration of collaborative classroom games , 2011, Comput. Educ..

[41]  Timo Lainema,et al.  Foundation for Measuring Engagement in Educational Games , 2008 .

[42]  Raija Hämäläinen,et al.  Perceived Sociability and Social Presence in a Collaborative Serious Game , 2013, Int. J. Game Based Learn..

[43]  Bernd Brügge,et al.  Social interaction patterns for learning in serious games , 2014, EuroPLoP.

[44]  Wilfried Admiraal,et al.  The concept of flow in collaborative game-based learning , 2011, Comput. Hum. Behav..

[45]  John D'Ambra,et al.  Do nontask interactions matter? The relationship between nontask sociability of computer supported collaborative learning and learning outcomes , 2012, Br. J. Educ. Technol..

[46]  Rupert Wegerif,et al.  The Social Dimension of Asynchronous Learning Networks , 2019, Online Learning.

[47]  James J. Appleton,et al.  Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument , 2006 .

[48]  Caroline Haythornthwaite,et al.  Community Development Among Distance Learners: Temporal and Technological Dimensions , 2006, J. Comput. Mediat. Commun..

[49]  Shannon Kennedy-Clark,et al.  What Do Students Learn When Collaboratively Using A Computer Game in the Study of Historical Disease Epidemics, and Why? , 2011, Games Cult..

[50]  Jeanne H. Brockmyer,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interacting with computers.

[51]  John R. Mergendoller,et al.  Developing a problem-based learning simulation: An economics unit on trade , 2004 .

[52]  P. Anderson,et al.  Business Simulations and Cognitive Learning , 2009 .

[53]  N. Whitton Game Engagement Theory and Adult Learning , 2011 .

[54]  Paul A. Kirschner,et al.  Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research , 2003, Comput. Hum. Behav..

[55]  Richard F. Bowman A "Pac-Man" theory of motivation: Tactical implications for classroom instruction. , 1982 .

[56]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[57]  Charles K. Crook,et al.  Deferring to resources: collaborations around traditional vs computer-based notes , 2002, J. Comput. Assist. Learn..

[58]  N. Whitton,et al.  Deconstructing Engagement , 2014 .

[59]  Tony Manninen,et al.  Designing Puzzles for Collaborative Gaming Experience - CASE: eScape , 2005, DiGRA Conference.

[60]  Sheng-Chin Yu,et al.  journal homepage: www.elsevier.com/locate/compedu , 2022 .

[61]  Eduardo Salas,et al.  Toward a Taxonomy Linking Game Attributes to Learning , 2012 .

[62]  Maarit Arvaja,et al.  Personal and shared experiences as resources for meaning making in a philosophy of science course , 2012, Int. J. Comput. Support. Collab. Learn..

[63]  P. Kirschner,et al.  Social Aspects of CSCL Environments: A Research Framework , 2013 .

[64]  Kara L. Orvis,et al.  Relationships Between Game Attributes and Learning Outcomes , 2009 .

[65]  James M. Boyle,et al.  Engagement in digital entertainment games: A systematic review , 2012, Comput. Hum. Behav..

[66]  Michele D. Dickey Engaging by design: How engagement strategies in popular computer and video games can inform instructional design , 2005 .

[67]  Raija Hämäläinen,et al.  Designing and evaluating collaboration in a virtual game environment for vocational learning , 2008, Comput. Educ..

[68]  Kimmo Oksanen,et al.  Subjective Experience and Sociability in a Collaborative Serious Game , 2013 .

[69]  J. Wolfe A History of Business Teaching Games in English-Speaking and Post-Socialist Countries: The Origination and Diffusion of a Management Education and Development Technology , 1993 .

[70]  M. Chi Quantifying Qualitative Analyses of Verbal Data: A Practical Guide , 1997 .

[71]  Qiyun Wang,et al.  Design and evaluation of a collaborative learning environment , 2009, Comput. Educ..

[72]  Hans van Buuren,et al.  Measuring perceived sociability of computer-supported collaborative learning environments , 2007, Comput. Educ..

[73]  Päivi Häkkinen,et al.  Designing and analyzing collaboration in a scripted game for vocational education , 2008, Comput. Hum. Behav..

[74]  Steven C. Gold,et al.  Developments in Business Gaming , 2009 .

[75]  Timo Lainema,et al.  Player-reported Impediments to Game-based Learning , 2014, Trans. Digit. Games Res. Assoc..

[76]  Gerry Stahl A decade of CSCL , 2015, Int. J. Comput. Support. Collab. Learn..

[77]  Karen Littleton,et al.  Musical collaboration outside school: Processes of negotiation in band rehearsals , 2008 .

[78]  John Washbush,et al.  A Review of Scholarship on Assessing Experiential Learning Effectiveness , 2004 .

[79]  Bernhard Herz,et al.  Experiential Learning and the Effectiveness of Economic Simulation Games , 1998 .

[80]  Jochen Rick,et al.  Collaborative games: Lessons learned from board games , 2006 .

[81]  V. Ruohomäki Simulation Gaming for Organizational Development , 2003 .