Tracking precursors of learning analytics over serious game team performance ranking

ABSTRACT The use of serious games to improve collaborative skill transfer and retention has received considerable attention from scholars, web marketing practitioners and business consultants. Team rankings and learning progress in game learning analytics, however, have yet to be empirically examined. Using fuzzy-set qualitative comparative analysis to study the performance of competing teams in a web marketing serious game (Simbound), we highlight a combination of causal conditions (engagement, reach and profitability) affecting team rankings. This paper proposes a conceptual architecture of the forces that influence learning progress within a collaborative learning environment. This learning environment is studied for web marketing boot camps powered by Simbound at three European universities: Grenoble Alpes University (France), University of Milano-Bicocca (Italy) and Dunarea de Jos University of Galati (Romania). Gaining knowledge of cases through game learning analytics is valuable for two reasons: It emphasises the instructor’s role in mobilising players’ engagement, and it tests variability across cases, offering precursors of team performance rankings. This approach to collective skill retention highlights the moderating factors of team performance rankings, whilst purposely calibrating a gameable learning environment. This paper enriches our knowledge of how active experimentation in learning analytics metrics can develop skills for real business competition.

[1]  Peer C. Fiss,et al.  Embracing Causal Complexity , 2017 .

[2]  Michail N. Giannakos,et al.  Enhancing Student Digital Skills: Adopting an Ecosystemic School Analytics Approach , 2017, 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT).

[3]  Eric Jamet,et al.  Digital game-based learning: Impact of instructions and feedback on motivation and learning effectiveness , 2013, Comput. Educ..

[4]  Leonard A. Annetta.  The “I's” Have It: A Framework for Serious Educational Game Design , 2010 .

[5]  Peer C. Fiss.  A set-theoretic approach to organizational configurations , 2007 .

[6]  W. Lewis Johnson,et al.  Serious Use of a Serious Game for Language Learning , 2007, AIED.

[7]  Patrice Torguet,et al.  Towards a Serious Game to Help Students Learn Computer Programming , 2009, Int. J. Comput. Games Technol..

[8]  Steve Brown,et al.  Capstone Teaching Models: Combining Simulation, Analytical Intuitive Learning Processes, History and Effectiveness , 2012 .

[9]  Alessandro De Gloria,et al.  Mapping learning and game mechanics for serious games analysis , 2015, Br. J. Educ. Technol..

[10]  E. Wenger,et al.  Promoting and assessing value creation in communities and networks: a conceptual framework , 2011 .

[11]  Shervin Shirmohammadi,et al.  Effects of serious games on perceived team cohesiveness in a multi-user virtual environment , 2016, Comput. Hum. Behav..

[12]  Dirk T. Tempelaar,et al.  In search for the most informative data for feedback generation: Learning analytics in a data-rich context , 2015, Comput. Hum. Behav..

[13]  João Varajão,et al.  Simulation, Games and Challenges: From Schools to Enterprises , 2011, EOMAS.

[14]  Hugh M. Cannon,et al.  Constructs of Simulation Evaluation , 2002 .

[15]  Margaret E. Gredler,et al.  Games and Simulations and Their Relationships to Learning , 2013 .

[16]  Donald R. Cruickshank,et al.  Classroom games and simulations , 1980 .

[17]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[18]  Michael J. D. Sutton,et al.  FUNIFICATION 2.0: Knowledge mobilization model for corporate and educational game-based learning , 2017 .

[19]  Carsten Q. Schneider,et al.  Standards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets , 2010 .

[20]  Alessandro De Gloria,et al.  Designing a Course for Stimulating Entrepreneurship in Higher Education through Serious Games , 2012, VS-GAMES.

[21]  Charles C. Ragin,et al.  Redesigning social inquiry , 2008 .

[22]  Michail N. Giannakos,et al.  Making Sense of Learning Analytics with a Configurational Approach , 2016, SE@VBL@LAK.

[23]  Das Narayandas,et al.  The Skills Gap and the Near-Far Problem in Executive Education and Leadership Development , 2016 .

[24]  Diana Pérez,et al.  Active learning through collaborative knowledge building using an automatic free-text scoring system in a b-learning environment , 2016, Behav. Inf. Technol..

[25]  Clint A. Bowers,et al.  Serious Game Design and Development: Technologies for Training and Learning , 2010 .

[26]  Pedro Torres,et al.  The impact of experiential learning on managers’ strategic competencies and decision style , 2017 .

[27]  Wen Qu,et al.  Using gameplay data to examine learning behavior patterns in a serious game , 2017, Comput. Hum. Behav..

[28]  Iván Martínez-Ortiz,et al.  Systematizing game learning analytics for serious games , 2017, 2017 IEEE Global Engineering Education Conference (EDUCON).

[29]  Alexandru Capatina,et al.  HOW TO MITIGATE THE RISKS OF MANAGING ONLINE ADVERTISING CAMPAIGNS BY TRAINING WITH SIMBOUND SIMULATION GAME , 2013 .

[30]  Owen P. Hall,et al.  Learning Assurance Using Business Simulations Applications to Executive Management Education , 2014 .

[31]  Scott Nicholson.  A User-Centered Theoretical Framework for Meaningful Gamification , 2012 .

[32]  Ross Brennan,et al.  ( HOW MUCH DO SIMULATION GAMES IMPROVE MARKETING STUDENTS' NUMERACY AND FINANCIAL SKILLS?) , 2012 .

[33]  Luis de Marcos,et al.  An empirical study comparing gamification and social networking on e-learning , 2014, Comput. Educ..

[34]  Umar Ruhi,et al.  An experiential learning pedagogical framework for enterprise systems education in business schools , 2016 .

[35]  Geertje Bekebrede,et al.  The research and evaluation of serious games: Toward a comprehensive methodology , 2014, Br. J. Educ. Technol..

[36]  P. Vorderer,et al.  Serious games : mechanisms and effects , 2009 .

[37]  Porter,et al.  MARKSTRAT3: The Strategic Marketing Simulation , 1997 .

[38]  Miltiadis D. Lytras,et al.  Predicting Student Performance using Advanced Learning Analytics , 2017, WWW.

[39]  Christian Sebastian Loh,et al.  Measuring the (dis-)similarity between expert and novice behaviors as serious games analytics , 2013, Education and Information Technologies.

[40]  Charles C. Ragin,et al.  Fuzzy Sets : Calibration Versus Measurement , 2006 .

[41]  Hajime Miyauchi,et al.  An Intelligent Decision Support Based on a subtractive Clustering and Fuzzy Inference System for multiobjective Optimization Problem in Serious Game , 2011, Int. J. Inf. Technol. Decis. Mak..

[42]  David Crookall,et al.  Towards a Reconceptualization of Simulation: From Representation to Reality. , 1987 .

[43]  Ralf Steinmetz,et al.  Learning Analytics and Serious Games: Trends and Considerations , 2014, SeriousGames '14.

[44]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[45]  Richard D. Teach,et al.  Assessing Participant Learning in a Business Simulation , 2014 .

[46]  Arch G. Woodside.  Case-Based Causal Mapping of Bad and Good Decisions ☆ , 2016 .

[47]  Cristina Alonso Fernández.  Gaming learning analytics for serious games , 2016 .

[48]  Lina Yordanova,et al.  Gamification in education , 2014 .

[49]  Bernhard Herz,et al.  Experiential Learning and the Effectiveness of Economic Simulation Games , 1998 .

[50]  Alejandro Calderón,et al.  Coverage of ISO/IEC 12207 Software Lifecycle Process by a Simulation-Based Serious Game , 2016, SPICE.

[51]  Pablo Moreno-Ger,et al.  Game Learning Analytics: Learning Analytics for Serious Games , 2016 .

[52]  Dennis Charsky,et al.  From Edutainment to Serious Games: A Change in the Use of Game Characteristics , 2010, Games Cult..

[53]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[54]  R. Landers.  Developing a Theory of Gamified Learning , 2014 .