DELIVER! - An educational game for teaching Earned Value Management in computing courses

Context: To meet the growing need for education in Software Project Management, educational games have been introduced as a beneficial instructional strategy. However, there are no low-cost board games openly available to teach Earned Value Management (EVM) in computing programs. Objective: This paper presents an educational board game to reinforce and teach the application of EVM concepts in the context of undergraduate computing programs complementing expository lessons on EVM basics. Method: The game has been developed based on project management fundamentals and teaching experience in this area. So far, it has been applied in two project management courses in undergraduate computing programs at the Federal University of Santa Catarina. We evaluated motivation, user experience and the game's contribution to learning through case studies on Kirkpatrick's level one based on the perception of the students. Results: First results of the evaluation of the game indicate a perceived potential of the game to contribute to the learning of EVM concepts and their application. The results also point out a very positive effect of the game on social interaction, engagement, immersion, attention and relevance to the course objectives. Conclusion: We conclude that the game DELIVER! can contribute to the learning of the EVM on the cognitive levels of remembering, understanding and application. The illustration of the application of EVM through the game can motivate its usefulness. The game has proven to be an engaging instructional strategy, keeping students on the task and attentive. In this respect, the game offers a possibility to complement traditional instructional strategies for teaching EVM. In order to further generalize and to strengthen the validity of the results, it is important to obtain further evaluations.

[1]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[2]  Jari Takatalo,et al.  Presence, Involvement, and Flow in Digital Games , 2010, Evaluating User Experience in Games.

[3]  Steffen-Peter Ballstaedt.  Buchbesprechungen / Book Reviews , 1999 .

[4]  Richard Stang.  Bruns, Beate; Gajewski, Petra: Multimediales Lernen im Netz. Leitfaden für Entscheider und Planer. 2000. Rezension , 2001 .

[5]  C. Itin.  Reasserting the Philosophy of Experiential Education as a Vehicle for Change in the 21st Century , 1999 .

[6]  Donald L. Kirkpatrick,et al.  Evaluating Training Programs : The Four Levels , 2009 .

[7]  J.A. Polack-Wahl,et al.  Enhancing software engineering education using teaching aids in 3-D online virtual worlds , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[8]  Winston Bennett,et al.  A META-ANALYSIS OF THE RELATIONS AMONG TRAINING CRITERIA , 1997 .

[9]  M. Hannafin,et al.  Situated cognition and learning environments: Roles, structures, and implications for design , 1995 .

[10]  Robert F. DeVellis,et al.  Scale Development: Theory and Applications. , 1992 .

[11]  Jerry Zeyu Gao,et al.  Business-to-Business E-Commerce Frameworks , 2000, Computer.

[12]  Timothy Lethbridge,et al.  What knowledge is important to a software professional? , 2000, Computer.

[13]  R. H. Thayer,et al.  Guest Editors' Introduction: Software Engineering Project Management 20 Years Later , 2005, IEEE Softw..

[14]  J. Keller.  Motivational Design for Learning and Performance: The ARCS Model Approach , 2009 .

[15]  J. Keller.  Development and use of the ARCS model of instructional design , 1987 .

[16]  Regina Bernhaupt,et al.  Evaluating User Experience in Games - Concepts and Methods , 2010, Human-Computer Interaction Series.

[17]  Fred Percival,et al.  A handbook of educational technology , 1984 .

[18]  Patricia Ensworth.  The accidental project manager , 2001 .

[19]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[20]  E. M. Bennatan.  Software Project Management: The Magic Suit of Clothes , 2009 .

[21]  Gil Taran,et al.  Using Games in Software Engineering Education to Teach Risk Management , 2007, 20th Conference on Software Engineering Education & Training (CSEET'07).

[22]  Eduardo H. Calvillo Gámez,et al.  On the core elements of the experience of playing video games , 2009 .

[23]  Márcio de Oliveira Barros,et al.  Model-driven game development: experience and model enhancements in software project management education , 2006, Softw. Process. Improv. Pract..

[24]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[25]  Clark C. Abt,et al.  Serious games , 2016, Springer International Publishing.

[26]  K. Poels,et al.  "It is always a lot of fun!": exploring dimensions of digital game experience using focus group methodology , 2007, Future Play.

[27]  Guttorm Sindre,et al.  Evaluating the effectiveness of learning interventions: an information systems case study , 2003, ECIS.

[28]  André van der Hoek,et al.  Comprehensive Evaluation of an Educational Software Engineering Simulation Environment , 2007, 20th Conference on Software Engineering Education & Training (CSEET'07).

[29]  K. Topping.  Self and Peer Assessment in School and University: Reliability, Validity and Utility , 2003 .

[30]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[31]  D. Boud,et al.  Student Self-Assessment in Higher Education: A Meta-Analysis , 1989 .

[32]  Carol Rolheiser,et al.  Skills training versus action research in-service: impact on student attitudes to self-evaluation , 1998 .

[33]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[34]  H. D. Rombach,et al.  The Goal Question Metric Approach , 1994 .

[35]  Rajesh Nellore,et al.  Factors influencing success in integrated product development (IPD) projects , 2001, IEEE Trans. Engineering Management.

[36]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[37]  Jochen Ludewig,et al.  Simulation in software engineering training , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[38]  Forrest Shull,et al.  To Game or Not to Game? , 2009, IEEE Software.