Evaluation of a game used to teach usability to undergraduate students in computer science

There is a growing recognition of the importance of teaching usability, which has been discussed in various forms in undergraduate courses in areas related to Information Technology. Usability is an essential concept that professionals need to learn as they produce artefacts for different types of users and contexts. After a systematic mapping of the literature in this field, the authors found that the techniques currently used to teach concepts related to usability mostly involve the development of projects and case studies or the application of heuristic evaluations. Although the use of serious games has been used in different areas, our research exposed that serious games are not used to teach usability. Therefore, we propose in this paper the development of a simulator game that exposes the player to a corporate environment by simulating real situations in the projects of a fictitious company. The objective of the game, called the Usability Game, is to support the teaching of usability by addressing the usability engineering life cycle, requirements analysis, and prototyping and heuristic evaluation. We conducted four experiments to evaluate the effectiveness of using the Usability Game as a tool to teach usability concepts to students. We concluded that the game promotes the learning of usability in general, and heuristic evaluation and requirements analysis in particular.

[1]  F. Culwin,et al.  The internet as a resource for teaching non internet topics , 2001, Proceedings 2001 Symposium on Applications and the Internet Workshops (Cat. No.01PR0945).

[2]  Chris Crawford,et al.  The Art of Computer Game Design , 1984 .

[3]  Eric Deeson Games and simulations in online learning - Edited by D Gibson , 2007, Br. J. Educ. Technol..

[4]  L. Cooke,et al.  Connecting usability education and research with industry needs and practices , 2005, IEEE Transactions on Professional Communication.

[5]  James M. Boyle,et al.  A systematic literature review of empirical evidence on computer games and serious games , 2012, Comput. Educ..

[6]  Jean B. Gasen HCI Education News: VALIDATING THE ACM SIGCHI CURRICULA FOR HUMAN-COMPUTER INTERACTION , 1993, SGCH.

[7]  Nancy J. Wahl Student-run usability testing , 2000, Thirteenth Conference on Software Engineering Education and Training.

[8]  Stanley M. Halpin,et al.  An Integrative Approach to Leader Development: Connecting Adult Development, Identity, and Expertise , 2008 .

[9]  William M. K. Trochim,et al.  Research methods knowledge base , 2001 .

[10]  Marc Prensky,et al.  Digital game-based learning , 2000, CIE.

[11]  S. Ludi Providing Students with Usability Testing Experience: Bringing Home the Lesson “The User is Not Like You” , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[12]  André van der Hoek,et al.  Simse: a software engineering simulation environment for software process education , 2006 .

[13]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1999, CHI Extended Abstracts.

[14]  Magnus Jahre,et al.  Experimental Validation of the Learning Effect for a Pedagogical Game on Computer Fundamentals , 2009, IEEE Transactions on Education.

[15]  Heather Wardlaw,et al.  Games and Simulations , 1978 .

[16]  Yonglei Tao Work in progress - introducing usability concepts in early phases of software development , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[17]  Alain Abran,et al.  Usability Meanings and Interpretations in ISO Standards , 2003, Software Quality Journal.

[18]  Fabiane Barreto Vavassori Benitti,et al.  Investigando o ensino de IHC no contexto da computação: o que e como é ensinado? , 2012, WEIHC.

[19]  Cristian Rusu,et al.  Teaching HCI: A Challenging Intercultural, Interdisciplinary, Cross-Field Experience , 2007, IWIC.

[20]  B. Bloom Taxonomy of educational objectives , 1956 .

[21]  Patrice Torguet,et al.  Experimental Feedback on Prog&Play: A Serious Game for Programming Practice , 2011, Comput. Graph. Forum.

[22]  John M. D. Hill,et al.  Puzzles and games: addressing different learning styles in teaching operating systems concepts , 2003, SIGCSE.

[23]  Mark Guzdial,et al.  Computer Science Curriculum 2008: An Interim Revision of CS 2001 , 2008 .

[24]  Jochen Ludewig,et al.  Simulation in software engineering training , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[25]  Forrest Shull,et al.  To Game or Not to Game? , 2009, IEEE Software.

[26]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[27]  José Antonio Pow-Sang,et al.  Applying the Chilean Educational Experience in HCI to Peruvian Undergraduate and Graduate Programs , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[28]  J.M. Carroll,et al.  Case Studies as Minimalist Information , 2006, IEEE Transactions on Professional Communication.

[29]  J. C. Herz,et al.  Joystick Nation: How Videogames Ate Our Quarters, Won Our Hearts, and Rewired Our Minds , 1997 .