Playtesting with a Purpose

Playtesting, or using play to guide game design, gives designers feedback about whether their game is meeting their goals and the player's expectations. We report a case study of designing, deploying, and iterating on a series of playtesting workshops for novice game designers. We identify common missteps made by novice designers and address these missteps through the concept of purposefulness, understanding why you are playtesting as well as how to playtest. We ground our workshops in the development of rich player experience goals, which inform playtest design, data collection and iteration. We show that by applying methods taught in our workshops, novice game designers leveraged playtest methods and tools, employed playtesting and data collection methods appropriate for their goals, and effectively applied playtest data in iterative design. We conclude with lessons learned and next steps in our research on playtesting.

[1]  Dennis R. Wixon,et al.  Using the RITE method to improve products; a definition and a case study , 2007 .

[2]  Andrés Lucero,et al.  PLEX Cards: a source of inspiration when designing for playfulness , 2010, Fun and Games '10.

[3]  Charlotte Wiberg,et al.  Game Usability Heuristics (PLAY) for Evaluating and Designing Better Games: The Next Iteration , 2009, HCI.

[4]  Robert Zubek,et al.  MDA : A Formal Approach to Game Design and Game Research , 2004 .

[5]  Jeanne H. Brockmyer,et al.  The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews , 2009, Interacting with computers.

[6]  James Noble,et al.  Video game values: Human-computer interaction and games , 2007, Interact. Comput..

[7]  Magy Seif El-Nasr,et al.  Methods for Game User Research: Studying Player Behavior to Enhance Game Design , 2013, IEEE Computer Graphics and Applications.

[8]  Richard Hull,et al.  Designing Engaging Experiences with Children and Artists , 2018, Funology, 2nd ed..

[9]  Clayton Lewis,et al.  Learning to use a text processing system: Evidence from “thinking aloud” protocols , 1982, CHI '82.

[10]  Staffan Björk,et al.  Game Research Methods. An Overview , 2015 .

[11]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[12]  Randy J. Pagulayan,et al.  User-centered design in games , 2012 .

[13]  Martin Guha,et al.  Encyclopedia of Statistics in Behavioral Science , 2006 .

[14]  Richard Hull,et al.  Designing Engaging Experiences with Children and Artists , 2005, Funology.

[15]  M. Csíkszentmihályi,et al.  The Importance of Challenge for the Enjoyment of Intrinsically Motivated, Goal-Directed Activities , 2012, Personality & social psychology bulletin.

[16]  Katherine Isbister,et al.  Game Usability: Advancing the Player Experience , 2008 .

[17]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[18]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[19]  Staffan Björk,et al.  Game Research Methods , 2015 .

[20]  Anna Anthropy,et al.  A Game Design Vocabulary: Exploring the Foundational Principles Behind Good Game Design , 2014 .

[21]  Margaret Volante Qualitative research. , 2008, Nurse researcher.

[22]  Tracy Fullerton,et al.  Game Design Workshop: A Playcentric Approach to Creating Innovative Games, Third Edition , 2014 .

[23]  Christian Bird,et al.  "What Went Right and What Went Wrong": An Analysis of 155 Postmortems from Game Development , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C).

[24]  P. Vorderer,et al.  Enjoyment: At the Heart of Media Entertainment , 2004 .