Playability: analysing user experience in video games

Currently, few studies focus on analysing the degree of the Player eXperience (PX) in video games. Video games have now become interactive entertainment systems with a high economic impact on society; these are interactive systems characterised by their subjectivity, which differ from other systems in that their main objective is to entertain and amuse the user (player). This work discusses the analysis and evaluation of the User eXperience (UX) in interactive entertainment systems, exploring how usability, given its definition, objectives and the fact it is one of the main dimensions of UX, is not sufficient to characterise the PX, giving rise to a new concept: Playability. In this paper, we present a framework for the analysis and evaluation of the UX in video games. The results show the need and importance of a framework to help us understand and measure the experience that players feel using these types of interactive systems, in order to improve the experience during play time. The proposed framework characterises the experience using attributes to identify and properties to measure UX. It thus provides a multifaceted analysis mechanism to assess the impact of the gaming experience and its relationship with the elements of a video game. We therefore present a system to represent UX based on this framework, with the aim of ensuring and measuring a satisfactory experience of the entertainment system. Finally, we discuss a practical experiment in which an evaluation of the playability of a commercial video game was carried out using the methods proposed in this work.

[1]  Yvonne de Kort,et al.  Influence of social setting on player experience of digital games , 2008, CHI Extended Abstracts.

[2]  W. IJsselsteijn,et al.  Exploring Behavioral Expressions of Player Experience in Digital Games , 2008 .

[3]  Karolien Poels,et al.  Digital Games, the Aftermath: Qualitative Insights into Postgame Experiences , 2010, Evaluating User Experience in Games.

[4]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction. Users Diversity , 2011, Lecture Notes in Computer Science.

[5]  Karolien Poels,et al.  Characterising and measuring user experiences in digital games , 2007 .

[6]  Paul van Schaik,et al.  Modelling user experience - An agenda for research and practice , 2010, Interact. Comput..

[7]  Tom Carey,et al.  ACM SIGCHI Curricula for Human-Computer Interaction , 1992 .

[8]  Alessandro Canossa,et al.  Defining personas in games using metrics , 2008, Future Play.

[9]  Manfred Tscheligi,et al.  Evaluating user experiences in games , 2008, CHI Extended Abstracts.

[10]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[11]  Francisco Luis Gutiérrez Vela,et al.  Playability as Extension of Quality in Use in Video Games , 2009, I-USED.

[12]  Francisco Luis Gutiérrez Vela,et al.  Playability: How to Identify the Player Experience in a Video Game , 2009, INTERACT.

[13]  Hyunseung Choo,et al.  Exploring the user experience of three-dimensional virtual learning environments , 2013, Behav. Inf. Technol..

[14]  Ben Shneiderman,et al.  Designing for fun: how can we design user interfaces to be more fun? , 2004, INTR.

[15]  Egon L. van den Broek,et al.  Experiencing affective interactive art , 2010, Int. J. Arts Technol..

[16]  D. Kort,et al.  Digital Games as Social Presence Technology: Development of the Social Presence in Gaming Questionnaire (SPGQ) , 2007 .

[17]  Christophe Kolski,et al.  Adding user experience into the interactive service design loop: a persona-based approach , 2012, Behav. Inf. Technol..

[18]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[19]  Heather Desurvire,et al.  Using heuristics to evaluate the playability of games , 2004, CHI EA '04.

[20]  Elina M. I. Koivisto,et al.  Playability heuristics for mobile multi-player games , 2007, DIMEA.

[21]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[22]  Panayiotis Zaphiris,et al.  HCI issues in computer games , 2007, Interact. Comput..

[23]  Jainaba Jagne,et al.  Cross-cultural interface design strategy , 2006, Universal Access in the Information Society.

[24]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[25]  Sus Lundgren,et al.  Game Design Patterns , 2003, DiGRA Conference.

[26]  Constantine Stephanidis,et al.  Universal access in the information society , 1999, HCI.

[27]  Allison Druin,et al.  The role of children in the design of new technology , 2002 .

[28]  Xu Sun,et al.  Evaluating user experience of adaptive digital educational games with Activity Theory , 2012, Int. J. Hum. Comput. Stud..

[29]  Ernest Adams,et al.  Andrew Rollings and Ernest Adams on Game Design , 2003 .

[30]  Geraldine Fitzpatrick,et al.  Intergenerational context as an emphasis for design , 2011, Universal Access in the Information Society.

[31]  Muriel Garreta Domingo,et al.  Ten emotion heuristics: guidelines for assessing the user's affective dimension easily and cost-effectively , 2007, BCS HCI.

[32]  Katherine Isbister,et al.  Game Usability - Advice from the Experts for Advancing the Player Experience , 2008 .

[33]  Virpi Roto,et al.  Understanding, scoping and defining user experience: a survey approach , 2009, CHI.

[34]  Andrew F. Monk,et al.  Measuring social behaviour as an indicator of experience , 2013, Behav. Inf. Technol..

[35]  Regina Bernhaupt,et al.  Evaluating User Experience in Games - Concepts and Methods , 2010, Human-Computer Interaction Series.

[36]  David Pinelle,et al.  Heuristic evaluation for games: usability principles for video game design , 2008, CHI.

[37]  Francisco Luis Gutiérrez Vela,et al.  From Usability to Playability: Introduction to Player-Centred Video Game Development Process , 2009, HCI.

[38]  Karolien Poels,et al.  Playability and player experience research , 2009 .

[39]  Sookeun Byun,et al.  Exploring perceptions toward biometric technology in service encounters: a comparison of current users and potential adopters , 2013, Behav. Inf. Technol..

[40]  Chuck Clanton,et al.  An interpreted demonstration of computer game design , 1998, CHI Conference Summary.

[41]  Patricia Paderewski,et al.  Design of educational multiplayer videogames: A vision from collaborative learning , 2009, Adv. Eng. Softw..

[42]  Francisco Luis Gutiérrez Vela,et al.  Enriching Evaluation in Video Games , 2011, INTERACT.

[43]  Clint A. Bowers,et al.  Serious Games Usability Testing: How to Ensure Proper Usability, Playability, and Effectiveness , 2011, HCI.

[44]  Bei Yuan,et al.  Game accessibility: a survey , 2011, Universal Access in the Information Society.

[45]  Constantine Stephanidis,et al.  Universal Access in Human-Computer Interaction , 2011 .

[46]  Elina M. I. Koivisto,et al.  Playability heuristics for mobile games , 2006, Mobile HCI.

[47]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[48]  Ben Shneiderman,et al.  Universal Usability , 2000, UBIQ.

[49]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[50]  Amy Voida,et al.  Console gaming across generations: exploring intergenerational interactions in collocated console gaming , 2011, Universal Access in the Information Society.

[51]  Aki Järvinen,et al.  Communication and Community in Digital Entertainment Services. Prestudy Research Report , 2002 .

[52]  Melissa A. Federoff,et al.  HEURISTICS AND USABILITY GUIDELINES FOR THE CREATION AND EVALUATION OF FUN IN VIDEO GAMES , 2002 .

[53]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[54]  M. Csíkszentmihályi.  Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[55]  Kate S. Hone,et al.  Affectemes and allaffects: A novel approach to coding user emotional expression during interactive experiences , 2006, Behav. Inf. Technol..

[56]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[57]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[58]  Charlotte Wiberg,et al.  Game Usability Heuristics (PLAY) for Evaluating and Designing Better Games: The Next Iteration , 2009, HCI.

[59]  Thomas Westin,et al.  Game Not Over : Accessibility Issues in Video Games , 2005 .

[60]  Regan L. Mandryk,et al.  Biofeedback game design: using direct and indirect physiological control to enhance game interaction , 2011, CHI.

[61]  Jürgen S. Sauer,et al.  The influence of product aesthetics and user state in usability testing , 2011, Behav. Inf. Technol..

[62]  Michela Ott,et al.  Digital games as creativity enablers for children , 2012, Behav. Inf. Technol..

[63]  Alessandro Canossa,et al.  Play-Personas: Behaviours and Belief Systems in User-Centred Game Design , 2009, INTERACT.

[64]  Dimitris Grammenos,et al.  Advances in Game Accessibility from 2005 to 2010 , 2011, HCI.

[65]  Chris Crawford,et al.  The Art of Computer Game Design , 1984 .

[66]  Dominique L. Scapin,et al.  Please Scroll down for Article International Journal of Human-computer Interaction Comparing Inspections and User Testing for the Evaluation of Virtual Environments Comparing Inspections and User Testing for the Evaluation of Virtual Environments , 2022 .

[67]  Egon L. van den Broek.  Beyond biometrics , 2010, ICCS.

[68]  HCI and Game Design : From a Practitioner ’ s Point of View , .

[69]  Constantine Stephanidis,et al.  Designing universally accessible games , 2009, CIE.

[70]  Paul A. Cairns,et al.  Assessing the Core Elements of the Gaming Experience , 2010, Evaluating User Experience in Games.

[71]  James Noble,et al.  Video game values: Human-computer interaction and games , 2007, Interact. Comput..