Postprocessing Gameplay Metrics for Gameplay Performance Segmentation Based on Audiovisual Analysis

This paper introduces a new variant of gameplay metrics that further develops a set of processes that expand user-centered game testing practices capable of quantifying user experiences. The key goal of the method presented here is to widen the appeal and application of game metrics within research relevant to, and representative of the wider field of game studies. In doing so, we acknowledge that the interests of this research community is often focused on player experience and performance with a broad range of off-the-shelf games that have already been released to the public. In order to be able to include any PC game system within research (or audiovideo stream, e.g., YouTube walkthroughs) our approach comprises of a postprocessing method for analyzing player performance. Through exploiting the audiovisual streams that are transmitted to the player, this approach processes content activated and generated during play and is therefore representative of individual player's encounters with specific games.

[1]  Clara Fernández-Vara,et al.  Rounds, Levels, and Waves , 2008, Games Cult..

[2]  Espen Aarseth,et al.  Computer Game Studies, Year One , 2001, Game Stud..

[3]  Datong Chen,et al.  Text enhancement with asymmetric filter for video OCR , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[4]  Susan Klement,et al.  Open-system versus closed-system indexing: A vital distinction , 2002 .

[5]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.

[6]  Gareth Schott,et al.  Feedback-based gameplay metrics: measuring player experience via automatic visual analysis , 2012, IE '12.

[7]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[8]  Clara Fernández-Vara,et al.  Towards an Ontological Language for Game Analysis , 2005, DiGRA Conference.

[9]  Gareth Schott,et al.  DeFragging Regulation: From putative effects to 'researched' accounts of player experience , 2013, DiGRA Conference.

[10]  Jonathan Foote,et al.  Scene boundary detection via video self-similarity analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[11]  Marco Slik,et al.  VIDEO BASED OCR: A CASE STUDY OF REAL TIME IN- SCREEN SUBTITLE RECOGNITION , 2013 .

[12]  G. Calleja In-Game: From Immersion to Incorporation , 2011 .

[13]  Freddy Y. Y. Choi Advances in domain independent linear text segmentation , 2000, ANLP.

[14]  Erik Fagerholt,et al.  Beyond the HUD - User Interfaces for Increased Player Immersion in FPS Games , 2009 .

[15]  Temple F. Smith,et al.  Comparison of biosequences , 1981 .

[16]  Anders Tychsen,et al.  Crafting User Experience via Game Metrics Analysis , 2008 .

[17]  Magy Seif El-Nasr,et al.  Game Analytics - The Basics , 2013, Game Analytics, Maximizing the Value of Player Data.

[18]  Noel Murphy,et al.  Automatic TV advertisement detection from MPEG bitstream , 2002, Pattern Recognit..

[19]  Riccardo Leonardi,et al.  Audio as a support to scene change detection and characterization of video sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Nicola Orio,et al.  Music Retrieval: A Tutorial and Review , 2006, Found. Trends Inf. Retr..

[21]  Gareth Schott,et al.  Exploring the Cause of Game (Derived) Arousal: What biometric accounts of player experience revealed , 2014, DiGRA.

[22]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[23]  Pierre Hanna,et al.  Visualisation of Musical Structure by Applying Improved Editing Algorithms , 2008, ICMC.

[24]  Vijayan K. Asari,et al.  Real time face detection from color video stream based on PCA method , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[25]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[26]  Laurent Oudre,et al.  Concurrent Estimation of Chords and Keys from Audio , 2010, ISMIR.

[27]  Gaël Richard,et al.  Combined Supervised and Unsupervised Approaches for Automatic Segmentation of Radiophonic Audio Streams , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[28]  Fred Leise,et al.  Controlled vocabularies : an introduction , 2008 .

[29]  Chia-Hung Yeh,et al.  Movie story intensity representation through audiovisual tempo analysis , 2009, Multimedia Tools and Applications.

[30]  Xavier Serra,et al.  Chroma Binary Similarity and Local Alignment Applied to Cover Song Identification , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[31]  David F. Redmiles,et al.  Extracting usability information from user interface events , 2000, CSUR.

[32]  Adam W. Ruch,et al.  Videogame interface: artefacts and tropes , 2010 .

[33]  Alex Santos Real-Time Opaque and Semi-Transparent TV Logos Detection , 2006 .

[34]  Wen Gao,et al.  Jersey number detection in sports video for athlete identification , 2005, Visual Communications and Image Processing.

[35]  Karolien Poels,et al.  Playability and player experience research , 2009 .

[36]  Gareth Schott,et al.  the of Game (Derived) : What biometric accounts of player experience revealed , 2014 .

[37]  Pierre Hanna,et al.  An alignment based system for chord sequence retrieval , 2009, JCDL '09.

[38]  Raya Fidel,et al.  Searchers' selection of search keys: II. Controlled vocabulary or free-text searching , 1991, J. Am. Soc. Inf. Sci..

[39]  Julien Allali,et al.  Adaption of String Matching Algorithms for Identification of Near-Duplicate Music Documents , 2007, PAN.

[40]  Michael Halliday,et al.  Cohesion in English , 1976 .

[41]  Joseph E. Grimes,et al.  The Thread of Discourse , 1984 .

[42]  Magy Seif El-Nasr,et al.  Game Analytics , 2013, Springer London.

[43]  B. G. Hogade,et al.  Abrupt Scene Change Detection , 2008 .

[44]  Chung-Lin Huang,et al.  A robust scene-change detection method for video segmentation , 2001, IEEE Trans. Circuits Syst. Video Technol..