Investigating the Impact of Annotation Interfaces on Player Performance in Distributed Multiplayer Games

In distributed multiplayer games, it can be difficult to communicate strategic information for planning game moves and player interactions. Often, players spend extra time communicating, reducing their engagement in the game. Visual annotations in game maps and in the gameworld can address this problem and result in more efficient player communication. We studied the impact of real-time feedback on planning annotations, specifically two different annotation types, in a custom-built, third-person, multiplayer game and analyzed their effects on player performance, experience, workload, and annotation use. We found that annotations helped engage players in collaborative planning, which reduced frustration, and shortened goal completion times. Based on these findings, we discuss how annotating in virtual game spaces enables collaborative planning and improves team performance.

[1]  William F. Moroney,et al.  A comparison of two scoring procedures with the NASA task load index in a simulated flight task , 1992, Proceedings of the IEEE 1992 National Aerospace and Electronics Conference@m_NAECON 1992.

[2]  Carl Gutwin,et al.  Target assistance for subtly balancing competitive play , 2011, CHI.

[3]  Carl Gutwin,et al.  Improving player balancing in racing games , 2014, CHI PLAY.

[4]  Eduardo Salas,et al.  Situation Awareness in Team Performance: Implications for Measurement and Training , 1995, Hum. Factors.

[5]  Robert E. Kraut,et al.  The use of visual information in shared visual spaces: informing the development of virtual co-presence , 2002, CSCW '02.

[6]  Marek Bell,et al.  CSCW at play: 'there' as a collaborative virtual environment , 2004, CSCW.

[7]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[8]  Ernest Adams,et al.  Game Mechanics: Advanced Game Design , 2012 .

[9]  Richard E. Hayes,et al.  Understanding Information Age Warfare , 2001 .

[10]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[11]  Sultan A. Alharthi,et al.  A Framework Supporting Selecting Space to Make Place in Spatial Mixed Reality Play , 2017, CHI PLAY.

[12]  Jessica Hammer,et al.  A framework for cooperative communication game mechanics from grounded theory , 2014, CHI PLAY.

[13]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[14]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[15]  C. Heath,et al.  Technology in Action: ‘Interaction’ with computers in architecture , 2000 .

[16]  Stacey D. Scott,et al.  Communication channels and awareness cues in collocated collaborative time-critical gaming , 2012, CSCW.

[17]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[18]  Brian Keegan,et al.  Ping to Win?: Non-Verbal Communication and Team Performance in Competitive Online Multiplayer Games , 2016, CHI.

[19]  Carl Gutwin,et al.  The Effects of Navigation Assistance on Spatial Learning and Performance in a 3D Game , 2017, CHI PLAY.

[20]  Susan R. Fussell,et al.  Gestures Over Video Streams to Support Remote Collaboration on Physical Tasks , 2004, Hum. Comput. Interact..

[21]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[22]  E. Entin,et al.  Communication overhead: The hidden cost of team cognition. , 2004 .

[23]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[24]  W. Keith Edwards,et al.  Verbal coordination in first person shooter games , 2012, CSCW.

[25]  Noshir S. Contractor,et al.  The Social Behaviors of Experts in Massive Multiplayer Online Role-Playing Games , 2009, 2009 International Conference on Computational Science and Engineering.

[26]  Sus Lundgren,et al.  Game Design Patterns , 2003, DiGRA Conference.

[27]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[28]  Wayne G. Lutters,et al.  Mixed reality games , 2012, CSCW.

[29]  Robert E. Kraut,et al.  Persistence matters: making the most of chat in tightly-coupled work , 2004, CHI.

[30]  付伶俐.  打磨Using Language,倡导新理念 , 2014 .

[31]  Kristine Jørgensen,et al.  Gameworld Interfaces , 2013 .

[32]  Andruid Kerne,et al.  Streaming on twitch: fostering participatory communities of play within live mixed media , 2014, CHI.

[33]  Christopher Andrews,et al.  Co-located Collaborative Sensemaking on a Large High-Resolution Display with Multiple Input Devices , 2011, INTERACT.

[34]  Robert E. Kraut,et al.  Action as language in a shared visual space , 2004, CSCW.

[35]  Sultan A. Alharthi,et al.  The Maze: Enabling Collaborative Planning in Games Through Annotation Interfaces , 2017, CHI PLAY.

[36]  Martin R. Gibbs,et al.  Voice in Virtual Worlds: The Design, Use, and Influence of Voice Chat in Online Play , 2015, Hum. Comput. Interact..

[37]  Andruid Kerne,et al.  Implicit coordination in firefighting practice: design implications for teaching fire emergency responders , 2007, CHI.

[38]  Lennart E. Nacke,et al.  Investigating the Impact of Cooperative Communication Mechanics on Player Performance in Portal 2 , 2016, Graphics Interface.

[39]  Sara A. Bly,et al.  Managing a trois: a study of a multi-user drawing tool in distributed design work , 1991, CHI.

[40]  Carl Gutwin,et al.  Now You Can Compete With Anyone: Balancing Players of Different Skill Levels in a First-Person Shooter Game , 2015, CHI.

[41]  Chris Baber,et al.  Supporting Implicit Coordination Between Distributed Teams in Disaster Management , 2007, Mobile Response.

[42]  D. Kort,et al.  The Game Experience Questionnaire , 2013 .

[43]  Scott Bateman,et al.  Why Players use Pings and Annotations in Dota 2 , 2017, CHI.

[44]  Philip Henning,et al.  Mental Models: Knowledge in the Head and Knowledge in the World , 1996, ICLS.

[45]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[46]  Susan R. Fussell,et al.  Where do helpers look?: gaze targets during collaborative physical tasks , 2003, CHI Extended Abstracts.

[47]  Scott Bateman,et al.  Stabilized Annotations for Mobile Remote Assistance , 2016, CHI.

[48]  Carl Gutwin,et al.  Workspace Awareness in Real-Time Distributed Groupware: Framework, Widgets, and Evaluation , 1996, BCS HCI.

[49]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[50]  Martha Larson,et al.  VideoJot: A Multifunctional Video Annotation Tool , 2014, ICMR.

[51]  Christian Heath,et al.  Technology in Action: Team work: collaboration and control in London Underground line control rooms , 2000 .

[52]  K. Weick.  FROM SENSEMAKING IN ORGANIZATIONS , 2021, The New Economic Sociology.

[53]  Sultan A. Alharthi,et al.  Playing at Planning: Game Design Patterns from Disaster Response Practice , 2016, CHI PLAY.

[54]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).