How Players Speak to an Intelligent Game Character Using Natural Language Messages

AI-driven characters that learn directly from human input are rare in digital games, but recent advances in several fields of machine learning suggests that they may soon be much more feasible to create. This study explores the design space for interacting with such a character through natural language text dialogue. We conducted an observational study with 18 high school students, who played Minecraft alongside a Wizard of Oz prototype of a companion AI character that learned from their actions and inputs. In this paper, we report on an analysis of the 186 natural language messages that players sent to the character, and review key variations in syntax, function and writing style. We find that players’ behaviour and language was differentiated by the extent to which they expressed an anthropomorphic view of the AI character and the level of interest that they showed in interacting with it.

[1]  Bradley C. Love,et al.  How Humans Teach Agents - A New Experimental Perspective , 2012, Int. J. Soc. Robotics.

[2]  Katja Hofmann,et al.  The Malmo Platform for Artificial Intelligence Experimentation , 2016, IJCAI.

[3]  Peter Bayliss,et al.  Notes Toward a Sense of Embodied Gameplay , 2007, DiGRA Conference.

[4]  J. F. Kelley,et al.  An empirical methodology for writing user-friendly natural language computer applications , 1983, CHI '83.

[5]  Pieter Spronck,et al.  Player behavioural modelling for video games , 2012, Entertain. Comput..

[6]  Jeff A. Bilmes,et al.  Simultaneous Learning and Covering with Adversarial Noise , 2011, ICML.

[7]  Ana Paiva,et al.  Empathy in Virtual Agents and Robots , 2017, ACM Trans. Interact. Intell. Syst..

[8]  Ben Shneiderman,et al.  The future of interactive systems and the emergence of direct manipulation , 1982 .

[9]  Kelly Caine,et al.  Local Standards for Sample Size at CHI , 2016, CHI.

[10]  Julian Togelius,et al.  Artificial Intelligence and Games , 2018, Springer International Publishing.

[11]  Kerstin Fischer,et al.  Effects of Different Kinds of Robot Feedback , 2013, ICSR.

[12]  Yoav Goldberg,et al.  A Primer on Neural Network Models for Natural Language Processing , 2015, J. Artif. Intell. Res..

[13]  Maya Cakmak,et al.  Designing Interactions for Robot Active Learners , 2010, IEEE Transactions on Autonomous Mental Development.

[14]  E. Schegloff,et al.  The preference for self-correction in the organization of repair in conversation , 1977 .

[15]  Nicole Shechtman,et al.  Media inequality in conversation: how people behave differently when interacting with computers and people , 2003, CHI '03.

[16]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[17]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[18]  Wojciech Jaskowski,et al.  ViZDoom: A Doom-based AI research platform for visual reinforcement learning , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[19]  Saul Greenberg,et al.  Prototyping an intelligent agent through Wizard of Oz , 1993, INTERCHI.

[20]  Hung-Hsuan Huang,et al.  Embodied Conversational Agents , 2009 .

[21]  Julian Togelius,et al.  A Panorama of Artificial and Computational Intelligence in Games , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[22]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[23]  Wolfgang Minker,et al.  Are computers still social actors? , 2013, CHI Extended Abstracts.

[24]  Michael Mateas,et al.  Playing with words: from intuition to evaluation of game dialogue interfaces , 2010, FDG.

[25]  Clayton T. Morrison,et al.  Towards understanding how humans teach robots , 2011, UMAP'11.

[26]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..

[27]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[28]  Petra Wagner,et al.  Welcome to the Future - How Naïve Users Intuitively Address an Intelligent Robotics Apartment , 2016, ICSR.

[29]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[30]  Julian Togelius,et al.  The turing test track of the 2012 Mario AI Championship: Entries and evaluation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[31]  Maya Cakmak,et al.  Power to the People: The Role of Humans in Interactive Machine Learning , 2014, AI Mag..

[32]  Robin R. Murphy,et al.  Human-Robot Interaction , 2012 .

[33]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[34]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[35]  Andrew Stern,et al.  Structuring Content in the Façade Interactive Drama Architecture , 2005, AIIDE.

[36]  Cynthia Breazeal,et al.  Training a Robot via Human Feedback: A Case Study , 2013, ICSR.

[37]  Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen,et al.  Real-Time Evolution in the NERO Video Game (Winner of CIG 2005 Best Paper Award) , 2005, CIG.

[38]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[39]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[40]  Li Gong,et al.  How social is social responses to computers? The function of the degree of anthropomorphism in computer representations , 2008, Comput. Hum. Behav..

[41]  Kyung-Joong Kim,et al.  StarCraft AI Competition Report , 2016, AI Mag..

[42]  Alex Lascarides,et al.  Indirect Speech Acts , 2001, Synthese.

[43]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[44]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.

[45]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[46]  Marc G. Bellemare,et al.  The Arcade Learning Environment: An Evaluation Platform for General Agents , 2012, J. Artif. Intell. Res..

[47]  Wes Sharrock,et al.  On simulacrums of conversation: toward a clarification of the relevance of conversation analysis for human-computer interaction , 1995 .

[48]  Hector Muñoz-Avila,et al.  Learning and Game AI , 2013, Artificial and Computational Intelligence in Games.

[49]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[50]  Leila Takayama,et al.  Communication and knowledge sharing in human-robot interaction and learning from demonstration , 2010, Neural Networks.