AI-Assisted Game Debugging with Cicero

We present Cicero, a mixed-initiative application for prototyping two-dimensional sprite-based games across different genres such as shooters, puzzles, and action games. Cicero provides a host of features which can offer assistance in different stages of the game development process. Noteworthy features include AI agents for gameplay simulation, a game mechanics recommender system, a playtrace aggregator, heatmap-based game analysis, a sequential replay mechanism, and a query system that allows searching for particular interaction patterns. In order to evaluate the efficacy and usefulness of the different features of Cicero, we conducted a user study in which we compared how users perform in game debugging tasks with different kinds of assistance.

[1]  Michael Mateas,et al.  Tanagra: a mixed-initiative level design tool , 2010, FDG.

[2]  John Seely Brown,et al.  A Model-Driven Question-Answering System for Mixed-Initiative Computer-Assisted Construction , 1973, IEEE Trans. Syst. Man Cybern..

[3]  Mark J. Nelson.  Game Metrics Without Players: Strategies for Understanding Game Artifacts , 2011, Artificial Intelligence in the Game Design Process.

[4]  Julian Togelius,et al.  SeekWhence a retrospective analysis tool for general game design , 2017, FDG.

[5]  Michael Mateas,et al.  A requirements analysis for videogame design support tools , 2009, FDG.

[6]  Keith Cheverst,et al.  3D Space-Time Visualization of Player Behaviour in Pervasive Location-Based Games , 2008, Int. J. Comput. Games Technol..

[7]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[8]  Zoran Popovic,et al.  A mixed-initiative tool for designing level progressions in games , 2013, UIST.

[9]  Julian Togelius,et al.  Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition , 2022 .

[10]  Zoran Popovic,et al.  A case study of expressively constrainable level design automation tools for a puzzle game , 2012, FDG.

[11]  Michael Mateas,et al.  Prototyping Games with BIPED , 2009, AIIDE.

[12]  Curry Guinn,et al.  Mixed-initiative interaction , 1999 .

[13]  A. Srisuphab,et al.  An application for the game of Go: Automatic live Go recording and searchable Go database , 2012, TENCON 2012 IEEE Region 10 Conference.

[14]  Julian Togelius,et al.  Artificial and Computational Intelligence in Games (Dagstuhl Seminar 12191) , 2012, Dagstuhl Reports.

[15]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[16]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[17]  Simone Kriglstein,et al.  Visualizations for Retrospective Analysis of Battles in Team-based Combat Games: A User Study , 2016, CHI PLAY.

[18]  Julian Togelius,et al.  Modifying MCTS for Human-Like General Video Game Playing , 2016, IJCAI.

[19]  Jonathan Blow,et al.  Game Development: Harder Than You Think , 2004, ACM Queue.

[20]  Johannes Gehrke,et al.  Declarative processing for computer games , 2008, Sandbox '08.

[21]  Zoran Popovic,et al.  Feature-based projections for effective playtrace analysis , 2011, FDG.

[22]  Ben Medler,et al.  Generations of Game Analytics, Achievements and High Scores , 2009, Eludamos: Journal for Computer Game Culture.

[23]  Frederick P. Brooks,et al.  "No silver bullet" reloaded: retrospective on "essence and accidents of software engineering" , 2007, OOPSLA '07.

[24]  Sylvain Hallé,et al.  Automated Bug Finding in Video Games: A Case Study for Runtime Monitoring , 2014, 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation.

[25]  Günter Wallner,et al.  Game user telemetry in practice: a case study , 2014, Advances in Computer Entertainment.

[26]  Simon M. Lucas,et al.  Open Loop Search for General Video Game Playing , 2015, GECCO.

[27]  Daniel Deutch,et al.  Declarative platform for data sourcing games , 2012, WWW.

[28]  Julian Togelius,et al.  Ropossum: An Authoring Tool for Designing, Optimizing and Solving Cut the Rope Levels , 2013, AIIDE.

[29]  Julian Togelius,et al.  Towards a Video Game Description Language , 2013, Artificial and Computational Intelligence in Games.

[30]  Niklas Elmqvist,et al.  Toward Visualization for Games: Theory, Design Space, and Patterns , 2012, IEEE Transactions on Visualization and Computer Graphics.

[31]  Tom Schaul,et al.  A video game description language for model-based or interactive learning , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[32]  Antonios Liapis,et al.  Mixed-initiative co-creativity , 2014, FDG.

[33]  Julian Togelius,et al.  Matching Games and Algorithms for General Video Game Playing , 2021, AIIDE.

[34]  Truong-Huy D. Nguyen,et al.  G-Player: Exploratory Visual Analytics for Accessible Knowledge Discovery , 2016, DiGRA/FDG.

[35]  Julian Togelius,et al.  Exploring Game Space of Minimal Action Games via Parameter Tuning and Survival Analysis , 2018, IEEE Transactions on Games.

[36]  Michael Mateas,et al.  Modular Computational Critics for Games , 2013, AIIDE.

[37]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.