Evaluation of a Recommender System for Assisting Novice Game Designers

Game development is a complex task involving multiple disciplines and technologies. Developers and researchers alike have suggested that AI-driven game design assistants may improve developer workflow. We present a recommender system for assisting humans in game design as well as a rigorous human subjects study to validate it. The AI-driven game design assistance system suggests game mechanics to designers based on characteristics of the game being developed. We believe this method can bring creative insights and increase users' productivity. We conducted quantitative studies that showed the recommender system increases users' levels of accuracy and computational affect, and decreases their levels of workload.

[1]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[2]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[3]  Steven Fraser,et al.  No Silver Bullet: Software Engineering Reloaded , 2008, IEEE Software.

[4]  Cathy O'Neil,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2016, Vikalpa: The Journal for Decision Makers.

[5]  Julian Togelius,et al.  Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition , 2022 .

[6]  Alberto Alvarez,et al.  Fostering creativity in the mixed-initiative evolutionary dungeon designer , 2018, FDG.

[7]  Richard D. Johnson,et al.  The Multilevel and Multifaceted Character of Computer Self-Efficacy: Toward Clarification of the Construct and an Integrative Framework for Research , 1998, Inf. Syst. Res..

[8]  Tony Doyle,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Inf. Soc..

[9]  Jonathan Blow,et al.  Game Development: Harder Than You Think , 2004, ACM Queue.

[10]  Michael Mateas,et al.  Tanagra: a mixed-initiative level design tool , 2010, FDG.

[11]  J. Henry,et al.  The positive and negative affect schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. , 2004, The British journal of clinical psychology.

[12]  Marcelo Soares Pimenta,et al.  What went wrong? A survey of problems in game development , 2009, CIE.

[13]  Julian Togelius,et al.  AI-Assisted Game Debugging with Cicero , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[14]  Vishwa Shah,et al.  Friend, Collaborator, Student, Manager: How Design of an AI-Driven Game Level Editor Affects Creators , 2019, CHI.

[15]  Emerson R. Murphy-Hill,et al.  Cowboys, ankle sprains, and keepers of quality: how is video game development different from software development? , 2014, ICSE.

[16]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[17]  Julian Togelius,et al.  Towards a Video Game Description Language , 2013, Artificial and Computational Intelligence in Games.

[18]  Julian Togelius,et al.  Ropossum: An Authoring Tool for Designing, Optimizing and Solving Cut the Rope Levels , 2013, AIIDE.

[19]  Kari Smolander,et al.  What do game developers expect from development and design tools? , 2013, EASE '13.

[20]  Taeyoung Lee,et al.  Us vs. Them: Understanding Artificial Intelligence Technophobia over the Google DeepMind Challenge Match , 2017, CHI.

[21]  Julian Togelius,et al.  Adapting Models of Visual Aesthetics for Personalized Content Creation , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[22]  Julian Togelius,et al.  Pitako - Recommending Game Design Elements in Cicero , 2019, 2019 IEEE Conference on Games (CoG).

[23]  Christian Bird,et al.  "What Went Right and What Went Wrong": An Analysis of 155 Postmortems from Game Development , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C).

[24]  Rajeev Motwani,et al.  Dynamic itemset counting and implication rules for market basket data , 1997, SIGMOD '97.

[25]  Xin Li,et al.  Application of an improved Apriori algorithm in a mobile e-commerce recommendation system , 2017, Ind. Manag. Data Syst..

[26]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[27]  Tom Schaul,et al.  A video game description language for model-based or interactive learning , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).