Impressions of the GDMC AI Settlement Generation Challenge in Minecraft

The GDMC AI settlement generation challenge is a PCG competition about producing an algorithm that can create an “interesting” Minecraft settlement for a given map. This paper contains a collection of written experiences with this competition, by participants, judges, organizers and advisors. We asked people to reflect both on the artifacts themselves, and on the competition in general. The aim of this paper is to offer a shareable and edited collection of experiences and qualitative feedback which seem to contain a lot of insights on PCG and computational creativity, but would otherwise be lost once the output of the competition is reduced to scalar performance values. We reflect upon some organizational issues for AI competitions, and discuss the future of the GDMC competition. ∗Corresponding author, christophsalge@gmail.com. All other authors in alphabetical order. Authors are those who provided an experience text, or organizers of the GDMC competition who contributed to editing this article. 1 ar X iv :2 10 8. 02 95 5v 1 [ cs .O H ] 6 A ug 2 02 1

[1]  Kenneth O. Stanley.  Why Open-Endedness Matters , 2019, Artificial Life.

[2]  Antonios Liapis,et al.  Mixed-initiative content creation , 2016 .

[3]  Julian Togelius,et al.  Generative design in minecraft (GDMC): settlement generation competition , 2018, FDG.

[4]  Katja Hofmann,et al.  The MineRL Competition on Sample Efficient Reinforcement Learning using Human Priors , 2019, ArXiv.

[5]  Pablo Gervás,et al.  Computational Approaches to Storytelling and Creativity , 2009, AI Mag..

[6]  Rasmus Berg Palm,et al.  EvoCraft: A New Challenge for Open-Endedness , 2020, EvoApplications.

[7]  Julian Togelius,et al.  The AI Settlement Generation Challenge in Minecraft , 2020, KI - Künstliche Intelligenz.

[8]  Julian Togelius,et al.  Towards Game-based Metrics for Computational Co-Creativity , 2018, 2018 IEEE Conference on Computational Intelligence and Games (CIG).

[9]  C. Goodhart.  Problems of Monetary Management: The UK Experience , 1984 .

[10]  Julian Togelius,et al.  Leveling the Playing Field - Fairness in AI Versus Human Game Benchmarks , 2019, ArXiv.

[11]  Julian Togelius,et al.  Computational Game Creativity , 2014, ICCC.

[12]  Rafael Bidarra,et al.  Declarative procedural generation of architecture with semantic architectural profiles , 2020, 2020 IEEE Conference on Games (CoG).

[13]  Simon Colton.  Seven Catchy Phrases for Computational Creativity Research , 2009, Computational Creativity: An Interdisciplinary Approach.

[14]  Julian Togelius,et al.  Organic building generation in minecraft , 2019, FDG.

[15]  Philip Hingston,et al.  A Turing Test for Computer Game Bots , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[16]  Julian Togelius,et al.  General Video Game Level Generation , 2016, GECCO.

[17]  Simon Colton,et al.  Computational Creativity: The Final Frontier? , 2012, ECAI.

[18]  Risto Miikkulainen,et al.  Believable Bot Navigation via Playback of Human Traces , 2012, Believable Bots.

[19]  Julian Togelius,et al.  The 2017 AIBIRDS Level Generation Competition , 2019, IEEE Transactions on Games.

[20]  Julian Togelius,et al.  Generative Design in Minecraft: Chronicle Challenge , 2019, ICCC.

[21]  Tanya X. Short,et al.  Procedural Generation in Game Design , 2017 .

[22]  Julian Togelius,et al.  How to Run a Successful Game-Based AI Competition , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[23]  Michael Mateas,et al.  Mechanizing Exploratory Game Design , 2012 .

[24]  Julian Togelius,et al.  General video game rule generation , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[25]  M. Strathern.  ‘Improving ratings’: audit in the British University system , 1997, European Review.