Artificial Intelligence and Games

This is the first textbook dedicated to explaining how artificial intelligence (AI) techniques can be used in and for games. After introductory chapters that explain the background and key techniques in AI and games, the authors explain how to use AI to play games, to generate content for games and to model players. The book will be suitable for undergraduate and graduate courses in games, artificial intelligence, design, human-computer interaction, and computational intelligence, and also for self-study by industrial game developers and practitioners. The authors have developed a website (http://www.gameaibook.org) that complements the material covered in the book with up-to-date exercises, lecture slides and reading.

[1]  Michael Buro,et al.  Portfolio greedy search and simulation for large-scale combat in starcraft , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[2]  Simon M. Lucas,et al.  Ms Pac-Man versus Ghost Team CEC 2011 competition , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[3]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[4]  Daniel Kahneman,et al.  Living, and thinking about it: two perspectives on life , 2005 .

[5]  Norman I. Badler,et al.  Planning approaches to constraint‐aware navigation in dynamic environments , 2015, Comput. Animat. Virtual Worlds.

[6]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[7]  Julian Togelius,et al.  Script- and cluster-based UCT for StarCraft , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[8]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[9]  Georgios N. Yannakakis,et al.  Player Modeling Impact on Player's Entertainment in Computer Games , 2005, User Modeling.

[10]  Georgios N. Yannakakis,et al.  Correlation between heart rate, electrodermal activity and player experience in first-person shooter games , 2010, Sandbox '10.

[11]  Richard L. Hazlett,et al.  Measuring emotional valence during interactive experiences: boys at video game play , 2006, CHI.

[12]  Jon D. Morris.  Observations: SAM: The Self-Assessment Manikin An Efficient Cross-Cultural Measurement Of Emotional Response 1 , 1995 .

[13]  Darryl Charles,et al.  Dynamic Player Modelling: A Framework for Player-Centered Digital Games , 2004 .

[14]  Rémi Coulom,et al.  Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search , 2006, Computers and Games.

[15]  Antonios Liapis,et al.  Learning the patterns of balance in a multi-player shooter game , 2017, FDG.

[16]  Steven Rabin,et al.  Game AI Pro 2: Collected Wisdom of Game AI Professionals , 2013 .

[17]  Tom Schaul,et al.  A video game description language for model-based or interactive learning , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[18]  Souhila Kaci,et al.  Working with Preferences: Less Is More , 2011, Cognitive Technologies.

[19]  John Yen,et al.  FLAME—Fuzzy Logic Adaptive Model of Emotions , 2000, Autonomous Agents and Multi-Agent Systems.

[20]  Romain Laroche,et al.  Hybrid Reward Architecture for Reinforcement Learning , 2017, NIPS.

[21]  Michael Mateas,et al.  A data mining approach to strategy prediction , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[22]  J. Togelius,et al.  Discovering Unique Game Variants , 2015 .

[23]  Julian Togelius,et al.  Computational intelligence and tower defence games , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[24]  D. Boyd,et al.  Six Provocations for Big Data , 2011 .

[25]  D. Kahneman.  A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[26]  Santiago Ontañón,et al.  The VGLC: The Video Game Level Corpus , 2016, ArXiv.

[27]  Z. Michalewicz.  Do Not Kill Unfeasible Individuals , 1995 .

[28]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[29]  Nicolas Szilas,et al.  IDtension: a narrative engine for Interactive Drama , 2003 .

[30]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[31]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[32]  Simon M. Lucas,et al.  Evolving a Neural Network Location Evaluator to Play Ms. Pac-Man , 2005, CIG.

[33]  Julian Togelius,et al.  Towards Automatic Personalized Content Generation for Platform Games , 2010, AIIDE.

[34]  Nicolas Usunier,et al.  Episodic Exploration for Deep Deterministic Policies: An Application to StarCraft Micromanagement Tasks , 2016, ArXiv.

[35]  Blai Bonet,et al.  Planning as heuristic search , 2001, Artif. Intell..

[36]  Apurv Jain.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2017, Business Economics.

[37]  Antonios Liapis,et al.  Mixed-initiative co-creativity , 2014, FDG.

[38]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[39]  Risto Miikkulainen,et al.  Evolving a Roving Eye for Go , 2004, GECCO.

[40]  Andrew Nealen,et al.  Exploring Game Space Using Survival Analysis , 2015, FDG.

[41]  M. Boden.  WHAT IS CREATIVITY , 2005 .

[42]  Alexander Osherenko.  Opinion mining and lexical affect sensing: Computer-aided analysis of opinions and emotions in texts , 2011 .

[43]  Georgios N. Yannakakis,et al.  Mining multimodal sequential patterns: a case study on affect detection , 2011, ICMI '11.

[44]  Mark Collins,et al.  AI Techniques for Game Programming , 2002 .

[45]  Nathan R. Sturtevant,et al.  Real-Time Heuristic Search for Pathfinding in Video Games , 2011 .

[46]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[47]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[48]  Simon Colton,et al.  Multi-faceted evolution of simple arcade games , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[49]  H. Fritzsch,et al.  The Constants of Nature , 1986 .

[50]  Jeff Orkin,et al.  Applying Goal-Oriented Action Planning to Games , 2008 .

[51]  Georgios N. Yannakakis.  AI in computer games : generating interesting interactive opponents by the use of evolutionary computation , 2005 .

[52]  Simon M. Lucas,et al.  Learning Finite-State Transducers: Evolution Versus Heuristic State Merging , 2007, IEEE Transactions on Evolutionary Computation.

[53]  Rafael Bidarra,et al.  A Semantic Foundation for Mixed-Initiative Computational Storytelling , 2015, ICIDS.

[54]  N. Lazzaro.  Why we Play Games: Four Keys to More Emotion without Story , 2004 .

[55]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[56]  Emmanuel Dellandréa,et al.  A Large Video Database for Computational Models of Induced Emotion , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[57]  Adi Botea,et al.  Near Optimal Hierarchical Path-Finding , 2004, J. Game Dev..

[58]  Julian Togelius,et al.  Generating diverse opponents with multiobjective evolution , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[59]  Michael Mateas,et al.  LUDOCORE: A logical game engine for modeling videogames , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[60]  Antonios Liapis,et al.  RankTrace: Relative and unbounded affect annotation , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[61]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[62]  Julian Togelius,et al.  AI-based playtesting of contemporary board games , 2017, FDG.

[63]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[64]  James C. Lester,et al.  Affect and Engagement in Game-BasedLearning Environments , 2014, IEEE Transactions on Affective Computing.

[65]  Erik D. Demaine,et al.  Super Mario Bros. is Harder/Easier Than We Thought , 2016, FUN.

[66]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[67]  M. Dufwenberg.  Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[68]  S.M. Lucas,et al.  Evolutionary computation and games , 2006, IEEE Computational Intelligence Magazine.

[69]  Simon Colton,et al.  Creativity Versus the Perception of Creativity in Computational Systems , 2008, AAAI Spring Symposium: Creative Intelligent Systems.

[70]  Julian Togelius,et al.  Assessing Believability , 2012, Believable Bots.

[71]  Julian Togelius,et al.  Neuroevolution in Games: State of the Art and Open Challenges , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[72]  Katja Hofmann,et al.  The Malmo Platform for Artificial Intelligence Experimentation , 2016, IJCAI.

[73]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[74]  Antonios Liapis,et al.  Boosting computational creativity with human interaction in mixed-initiative co-creation tasks , 2016 .

[75]  Julian Togelius,et al.  AI Researchers, Video Games are your Friends! , 2015, IJCCI.

[76]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[77]  Ana Paiva,et al.  FAtiMA Modular: Towards an Agent Architecture with a Generic Appraisal Framework , 2014, Emotion Modeling.

[78]  Jennifer Healey,et al.  Recording Affect in the Field: Towards Methods and Metrics for Improving Ground Truth Labels , 2011, ACII.

[79]  John E. Laird,et al.  Human-Level AI's Killer Application: Interactive Computer Games , 2000, AI Mag..

[80]  Keshav P. Dahal,et al.  Symbolic Reasoning for Hearthstone , 2018, IEEE Transactions on Games.

[81]  George Skaff Elias,et al.  Characteristics of Games , 2012 .

[82]  Simon Colton,et al.  Evolving pixel shaders for the prototype video game Subversion , 2010 .

[83]  Hector Geffner,et al.  Width-based Algorithms for Classical Planning: New Results , 2014, ECAI.

[84]  David B. Fogel,et al.  The Blondie25 Chess Program Competes Against Fritz 8.0 and a Human Chess Master , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[85]  Kallirroi Georgila,et al.  Learning user simulations for information state update dialogue systems , 2005, INTERSPEECH.

[86]  David Thue,et al.  Interactive Storytelling: A Player Modelling Approach , 2007, AIIDE.

[87]  Omar AlZoubi,et al.  Classification of EEG for Affect Recognition: An Adaptive Approach , 2009, Australasian Conference on Artificial Intelligence.

[88]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[89]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[90]  Xiang 'Anthony' Chen,et al.  Duet: exploring joint interactions on a smart phone and a smart watch , 2014, CHI.

[91]  Alfred Ultsch,et al.  Data Mining and Knowledge Discovery with Emergent Self-Organizing Feature Maps for Multivariate Time Series , 1999 .

[92]  Glen Robertson,et al.  An Improved Dataset and Extraction Process for Starcraft AI , 2014, FLAIRS Conference.

[93]  R. Dhar,et al.  The Effect of Forced Choice on Choice , 2003 .

[94]  Roddy Cowie,et al.  Real life emotions in French and English TV video clips: an integrated annotation protocol combining continuous and discrete approaches , 2006, LREC.

[95]  Kenneth O. Stanley,et al.  Automatic Content Generation in the Galactic Arms Race Video Game , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[96]  Alex S. Fukunaga,et al.  Learning to Prune Dominated Action Sequences in Online Black-Box Planning , 2016, AAAI.

[97]  Mark H. M. Winands,et al.  Real-Time Monte Carlo Tree Search in Ms Pac-Man , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[98]  Athanasia Zlatintsi,et al.  A supervised approach to movie emotion tracking , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[99]  L. Feldman.  Valence Focus and Arousal Focus: Individual Differences in the Structure of Affective Experience , 1995 .

[100]  Athanasios V. Vasilakos,et al.  Dynamic Intelligent Lighting for Directing Visual Attention in Interactive 3-D Scenes , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[101]  Sebastian Risi,et al.  Continual online evolutionary planning for in-game build order adaptation in StarCraft , 2017, GECCO.

[102]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[103]  D. Fox Harrell,et al.  Revealing Social Identity Phenomena in Videogames with Archetypal Analysis , 2015 .

[104]  Anders Drachen,et al.  Spatial Game Analytics , 2013, Game Analytics, Maximizing the Value of Player Data.

[105]  Nathan Ensmenger,et al.  Is chess the drosophila of artificial intelligence? A social history of an algorithm , 2012, Social studies of science.

[106]  Katherine Isbister,et al.  Game Usability: Advancing the Player Experience , 2008 .

[107]  Marc Cavazza,et al.  Character-Based Interactive Storytelling , 2002, IEEE Intell. Syst..

[108]  Julian Togelius,et al.  Generative agents for player decision modeling in games , 2014, FDG.

[109]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[110]  Ruck Thawonmas,et al.  Deduction of fighting-game countermeasures using the k-nearest neighbor algorithm and a game simulator , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[111]  John McCarthy.  Partial Formalizations And The Lemmings Game , 1998 .

[112]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[113]  Andrea Kleinsmith,et al.  Affective Body Expression Perception and Recognition: A Survey , 2013, IEEE Transactions on Affective Computing.

[114]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[115]  W. IJsselsteijn,et al.  Exploring Behavioral Expressions of Player Experience in Digital Games , 2008 .

[116]  Jichen Zhu,et al.  Towards story-based content generation: From plot-points to maps , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[117]  Bruce Bueno de Mesquita,et al.  An Introduction to Game Theory , 2014 .

[118]  Barney Pell,et al.  Strategy Generation and Evaluation for Meta-Game Playing , 2011, KI - Künstliche Intelligenz.

[119]  Miroslaw Truszczynski,et al.  Answer set programming at a glance , 2011, Commun. ACM.

[120]  Georgios N. Yannakakis,et al.  Real-time challenge balance in an RTS game using rtNEAT , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[121]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[122]  Aki Järvinen,et al.  Gran Stylissimo: The Audiovisual Elements and Styles in Computer and Video Games , 2002, CGDC Conf..

[123]  Ruck Thawonmas,et al.  Detection of MMORPG bots based on behavior analysis , 2008, ACE '08.

[124]  Alexander Nareyek,et al.  Game AI is Dead. Long Live Game AI! , 2007, IEEE Intelligent Systems.

[125]  Aung Sithu Kyaw,et al.  Unity AI game programming : leverage the power of Unity 5 to create stunningly life-like AI entities in your games! , 2015 .

[126]  Alex J. Champandard.  AI Game Development: Synthetic Creatures with Learning and Reactive Behaviors , 2003 .

[127]  Mark O. Riedl,et al.  Crowdsourcing Narrative Intelligence , 2012 .

[128]  Julian Togelius,et al.  Investigating MCTS modifications in general video game playing , 2015, 2015 IEEE Conference on Computational Intelligence and Games (CIG).

[129]  Julian Togelius,et al.  Audioverdrive: Exploring Bidirectional Communication between Music and gameplay , 2013, ICMC.

[130]  Georgios N. Yannakakis,et al.  Entertainment modeling through physiology in physical play , 2008, Int. J. Hum. Comput. Stud..

[131]  Gabriela Ochoa,et al.  On Genetic Algorithms and Lindenmayer Systems , 1998, PPSN.

[132]  Julian Togelius,et al.  Ethical Considerations for Player Modeling , 2017, AAAI Workshops.

[133]  Jeff Orkin,et al.  Three States and a Plan: The A.I. of F.E.A.R. , 2006 .

[134]  Adrien Treuille,et al.  Predicting protein structures with a multiplayer online game , 2010, Nature.

[135]  Marc G. Bellemare,et al.  The Arcade Learning Environment: An Evaluation Platform for General Agents , 2012, J. Artif. Intell. Res..

[136]  Kevin Lynch,et al.  The Image of the City , 1960 .

[137]  Jakub Kowalski,et al.  Text-based adventures of the golovin AI agent , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[138]  Peng Zhang,et al.  Qualitative Spatial Representation and Reasoning in Angry Birds: The Extended Rectangle Algebra , 2014, KR.

[139]  Jonathan P. ROWEa,et al.  C RYSTAL I SLAND : A Narrative-Centered Learning Environment for Eighth Grade Microbiology , 2009 .

[140]  Graham Kendall,et al.  A Survey of NP-Complete Puzzles , 2008, J. Int. Comput. Games Assoc..

[141]  Gita Reese Sukthankar,et al.  Learning Policies for First Person Shooter Games Using Inverse Reinforcement Learning , 2011, AIIDE.

[142]  Julian Togelius,et al.  Evolving controllers for simulated car racing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[143]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[144]  Antonios Liapis,et al.  Framing Tension for Game Generation , 2016, ICCC.

[145]  Julian Togelius,et al.  Modeling Player Experience for Content Creation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[146]  Sander Bakkes,et al.  Generating Missions and Spaces for Adaptable Play Experiences , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[147]  B. Skinner,et al.  The Behavior of Organisms: An Experimental Analysis , 2016 .

[148]  Julian Togelius,et al.  Evolving Interesting Maps for a First Person Shooter , 2011, EvoApplications.

[149]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[150]  Pierre Bessière,et al.  Multiscale Bayesian Modeling for RTS Games: An Application to StarCraft AI , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[151]  U. Fischbacher,et al.  Oxytocin increases trust in humans , 2005, Nature.

[152]  Julian Togelius,et al.  Neuroevolutionary constrained optimization for content creation , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[153]  Edith Cowan University,et al.  Bots Trained to Play Like a Human are More Fun , 2017 .

[154]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[155]  Arvind Narayanan,et al.  Semantics derived automatically from language corpora contain human-like biases , 2016, Science.

[156]  Rudolf Kadlec,et al.  Pogamut 3 Can Assist Developers in Building AI (Not Only) for Their Videogame Agents , 2009, AGS.

[157]  Julian Togelius,et al.  Procedural Generation of 3D Caves for Games on the GPU , 2015, FDG.

[158]  Roger B. Myerson,et al.  Game theory - Analysis of Conflict , 1991 .

[159]  Christoph Salge,et al.  Using genetically optimized artificial intelligence to improve gameplaying fun for strategical games , 2008, Sandbox '08.

[160]  Allan Mazur,et al.  Sex Difference in Testosterone Response to a Video Game Contest , 1997 .

[161]  S. Seshu,et al.  Introduction to the theory of finite-state machines , 1963 .

[162]  John H. Conway,et al.  The game of life. , 1996, The Hastings Center report.

[163]  Simon M. Lucas,et al.  Coevolution versus self-play temporal difference learning for acquiring position evaluation in small-board go , 2005, IEEE Transactions on Evolutionary Computation.

[164]  Kenneth O. Stanley,et al.  Functional Scaffolding for Composing Additional Musical Voices , 2014, Computer Music Journal.

[165]  Julian Togelius,et al.  Super mario evolution , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[166]  Marco Wiering,et al.  Connectionist reinforcement learning for intelligent unit micro management in StarCraft , 2011, The 2011 International Joint Conference on Neural Networks.

[167]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[168]  Nathan R. Sturtevant,et al.  Canonical Orderings on Grids , 2016, IJCAI.

[169]  Antonios Liapis,et al.  Towards general models of player affect , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[170]  Julian Togelius,et al.  Personas versus Clones for Player Decision Modeling , 2014, ICEC.

[171]  Juan Julián Merelo Guervós,et al.  Solving Master Mind Using GAs and Simulated Annealing: A Case of Dynamic Constraint Optimization , 1996, PPSN.

[172]  Joris Dormans,et al.  Adventures in level design: generating missions and spaces for action adventure games , 2010, PCGames@FDG.

[173]  Michael Mateas,et al.  Game-O-Matic: Generating Videogames that Represent Ideas , 2012, PCG@FDG.

[174]  Julian Togelius,et al.  Designer Modeling for Personalized Game Content Creation Tools , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[175]  H. Jaap van den Herik,et al.  Games as personality profiling tools , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[176]  David L. Roberts,et al.  Learning to Influence Emotional Responses for Interactive Storytelling , 2009, AAAI Spring Symposium: Intelligent Narrative Technologies II.

[177]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[178]  Michael D. Robinson,et al.  Belief and feeling: evidence for an accessibility model of emotional self-report. , 2002, Psychological bulletin.

[179]  Allan Fowler,et al.  Automated Generation of Conversational Non Player Characters , 2015, INT/SBG@AIIDE.

[180]  Alexandros Labrinidis,et al.  Challenges and Opportunities with Big Data , 2012, Proc. VLDB Endow..

[181]  P. Petta,et al.  Computational models of emotion , 2010 .

[182]  Daniele Gravina,et al.  Constrained surprise search for content generation , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[183]  Richard E. Korf,et al.  On Pruning Techniques for Multi-Player Games , 2000, AAAI/IAAI.

[184]  Graham Nelson,et al.  NATURAL LANGUAGE, SEMANTIC ANALYSIS AND INTERACTIVE FICTION , 2006 .

[185]  Christian Bauckhage,et al.  Learning Human-Like Movement Behavior for Computer Games , 2004 .

[186]  Gerald Tesauro,et al.  Temporal difference learning and TD-Gammon , 1995, CACM.

[187]  André Wilson Brotto Furtado,et al.  Online adaptation of computer games agents: A reinforcement learning approach , 2004 .

[188]  Bruce Blumberg.  New Challenges for Character-Based AI for Games , 2002 .

[189]  Ashish Kapoor,et al.  Automatic prediction of frustration , 2007, Int. J. Hum. Comput. Stud..

[190]  Steve Nebel,et al.  Mining Learning and Crafting Scientific Experiments: A Literature Review on the Use of Minecraft in Education and Research , 2016, J. Educ. Technol. Soc..

[191]  Juan Julián Merelo Guervós,et al.  Evolutionary deckbuilding in hearthstone , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[192]  Michele Pirovano,et al.  The use of Fuzzy Logic for Artificial Intelligence in Games , 2012 .

[193]  Nathan R. Sturtevant,et al.  The Grid-Based Path Planning Competition: 2014 Entries and Results , 2015, SOCS.

[194]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[195]  Philippe Pasquier,et al.  Towards a Generic Framework for Automated Video Game Level Creation , 2010, EvoApplications.

[196]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[197]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[198]  Alexander Zook,et al.  Game AGI beyond Characters , 2016 .

[199]  J. Olsen.  Realtime Procedural Terrain Generation , 2004 .

[200]  Michael Mateas,et al.  An interactive game-design assistant , 2008, IUI '08.

[201]  Santiago Ontañón,et al.  StarCraft Bots and Competitions , 2019, Encyclopedia of Computer Graphics and Games.

[202]  Risto Miikkulainen,et al.  Computational Intelligence in Games , 2006 .

[203]  Andrew Stern,et al.  A Behavior Language for Story-Based Believable Agents , 2002, IEEE Intell. Syst..

[204]  Albert Lindsey Zobrist,et al.  Feature extraction and representation for pattern recognition and the game of go , 1970 .

[205]  Jesper Juul,et al.  A Casual Revolution: Reinventing Video Games and Their Players , 2009 .

[206]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[207]  Michael Fink,et al.  Angry-HEX: An Artificial Player for Angry Birds Based on Declarative Knowledge Bases , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[208]  James C. Lester,et al.  Evaluating the consequences of affective feedback in intelligent tutoring systems , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[209]  Jeremy Ludwig,et al.  A Learning Infrastructure for Improving Agent Performance and Game Balance Jeremy Ludwig and Art Farley , 2007 .

[210]  Paolo Traverso,et al.  Automated planning - theory and practice , 2004 .

[211]  K. Scherer,et al.  Vocal expression of affect , 2005 .

[212]  Ruth Aylett,et al.  Unscripted narrative for affectively driven characters , 2005, IEEE Computer Graphics and Applications.

[213]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[214]  K. Ressler,et al.  Virtual reality exposure therapy using a virtual Iraq: case report. , 2008, Journal of traumatic stress.

[215]  Robert Michael Young,et al.  Cinematic Visual Discourse: Representation, Generation, and Evaluation , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[216]  Fotis Liarokapis,et al.  Assessing NeuroSky's Usability to Detect Attention Levels in an Assessment Exercise , 2009, HCI.

[217]  Farès Belhadj,et al.  Terrain modeling: a constrained fractal model , 2007, AFRIGRAPH '07.

[218]  Julian Togelius,et al.  Ropossum: An Authoring Tool for Designing, Optimizing and Solving Cut the Rope Levels , 2013, AIIDE.

[219]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[220]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[221]  H. Jaap van den Herik,et al.  Progressive Strategies for Monte-Carlo Tree Search , 2008 .

[222]  Jacek Ma,et al.  Self-Adaptation of Playing Strategies in General Game Playing , 2014 .

[223]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[224]  Yi-Hsuan Yang,et al.  Ranking-Based Emotion Recognition for Music Organization and Retrieval , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[225]  Andrea Kleinsmith,et al.  Form as a Cue in the Automatic Recognition of Non-acted Affective Body Expressions , 2011, ACII.

[226]  Das Amrita,et al.  Mining Association Rules between Sets of Items in Large Databases , 2013 .

[227]  Michael Wooldridge,et al.  Computational Aspects of Cooperative Game Theory , 2011, KES-AMSTA.

[228]  Neil Burch,et al.  Heads-up limit hold’em poker is solved , 2015, Science.

[229]  Antonios Liapis,et al.  AudioInSpace: Exploring the Creative Fusion of Generative Audio, Visuals and Gameplay , 2015, EvoMUSART.

[230]  D. Brooks,et al.  Evidence for striatal dopamine release during a video game , 1998, Nature.

[231]  Wijnand A. IJsselsteijn,et al.  Dynamic Game Balancing by Recognizing Affect , 2008, Fun and Games.

[232]  P. Costa,et al.  The five-factor theory of personality. , 2008 .

[233]  M. Miller,et al.  Measurement and Assessment in Teaching , 1994 .

[234]  Julian Togelius,et al.  Monte Mario: platforming with MCTS , 2014, GECCO.

[235]  Giovanna Martínez-Arellano,et al.  Creating AI Characters for Fighting Games Using Genetic Programming , 2017, IEEE Transactions on Computational Intelligence and AI in Games.

[236]  Kostas Karpouzis,et al.  Fusing Visual and Behavioral Cues for Modeling User Experience in Games , 2013, IEEE Transactions on Cybernetics.

[237]  Georgios N. Yannakakis,et al.  Generic Physiological Features as Predictors of Player Experience , 2011, ACII.

[238]  Adam M. Smith,et al.  An Inclusive Taxonomy of Player Modeling , 2011 .

[239]  Cristina Conati,et al.  Using Bayesian Networks to Manage Uncertainty in Student Modeling , 2002, User Modeling and User-Adapted Interaction.

[240]  Jonathan Schaeffer,et al.  Opponent Modeling in Poker , 1998, AAAI/IAAI.

[241]  Thore Graepel,et al.  LEARNING TO FIGHT , 2004 .

[242]  Heike Trautmann,et al.  Reactive strategy choice in StarCraft by means of Fuzzy Control , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[243]  Julian Togelius,et al.  Towards generating arcade game rules with VGDL , 2015, 2015 IEEE Conference on Computational Intelligence and Games (CIG).

[244]  Risto Miikkulainen,et al.  Evolving Stochastic Controller Networks for Intelligent Game Agents , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[245]  David S. Ebert,et al.  Texturing & modeling : a procedural approach : 日本語版 , 2009 .

[246]  Stefanie Tellex,et al.  Minecraft as an Experimental World for AI in Robotics , 2015, AAAI Fall Symposia.

[247]  Eckart Altenmüller,et al.  EMuJoy: Software for continuous measurement of perceived emotions in music , 2007, Behavior research methods.

[248]  Julian Togelius,et al.  General Video Game AI: Competition, Challenges and Opportunities , 2016, AAAI.

[249]  Janet Wiles,et al.  Scripting versus Emergence: Issues for Game Developers and Players in Game Environment Design , 2005 .

[250]  Stewart W. Wilson,et al.  Learning Classifier Systems, From Foundations to Applications , 2000 .

[251]  Julian Togelius,et al.  Ieee Transactions on Computational Intelligence and Ai in Games the 2014 General Video Game Playing Competition , 2022 .

[252]  Julian Togelius,et al.  Sentient World: Human-Based Procedural Cartography - An Experiment in Interactive Sketching and Iterative Refining , 2013, EvoMUSART.

[253]  Araceli Sanchis,et al.  Towards Imitation of Human Driving Style in Car Racing Games , 2012, Believable Bots.

[254]  Julian Togelius,et al.  Arms Races and Car Races , 2006, PPSN.

[255]  Roddy Cowie,et al.  Describing the emotional states that are expressed in speech , 2003, Speech Commun..

[256]  Georgios N. Yannakakis,et al.  Psychophysiology in Games , 2016 .

[257]  Erik Brynjolfsson,et al.  Big data: the management revolution. , 2012, Harvard business review.

[258]  G. Calleja.  In-Game: From Immersion to Incorporation , 2011 .

[259]  Christian Bauckhage,et al.  Learning Human-Like Opponent Behavior for Interactive Computer Games , 2003, DAGM-Symposium.

[260]  Cameron Browne,et al.  Automatic generation and evaluation of recombination games , 2008 .

[261]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[262]  Georgios N. Yannakakis,et al.  Village Voices: An adaptive game for conflict resolution , 2013, FDG.

[263]  Martin V. Butz,et al.  Optimized sensory-motor couplings plus strategy extensions for the TORCS car racing challenge , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[264]  Karen Collins,et al.  An Introduction to Procedural Music in Video Games , 2009 .

[265]  E. Rolls.  The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[266]  S. Barry Cooper,et al.  Digital Computers Applied to Games , 2013 .

[267]  Zoran Popovic,et al.  A case study of expressively constrainable level design automation tools for a puzzle game , 2012, FDG.

[268]  Araceli Sanchis,et al.  Towards gaze-controlled platform games , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[269]  N Yannakakis Georgios,et al.  Platformer level design for player believability , 2016 .

[270]  Gabriella A. B. Barros,et al.  Data Adventures , 2015 .

[271]  Antonios Liapis,et al.  Modelling Affect for Horror Soundscapes , 2019, IEEE Transactions on Affective Computing.

[272]  Kevin Dill,et al.  Game AI Appreciation, Revisited , 2015 .

[273]  詹志禹.  Response order effects in Likert-type scales , 1991 .

[274]  Rafael Bidarra,et al.  In Press: Ieee Transactions on Computational Intelligence and Ai in Games Adaptivity Challenges in Games and Simulations: a Survey , 2022 .

[275]  Paolo Burelli,et al.  Virtual cinematography in games: Investigating the impact on player experience , 2013, FDG.

[276]  Sander Bakkes,et al.  Procedural zelda: a PCG environment for player experience research , 2017, FDG.

[277]  Günter Rudolph,et al.  Driving as a human: a track learning based adaptable architecture for a car racing controller , 2014, Genetic Programming and Evolvable Machines.

[278]  Dave Mark,et al.  Behavioral Mathematics for Game AI , 2009 .

[279]  Tom Schaul,et al.  Natural Evolution Strategies , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[280]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[281]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[282]  Rémi Coulom,et al.  Computing "Elo Ratings" of Move Patterns in the Game of Go , 2007, J. Int. Comput. Games Assoc..

[283]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[284]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[285]  N. Taatgen,et al.  How to construct a believable opponent using cognitive modeling in the game of set , 2003 .

[286]  Philip Hingston,et al.  A new design for a Turing Test for Bots , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[287]  Mark O. Riedl,et al.  AI for game production , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[288]  Julian Togelius,et al.  Evolution of a subsumption architecture neurocontroller , 2004, J. Intell. Fuzzy Syst..

[289]  Georgios N. Yannakakis.  Game AI revisited , 2012, CF '12.

[290]  Joel Lehman,et al.  Petalz: Search-Based Procedural Content Generation for the Casual Gamer , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[291]  Georgios N. Yannakakis,et al.  Combining local and global optimisation for virtual camera control , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[292]  Mark O. Riedl,et al.  A Temporal Data-Driven Player Model for Dynamic Difficulty Adjustment , 2012, AIIDE.

[293]  Martin H. Levinson.  Creativity: Flow and the Psychology of Discovery and Invention , 1997 .

[294]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[295]  Nathan R. Sturtevant,et al.  Benchmarks for Grid-Based Pathfinding , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[296]  Christian Bauckhage,et al.  Imitation learning at all levels of game-AI , 2004 .

[297]  Mihai Polceanu,et al.  MirrorBot: Using human-inspired mirroring behavior to pass a turing test , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[298]  Jordan B. Pollack,et al.  Coevolution of a Backgammon Player , 1996 .

[299]  Georgios N. Yannakakis,et al.  Evaluating content generators , 2016 .

[300]  Gillian Smith,et al.  Analyzing the expressive range of a level generator , 2010, PCGames@FDG.

[301]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[302]  Michael Mateas,et al.  Tanagra: Reactive Planning and Constraint Solving for Mixed-Initiative Level Design , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[303]  David M. Bourg,et al.  AI for Game Developers , 2004 .

[304]  Michael Mateas,et al.  Variations Forever: Flexibly generating rulesets from a sculptable design space of mini-games , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[305]  Samuel M. McClure,et al.  Anchors, scales and the relative coding of value in the brain , 2008, Current Opinion in Neurobiology.

[306]  Georgios N. Yannakakis,et al.  A Generic Approach for Obtaining Higher Entertainment in Predator/Prey Computer Games , 2005 .

[307]  Jakub Kowalski,et al.  Evolving Chess-like Games Using Relative Algorithm Performance Profiles , 2016, EvoApplications.

[308]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[309]  Georgios N. Yannakakis,et al.  Space Maze: Experience-driven game camera control , 2013, FDG.

[310]  Georgios N. Yannakakis,et al.  Genetic search feature selection for affective modeling: a case study on reported preferences , 2010, AFFINE '10.

[311]  랄프 헤르브리치,et al.  Personalized behavior of computer controlled avatars in a virtual reality environment , 2004 .

[312]  Klaus R. Scherer,et al.  Vocal communication of emotion , 2000 .

[313]  Julian Togelius,et al.  The 2010 Mario AI Championship: Level Generation Track , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[314]  Hiroto Udagawa,et al.  Fighting Zombies in Minecraft With Deep Reinforcement Learning , 2016 .

[315]  Angeliki Metallinou,et al.  Annotation and processing of continuous emotional attributes: Challenges and opportunities , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[316]  J. Cohn,et al.  Infant Smiling Dynamics and Perceived Positive Emotion , 2008, Journal of nonverbal behavior.

[317]  Mark J. Nelson,et al.  ASP with Applications to Mazes and Levels , 2016 .

[318]  Michael Freed,et al.  Towards more human-like computer opponents , 2000 .

[319]  Michael Buro,et al.  Adversarial Planning Through Strategy Simulation , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[320]  David G. Novick,et al.  What is Mixed-Initiative Interaction? , 1997 .

[321]  Jürgen Schmidhuber,et al.  Optimal Artificial Curiosity, Creativity, Music, and the Fine Arts , 2005 .

[322]  Julian Togelius,et al.  Imitating human playing styles in Super Mario Bros , 2013, Entertain. Comput..

[323]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[324]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[325]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[326]  Hector Geffner,et al.  Classical Planning with Simulators: Results on the Atari Video Games , 2015, IJCAI.

[327]  Jeannie Novak,et al.  Game development essentials : game artificial intelligence , 2008 .

[328]  Sebastian Risi,et al.  Interactive Super Mario Bros Evolution , 2016, GECCO.

[329]  H. Jaap van den Herik,et al.  Rapid and Reliable Adaptation of Video Game AI , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[330]  Julian Togelius,et al.  The 2009 Mario AI Competition , 2010, IEEE Congress on Evolutionary Computation.

[331]  Richard Evans,et al.  Versu—A Simulationist Storytelling System , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[332]  Pieter Spronck,et al.  Opponent Modeling in Real-Time Strategy Games , 2007, GAMEON.

[333]  Ramakrishnan Srikant,et al.  Mining Sequential Patterns: Generalizations and Performance Improvements , 1996, EDBT.

[334]  Jaime G. Carbonell,et al.  Interactive drama, art and artificial intelligence , 2002 .

[335]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[336]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[337]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.

[338]  Elisabeth André,et al.  Comparing Feature Sets for Acted and Spontaneous Speech in View of Automatic Emotion Recognition , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[339]  Julian Togelius,et al.  Multiobjective exploration of the StarCraft map space , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[340]  G. Tesauro.  Practical Issues in Temporal Difference Learning , 1992 .

[341]  Magy Seif El-Nasr,et al.  Modeling Individual Differences through Frequent Pattern Mining on Role-Playing Game Actions , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[342]  Julian Togelius,et al.  Evolving Playable Content for Cut the Rope through a Simulation-Based Approach , 2013, AIIDE.

[343]  Koby Crammer,et al.  Pranking with Ranking , 2001, NIPS.

[344]  Xiaodong Li,et al.  A survey of procedural terrain generation techniques using evolutionary algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[345]  Julian Togelius,et al.  Experience-Driven Procedural Content Generation , 2011, IEEE Transactions on Affective Computing.

[346]  Simon Colton,et al.  Mixed-Initiative Approaches to On-Device Mobile Game Design , 2017, MICI@CHI.

[347]  Peter I. Cowling,et al.  Information Set Monte Carlo Tree Search , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[348]  Julian Togelius,et al.  AI-based Game Design Patterns , 2015, FDG.

[349]  Julian Togelius,et al.  Modelling and evaluation of complex scenarios with the Strategy Game Description Language , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[350]  Nathan R. Sturtevant,et al.  Pathfinding Architecture Optimizations , 2019, Game AI Pro 360.

[351]  Simon M. Lucas,et al.  Coevolving Game-Playing Agents: Measuring Performance and Intransitivities , 2013, IEEE Transactions on Evolutionary Computation.

[352]  Saeed Shiry Ghidary,et al.  Usage-based web recommendations: a reinforcement learning approach , 2007, RecSys '07.

[353]  Dennis J. N. J. Soemers,et al.  Tactical Planning Using MCTS in the Game of StarCraft , 2014 .

[354]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[355]  Glen Robertson,et al.  A Review of Real-Time Strategy Game AI , 2014, AI Mag..

[356]  Julian Togelius,et al.  Predicting player behavior in Tomb Raider: Underworld , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[357]  J. Stainer,et al.  The Emotions , 1922, Nature.

[358]  J. Neumann.  The General and Logical Theory of Au-tomata , 1963 .

[359]  Jordan B. Pollack,et al.  Co-Evolution in the Successful Learning of Backgammon Strategy , 1998, Machine Learning.

[360]  Glenn Reinman,et al.  Footstep navigation for dynamic crowds , 2011, Comput. Animat. Virtual Worlds.

[361]  Michael Thielscher,et al.  A General Game Description Language for Incomplete Information Games , 2010, AAAI.

[362]  Norman I. Badler,et al.  Parameterizing Behavior Trees , 2011, MIG.

[363]  Jacek Mandziuk,et al.  Computational Intelligence in Mind Games , 2007, Challenges for Computational Intelligence.

[364]  Georgios N. Yannakakis,et al.  Evolving opponents for interesting interactive computer games , 2004 .

[365]  Petra Sundström,et al.  Exploring the Affective Loop , 2005 .

[366]  Antonios Liapis.  Mixed-Initiative Creative Drawing with webIconoscope , 2017, EvoMUSART.

[367]  James C. Lester,et al.  Early Prediction of Student Frustration , 2007, ACII.

[368]  Mat Buckland,et al.  Programming Game AI by Example , 2004 .

[369]  Julian Togelius,et al.  Computational Game Creativity , 2014, ICCC.

[370]  Cynthia Breazeal,et al.  Crowdsourcing HRI through Online Multiplayer Games , 2010, AAAI Fall Symposium: Dialog with Robots.

[371]  Julian Togelius,et al.  Modifying MCTS for Human-Like General Video Game Playing , 2016, IJCAI.

[372]  William V. Wright,et al.  A Theory of Fun for Game Design , 2004 .

[373]  Nilanjan Sarkar,et al.  Maintaining Optimal Challenge in Computer Games through Real-Time Physiological Feedback , 2005 .

[374]  Julian Togelius,et al.  Detecting Predatory Behaviour in Game Chats , 2015 .

[375]  Julian Togelius,et al.  Adapting Models of Visual Aesthetics for Personalized Content Creation , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[376]  J. R. Quinlan.  Induction of decision trees , 2004, Machine Learning.

[377]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[378]  Jacek Mandziuk,et al.  Knowledge-Free and Learning-Based Methods in Intelligent Game Playing , 2010, Studies in Computational Intelligence.

[379]  Michael Mateas,et al.  Expressive AI: Games and Artificial Intelligence , 2003, DiGRA Conference.

[380]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[381]  Julian Togelius,et al.  An experiment in automatic game design , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[382]  Santiago Ontañón,et al.  RTS AI Problems and Techniques , 2019, Encyclopedia of Computer Graphics and Games.

[383]  M. Csíkszentmihályi.  Toward a Psychology of Optimal Experience , 2014 .

[384]  Georgios N. Yannakakis,et al.  Stress Detection for PTSD via the StartleMart Game , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[385]  Georgios N. Yannakakis,et al.  A Generic Approach for Generating Interesting Interactive Pac-Man Opponents , 2005, CIG.

[386]  Julian Togelius,et al.  Towards automatic personalised content creation for racing games , 2007, 2007 IEEE Symposium on Computational Intelligence and Games.

[387]  Nadia Magnenat-Thalmann,et al.  Generic personality and emotion simulation for conversational agents , 2004, Comput. Animat. Virtual Worlds.

[388]  Yoshua Bengio,et al.  Learning deep physiological models of affect , 2013, IEEE Computational Intelligence Magazine.

[389]  Simon Colton,et al.  Aesthetic Considerations for Automated Platformer Design , 2012, AIIDE.

[390]  Julian Togelius,et al.  General Video Game Evaluation Using Relative Algorithm Performance Profiles , 2015, EvoApplications.

[391]  Jonathan Gratch,et al.  Émile: Marshalling passions in training and education , 2000, AGENTS '00.

[392]  Shrikanth S. Narayanan,et al.  Detecting emotional state of a child in a conversational computer game , 2011, Comput. Speech Lang..

[393]  Julian Togelius,et al.  Hyper-heuristic general video game playing , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[394]  Cristina Conati,et al.  Intelligent Tutoring Systems: New Challenges and Directions , 2009, IJCAI.

[395]  Chris Martens.  Ceptre: A Language for Modeling Generative Interactive Systems , 2015, AIIDE.

[396]  H. Jaap van den Herik,et al.  Extraversion in Games , 2010, Computers and Games.

[397]  Joel Lehman,et al.  Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game , 2012, AIIDE.

[398]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[399]  Guo-Qiang Zhang,et al.  Mastermind is NP-Complete , 2005, ArXiv.

[400]  Arthur C. Graesser,et al.  AUTOMATIC DETECTION OF LEARNER'S AFFECT FROM GROSS BODY LANGUAGE , 2009, Appl. Artif. Intell..

[401]  Georgios N. Yannakakis,et al.  Extending neuro-evolutionary preference learning through player modeling , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[402]  Vadim Bulitko,et al.  Interactive Narrative: An Intelligent Systems Approach , 2012, AI Mag..

[403]  Julian Togelius,et al.  A Procedural Critique of Deontological Reasoning , 2011, DiGRA Conference.

[404]  Michael Buro,et al.  Real-Time Strategy Game Competitions , 2012, AI Mag..

[405]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[406]  Christian Bauckhage,et al.  Clustering Game Behavior Data , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[407]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[408]  Steve J. Young,et al.  A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies , 2006, The Knowledge Engineering Review.

[409]  Gordon D. A. Brown,et al.  Absolute identification by relative judgment. , 2005, Psychological review.

[410]  Igor Karpov and Leif Johnson and Vinod Valsalam and Ris Miikkulainen.  Evaluation Methods for Active Human-Guided Neuroevolution in Games , 2012 .

[411]  Matthieu Geist,et al.  User Simulation in Dialogue Systems Using Inverse Reinforcement Learning , 2011, INTERSPEECH.

[412]  Julian Togelius,et al.  Crowdsourcing the Aesthetics of Platform Games , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[413]  Shai Rozenberg,et al.  Playing SNES in the Retro Learning Environment , 2016, ICLR.

[414]  Julian Togelius,et al.  Ontogenetic and Phylogenetic Reinforcement Learning , 2009, Künstliche Intell..

[415]  Johan Hagelbäck,et al.  Potential-field based navigation in StarCraft , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[416]  Michael Mateas,et al.  MCMCTS PCG 4 SMB: Monte Carlo Tree Search to Guide Platformer Level Generation , 2021, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment.

[417]  J. Cacioppo,et al.  The psychophysiology of emotion. , 1993 .

[418]  Zoran Popovic,et al.  A mixed-initiative tool for designing level progressions in games , 2013, UIST.

[419]  Christine L. Lisetti,et al.  Modeling Multimodal Expression of User’s Affective Subjective Experience , 2002, User Modeling and User-Adapted Interaction.

[420]  Georgios N. Yannakakis,et al.  Player modeling using self-organization in Tomb Raider: Underworld , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[421]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[422]  James C. Lester,et al.  Modeling self-efficacy in intelligent tutoring systems: An inductive approach , 2008, User Modeling and User-Adapted Interaction.

[423]  Magy Seif El-Nasr,et al.  Intelligent Lighting for Game Environments , 2005, J. Game Dev..

[424]  Magy Seif El-Nasr,et al.  Data-Driven Retrospective Interviewing (DDRI): A proposed methodology for formative evaluation of pervasive games , 2015, Entertain. Comput..

[425]  G. Langley,et al.  The visual analogue scale: Its use in pain measurement , 2004, Rheumatology International.

[426]  Jonathan P. Rowe,et al.  Integrating Learning, Problem Solving, and Engagement in Narrative-Centered Learning Environments , 2011, Int. J. Artif. Intell. Educ..

[427]  Graham Kendall,et al.  Mobile games with intelligence: A killer application? , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[428]  Julian Togelius,et al.  A Panorama of Artificial and Computational Intelligence in Games , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[429]  Madhubalan Viswanathan,et al.  Measurement of Individual Differences in Preference for Numerical Information , 1993 .

[430]  Julian Togelius,et al.  Constrained Novelty Search: A Study on Game Content Generation , 2015, Evolutionary Computation.

[431]  Julian Togelius,et al.  Rules and Mechanics , 2016 .

[432]  Carlos Busso,et al.  The ordinal nature of emotions , 2017, 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII).

[433]  Margaret McRorie,et al.  Cross-Cultural Patterns in Dynamic Ratings of Positive and Negative Natural Emotional Behaviour , 2011, PloS one.

[434]  Gloria Mark,et al.  Stress and multitasking in everyday college life: an empirical study of online activity , 2014, CHI.

[435]  Julian Togelius,et al.  Transforming Exploratory Creativity with DeLeNoX, , 2021, ICCC.

[436]  K. Kallinen,et al.  Phasic Emotional Reactions to Video Game Events: A Psychophysiological Investigation , 2006 .

[437]  Julian Togelius,et al.  Automatic generation and analysis of physics-based puzzle games , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[438]  Julian Togelius,et al.  Artificial and Computational Intelligence in Games (Dagstuhl Seminar 12191) , 2012, Dagstuhl Reports.

[439]  Georgios N. Yannakakis,et al.  TOWARDS OPTIMIZING ENTERTAINMENT IN COMPUTER GAMES , 2007, Appl. Artif. Intell..

[440]  Panayiotis G. Georgiou,et al.  "That's Aggravating, Very Aggravating": Is It Possible to Classify Behaviors in Couple Interactions Using Automatically Derived Lexical Features? , 2011, ACII.

[441]  Michael Mateas,et al.  Prom Week: social physics as gameplay , 2011, FDG.

[442]  Steven Orla Kimbrough,et al.  On a Feasible-Infeasible Two-Population (FI-2Pop) genetic algorithm for constrained optimization: Distance tracing and no free lunch , 2008, Eur. J. Oper. Res..

[443]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[444]  Julian Togelius,et al.  Monte-Carlo Tree Search for Simulated Car Racing , 2015, FDG.

[445]  Simon M. Lucas,et al.  A Survey of Monte Carlo Tree Search Methods , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[446]  Julian Togelius,et al.  The experience-driven perspective , 2016 .

[447]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[448]  Julian Togelius,et al.  Patterns as Objectives for Level Generation , 2013 .

[449]  Jack T. Dennerlein,et al.  FRUSTRATING COMPUTERS USERS INCREASES EXPOSURE TO PHYSICAL FACTORS , 2002 .

[450]  Julian Togelius,et al.  Hierarchical controller learning in a First-Person Shooter , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[451]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[452]  Joe Marks,et al.  Automatic Design of Balanced Board Games , 2007, AIIDE.

[453]  Georgios N. Yannakakis,et al.  Fantasy, curiosity and challenge as adaptation indicators in multimodal dialogue systems for preschoolers , 2009, WOCCI.

[454]  Pascal Van Hentenryck.  Constraint satisfaction in logic programming , 1989, Logic programming.

[455]  Julian Togelius,et al.  Making Racing Fun Through Player Modeling and Track Evolution , 2006 .

[456]  Wei Chu,et al.  Preference learning with Gaussian processes , 2005, ICML.

[457]  Florian Richoux,et al.  TorchCraft: a Library for Machine Learning Research on Real-Time Strategy Games , 2016, ArXiv.

[458]  Georgios N. Yannakakis,et al.  Modeling Children's Entertainment in the Playware Playground , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[459]  R. Konečný.  Modeling of fighting game players , 2016 .

[460]  J. Russell.  A circumplex model of affect. , 1980 .

[461]  Ryan Shaun Joazeiro de Baker,et al.  The Dynamics between Student Affect and Behavior Occurring Outside of Educational Software , 2011, ACII.

[462]  Günter Rudolph,et al.  Advanced Dynamic Scripting for Fighting Game AI , 2015, ICEC.

[463]  Rafael Bidarra,et al.  Procedural Generation of Dungeons , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[464]  Julian Togelius,et al.  General general game AI , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[465]  Reid Swanson,et al.  Say Anything: Using Textual Case-Based Reasoning to Enable Open-Domain Interactive Storytelling , 2012, TIIS.

[466]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[467]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[468]  Miguel A. Nacenta,et al.  Depth perception with gaze-contingent depth of field , 2014, CHI.

[469]  Lars Niklasson,et al.  Goal-Directed Hierarchical Dynamic Scripting for RTS Games , 2006, AIIDE.

[470]  Abdulmotaleb El Saddik,et al.  The Role of Haptics in Games , 2012 .

[471]  Julian Togelius,et al.  The WCCI 2008 simulated car racing competition , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[472]  J. Togelius,et al.  Characteristics of Generatable Games , 2014 .

[473]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[474]  Georgios N. Yannakakis,et al.  Towards affective camera control in games , 2010, User Modeling and User-Adapted Interaction.

[475]  Andrea Bonarini,et al.  Modeling enjoyment preference from physiological responses in a car racing game , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[476]  Fred Charles,et al.  Planning formalisms and authoring in interactive storytelling , 2003 .

[477]  Julian Togelius,et al.  Modeling player experience in Super Mario Bros , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[478]  Staffan Björk,et al.  Zero-Player Games - What We Talk about When We Talk about Players , 2012, CGAMES 2012.

[479]  Kyunghyun Cho,et al.  Query-Efficient Imitation Learning for End-to-End Autonomous Driving , 2016, ArXiv.

[480]  Alexandros Potamianos,et al.  Towards adapting fantasy, curiosity and challenge in multimodal dialogue systems for preschoolers , 2009, ICMI-MLMI '09.

[481]  Ruck Thawonmas,et al.  Fighting game artificial intelligence competition platform , 2013, 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE).

[482]  Kevin Waugh,et al.  DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker , 2017, ArXiv.

[483]  Roddy Cowie,et al.  FEELTRACE: an instrument for recording perceived emotion in real time , 2000 .

[484]  Rafael Bidarra,et al.  Mixed-Initiative Design of Game Levels: Integrating Mission and Space into Level Generation , 2015, FDG.

[485]  Michael R. Genesereth,et al.  General Game Playing: Overview of the AAAI Competition , 2005, AI Mag..

[486]  Philip Hingston,et al.  A Turing Test for Computer Game Bots , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[487]  Michael Mateas,et al.  Answer Set Programming for Procedural Content Generation: A Design Space Approach , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[488]  Julian Togelius,et al.  Cellular automata for real-time generation of infinite cave levels , 2010, PCGames@FDG.

[489]  Nick Yee,et al.  The Demographics, Motivations, and Derived Experiences of Users of Massively Multi-User Online Graphical Environments , 2006, PRESENCE: Teleoperators and Virtual Environments.

[490]  Jacques Pitrat,et al.  Realization of a general game-playing program , 1968, IFIP Congress.

[491]  Jun Wang,et al.  Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games , 2017, ArXiv.

[492]  Antonios Liapis,et al.  Mixed-initiative content creation , 2016 .

[493]  Julian Togelius,et al.  Creativity Facet Orchestration : the Whys and the Hows , 2018 .

[494]  Santiago Ontañón,et al.  The Combinatorial Multi-Armed Bandit Problem and Its Application to Real-Time Strategy Games , 2013, AIIDE.

[495]  Simon Colton,et al.  Ludus Ex Machina: Building A 3D Game Designer That Competes Alongside Humans , 2014, ICCC.

[496]  Julian Togelius,et al.  How to Run a Successful Game-Based AI Competition , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[497]  Julian Togelius,et al.  Linear levels through n-grams , 2014, MindTrek.

[498]  Julian Togelius,et al.  EvoCommander: A Novel Game Based on Evolving and Switching Between Artificial Brains , 2017, IEEE Transactions on Computational Intelligence and AI in Games.

[499]  Susan R. Fussell,et al.  Effects of implicit sharing in collaborative analysis , 2014, CHI.

[500]  W. Ross Ashby,et al.  Principles of the Self-Organizing System , 1991 .

[501]  Terri Gullickson.  The Creative Mind: Myths and Mechanisms. , 1995 .

[502]  Georgios N. Yannakakis,et al.  Emotion in Games: Theory and Praxis , 2016 .

[503]  A. Silverstein.  The Developmental Psychology of Jean Piaget , 1965 .

[504]  Lennart E. Nacke,et al.  The neurobiology of play , 2010, Future Play.

[505]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[506]  Michael H. Bowling,et al.  Regret Minimization in Games with Incomplete Information , 2007, NIPS.

[507]  David Thue,et al.  Techniques for AI-Driven Experience Management in Interactive Narratives , 2015 .

[508]  Robert Woodbury,et al.  Searching for Designs: Paradigm and Practice , 1991 .

[509]  Georgios N. Yannakakis,et al.  Multimodal PTSD characterization via the StartleMart game , 2014, Journal on Multimodal User Interfaces.

[510]  Georgios N. Yannakakis,et al.  Deep Multimodal Fusion: Combining Discrete Events and Continuous Signals , 2014, ICMI.

[511]  R. Houle.  Player Modeling for Adaptive Games , 2006 .

[512]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[513]  R. Eklund,et al.  Assessing Flow in Physical Activity: The Flow State Scale-2 and Dispositional Flow Scale-2 , 2002 .

[514]  Peta Wyeth,et al.  Revisiting the GameFlow model with detailed heuristics , 2012 .

[515]  Ana Paiva,et al.  My Dream Theatre: Putting conflict on center stage , 2013, FDG.

[516]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[517]  Lennart E. Nacke,et al.  Flow and immersion in first-person shooters: measuring the player's gameplay experience , 2008, Future Play.

[518]  Jürgen S. Sauer,et al.  The influence of aesthetics in usability testing: the case of dual-domain products , 2014, CHI.

[519]  Tamás D. Gedeon,et al.  Objective measures, sensors and computational techniques for stress recognition and classification: A survey , 2012, Comput. Methods Programs Biomed..

[520]  Julian Togelius,et al.  AI for General Strategy Game Playing , 2014 .

[521]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[522]  Karen Collins,et al.  Playing with Sound: A Theory of Interacting with Sound and Music in Video Games , 2013 .

[523]  Ana Paiva,et al.  My dream theatre , 2013, AAMAS.

[524]  Shimon Whiteson,et al.  Challenge balancing for personalised game spaces , 2014, 2014 IEEE Games Media Entertainment.

[525]  Sebastian Risi,et al.  Interactive evolution of levels for a competitive multiplayer FPS , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[526]  H. Jaap van den Herik,et al.  PsyOps: Personality assessment through gaming behavior , 2013, FDG.

[527]  Joseph Weizenbaum,et al.  ELIZA—a computer program for the study of natural language communication between man and machine , 1966, CACM.

[528]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[529]  Jörg Denzinger,et al.  Dealing with Parameterized Actions in Behavior Testing of Commercial Computer Games , 2005, CIG.

[530]  Simon M. Lucas,et al.  Analysis of Vanilla Rolling Horizon Evolution Parameters in General Video Game Playing , 2017, EvoApplications.

[531]  Michael Mateas,et al.  Mystical Tutor: A Magic: The Gathering Design Assistant via Denoising Sequence-to-Sequence Learning , 2021, AIIDE.

[532]  Kostas Karpouzis,et al.  Does your profile say it all? Using demographics to predict expressive head movement during gameplay , 2012, UMAP Workshops.

[533]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[534]  Julian Togelius,et al.  A procedural procedural level generator generator , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[535]  D. Kahneman,et al.  Memories of yesterday's emotions: does the valence of experience affect the memory-experience gap? , 2009, Emotion.

[536]  Eyke Hüllermeier,et al.  Preference Learning , 2005, Künstliche Intell..

[537]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[538]  Regina Barzilay,et al.  Language Understanding for Text-based Games using Deep Reinforcement Learning , 2015, EMNLP.

[539]  A. Lindenmayer.  Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[540]  Alexander Nareyek,et al.  Intelligent Agents for Computer Games , 2006 .

[541]  John Salvatier,et al.  When Will AI Exceed Human Performance? Evidence from AI Experts , 2017, ArXiv.

[542]  Javier Hernandez,et al.  Call Center Stress Recognition with Person-Specific Models , 2011, ACII.

[543]  Kristy Elizabeth Boyer,et al.  Predicting Facial Indicators of Confusion with Hidden Markov Models , 2011, ACII.

[544]  R. Michael Young,et al.  Real-time cinematic camera control for interactive narratives , 2005, ACE '05.

[545]  Julian Togelius,et al.  Depth in Strategic Games , 2017, AAAI Workshops.

[546]  Michael Wooldridge,et al.  The Belief-Desire-Intention Model of Agency , 1998, ATAL.

[547]  Andrew K. Przybylski,et al.  The Motivational Pull of Video Games: A Self-Determination Theory Approach , 2006 .

[548]  Peter I. Cowling,et al.  Monte Carlo search applied to card selection in Magic: The Gathering , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[549]  Gautham J. Mysore,et al.  ISSE: an interactive source separation editor , 2014, CHI.

[550]  Marco Wiering,et al.  Reinforcement learning to train Ms. Pac-Man using higher-order action-relative inputs , 2013, 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[551]  Ruck Thawonmas,et al.  Application of Monte-Carlo tree search in a fighting game AI , 2016, 2016 IEEE 5th Global Conference on Consumer Electronics.

[552]  Yu-Jung Heo,et al.  Pororobot: A Deep Learning Robot That Plays Video Q&A Games , 2015, AAAI Fall Symposia.

[553]  Julian Togelius,et al.  SpeedRock: procedural rocks through grammars and evolution , 2011, PCGames '11.

[554]  A. Ram,et al.  Player Modeling Evaluation for Interactive Fiction , 2007 .

[555]  Mark O. Riedl,et al.  Emotion-Driven Narrative Generation , 2016 .

[556]  Richard Bartle,et al.  Designing Virtual Worlds , 2003 .

[557]  A. Damasio.  The somatic marker hypothesis and the possible functions of the prefrontal cortex. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[558]  Stacy Marsella,et al.  Evaluating a Computational Model of Emotion , 2005, Autonomous Agents and Multi-Agent Systems.

[559]  Andrea Bonarini,et al.  Learning General Preference Models from Physiological Responses in Video Games: How Complex Is It? , 2011, ACII.

[560]  Andrew Stern,et al.  Believable Agents and Intelligent Story Adaptation for Interactive Storytelling , 2006, TIDSE.

[561]  R. S-A. Gatsaeva,et al.  On the representation of continuous functions of several variables as superpositions of continuous functions of one variable and addition , 2018 .

[562]  Vladimir Lifschitz,et al.  Answer set programming and plan generation , 2002, Artif. Intell..

[563]  Simon M. Lucas.  Computational intelligence and games: Challenges and opportunities , 2008, Int. J. Autom. Comput..

[564]  Simon M. Lucas,et al.  Pac-Man Conquers Academia: Two Decades of Research Using a Classic Arcade Game , 2018, IEEE Transactions on Games.

[565]  Georgios N. Yannakakis,et al.  Modeling and Augmenting Game Entertainment through Challenge and Curiosity , 2007, Int. J. Artif. Intell. Tools.

[566]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[567]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[568]  Georgios N. Yannakakis,et al.  Real-Time Game Adaptation for Optimizing Player Satisfaction , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[569]  Hans-Peter Gasselseder,et al.  Re-Scoring the Game’s Score: Dynamic Music, Personality and Immersion in the Ludonarrative , 2014 .

[570]  Julian Togelius,et al.  Countering Poisonous Inputs with Memetic Neuroevolution , 2008, PPSN.

[571]  Alban Grastien,et al.  Online Graph Pruning for Pathfinding On Grid Maps , 2011, AAAI.

[572]  M. Tomasello,et al.  Does the chimpanzee have a theory of mind? 30 years later , 2008, Trends in Cognitive Sciences.

[573]  Julian Togelius,et al.  Online Evolution for Multi-action Adversarial Games , 2016, EvoApplications.

[574]  Daniele Loiacono,et al.  Interactive evolution for the procedural generation of tracks in a high-end racing game , 2011, GECCO '11.

[575]  Julian Togelius,et al.  Resource systems in games: An analytical approach , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[576]  Julian Togelius,et al.  The Mario AI Benchmark and Competitions , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[577]  Kostas Karpouzis,et al.  A Game-Based Corpus for Analysing the Interplay between Game Context and Player Experience , 2011, ACII.

[578]  Masayuki Numao,et al.  Three-Subagent Adapting Architecture for Fighting Videogames , 2010, PRICAI.

[579]  Iyad Rahwan,et al.  Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm , 2017, EMNLP.

[580]  J. Andreassi.  Psychophysiology: Human Behavior and Physiological Response , 1980 .

[581]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[582]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[583]  Georgios N. Yannakakis,et al.  The Preference Learning Toolbox , 2015, ArXiv.

[584]  R. Kaye.  Minesweeper is NP-complete , 2000 .

[585]  Simon M. Lucas,et al.  Fast Approximate Max-n Monte Carlo Tree Search for Ms Pac-Man , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[586]  Marc Cavazza,et al.  Interacting with virtual characters in interactive storytelling , 2002, AAMAS '02.

[587]  Mohamed Abou-Zleikha,et al.  Towards Generic Models of Player Experience , 2015, AIIDE.

[588]  Eric O. Postma,et al.  Adaptive game AI with dynamic scripting , 2006, Machine Learning.

[589]  Julian Togelius,et al.  Procedural Content Generation via Machine Learning (PCGML) , 2017, IEEE Transactions on Games.

[590]  Julian Togelius,et al.  Evolving card sets towards balancing dominion , 2012, 2012 IEEE Congress on Evolutionary Computation.

[591]  Sushil J. Louis,et al.  Evolving coordinated spatial tactics for autonomous entities using influence maps , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[592]  Alberto Maydeu-Olivares,et al.  How IRT can solve problems of ipsative data in forced-choice questionnaires. , 2013, Psychological methods.

[593]  Julian Togelius,et al.  General Video Game Level Generation , 2016, GECCO.

[594]  Kostas Karpouzis,et al.  Estimation of behavioral user state based on eye gaze and head pose—application in an e-learning environment , 2009, Multimedia Tools and Applications.

[595]  David B. Fogel,et al.  Blondie24: Playing at the Edge of AI , 2001 .

[596]  Julian Togelius,et al.  The Mario AI Championship 2009-2012 , 2013, AI Mag..

[597]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[598]  R. Lazarus.  Emotion and Adaptation , 1991 .

[599]  Risto Miikkulainen,et al.  Believable Bot Navigation via Playback of Human Traces , 2012, Believable Bots.

[600]  Mike Preuss,et al.  Automatic adaptation to generated content via car setup optimization in TORCS , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[601]  Simon Colton,et al.  Towards the Automatic Generation of Fictional Ideas for Games , 2014 .

[602]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[603]  Julian Togelius,et al.  Evolving personas for player decision modeling , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[604]  Michael Mateas,et al.  Search-Based Drama Management in the Interactive Fiction Anchorhead , 2005, AIIDE.

[605]  J. H. Ward.  Hierarchical Grouping to Optimize an Objective Function , 1963 .

[606]  Seth Ovadia.  Ratings and rankings: reconsidering the structure of values and their measurement , 2004 .

[607]  Mark J. Nelson.  Game Metrics Without Players: Strategies for Understanding Game Artifacts , 2011, Artificial Intelligence in the Game Design Process.

[608]  Brian Magerko,et al.  Story Representation and Interactive Drama , 2005, AIIDE.

[609]  J. Schwartz,et al.  Theory of Self-Reproducing Automata , 1967 .

[610]  Julian Togelius,et al.  Procedural Content Generation: Goals, Challenges and Actionable Steps , 2013, Artificial and Computational Intelligence in Games.

[611]  Georgios N. Yannakakis,et al.  Ranking vs. Preference: A Comparative Study of Self-reporting , 2011, ACII.

[612]  Perttu Hämäläinen,et al.  Children's intuitive gestures in vision-based action games , 2005, CACM.

[613]  Jessica D. Bayliss.  Teaching game AI through Minecraft mods , 2012, 2012 IEEE International Games Innovation Conference.

[614]  Julian Togelius,et al.  Evolving levels for Super Mario Bros using grammatical evolution , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[615]  Tom Alexander Garner,et al.  From sinewaves to physiologically-adaptive soundscapes: the evolving relationship between sound and emotion in video games , 2016 .

[616]  Menno D. T. de Jong,et al.  Does think aloud work?: how do we know? , 2006, CHI Extended Abstracts.

[617]  Julian Togelius,et al.  Measuring Intelligence through Games , 2011, ArXiv.

[618]  Julian Togelius,et al.  Autoencoder-augmented neuroevolution for visual doom playing , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[619]  Julian Togelius,et al.  Robust player imitation using multiobjective evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[620]  Julian Togelius,et al.  Give me a reason to dig Minecraft and psychology of motivation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[621]  Julian Togelius,et al.  The 2009 Simulated Car Racing Championship , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[622]  Julian Togelius,et al.  The turing test track of the 2012 Mario AI Championship: Entries and evaluation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[623]  Mark O. Riedl,et al.  A Lightweight Intelligent Virtual Cinematography System for Machinima Production , 2007, AIIDE.

[624]  Kenneth O. Stanley,et al.  Evolving content in the Galactic Arms Race video game , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[625]  Antonios Liapis,et al.  Sonancia : sonification of procedurally generated game levels , 2015 .

[626]  Donald S. Fussell,et al.  Computer rendering of stochastic models , 1998 .

[627]  Ben Houge.  Cell-based Music Organization in Tom Clancy's EndWar , 2012 .

[628]  Kent C. Berridge,et al.  Pleasures of the brain , 2003, Brain and Cognition.

[629]  Chris Bateman,et al.  21st Century Game Design (Game Development Series) , 2005 .

[630]  Frédéric Maire,et al.  Evolutionary Game Design , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[631]  Simon M. Lucas,et al.  Solving the Physical Traveling Salesman Problem: Tree Search and Macro Actions , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[632]  Dario Floreano,et al.  Coevolution of active vision and feature selection , 2004, Biological Cybernetics.

[633]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[634]  Mohammed J. Zaki,et al.  SPADE: An Efficient Algorithm for Mining Frequent Sequences , 2004, Machine Learning.

[635]  Julian Togelius,et al.  Towards a Video Game Description Language , 2013, Artificial and Computational Intelligence in Games.

[636]  Georgios N. Yannakakis,et al.  Generating Narrative Action Schemas for Suspense , 2012, INT@AIIDE.

[637]  Les Nelson,et al.  Introverted elves & conscientious gnomes: the expression of personality in world of warcraft , 2011, CHI.

[638]  Rafael A. Calvo,et al.  Effect of Experimental Factors on the Recognition of Affective Mental States through Physiological Measures , 2009, Australasian Conference on Artificial Intelligence.

[639]  Nur Ulfa Maulidevi,et al.  Deduction of fighting game countermeasures using Neuroevolution of Augmenting Topologies , 2016, 2016 International Conference on Data and Software Engineering (ICoDSE).

[640]  K. Scherer,et al.  Appraisal processes in emotion: Theory, methods, research. , 2001 .

[641]  Mark J. Nelson,et al.  Evaluating musical foreshadowing of videogame narrative experiences , 2014, Audio Mostly Conference.

[642]  Daniel Brewer.  Tactical Pathfinding on a NavMesh , 2019 .

[643]  Julian Togelius,et al.  Portfolio Online Evolution in StarCraft , 2016, AIIDE.

[644]  Tom Schaul,et al.  An Extensible Description Language for Video Games , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[645]  Jacek Mandziuk,et al.  An Automatically Generated Evaluation Function in General Game Playing , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[646]  Ana Paiva,et al.  Emotion in Games , 2011, ACII.

[647]  Peter J. Rousseeuw,et al.  Clustering by means of medoids , 1987 .

[648]  Ian Millington,et al.  Artificial Intelligence for Games , 2006, The Morgan Kaufmann series in interactive 3D technology.

[649]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[650]  Wojciech Jaskowski,et al.  ViZDoom: A Doom-based AI research platform for visual reinforcement learning , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[651]  C. Pelachaud,et al.  GRETA. A BELIEVABLE EMBODIED CONVERSATIONAL AGENT , 2005 .

[652]  Georgios N. Yannakakis,et al.  To rank or to classify? Annotating stress for reliable PTSD profiling , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[653]  Daniel Lankford Brown,et al.  Mezzo: An Adaptive, Real-Time Composition Program for Game Soundtracks , 2021, MUME@AIIDE.

[654]  P. Hingston.  Believable Bots: Can Computers Play Like People? , 2012 .

[655]  Guillaume Lample,et al.  Arnold: An Autonomous Agent to Play FPS Games , 2017, AAAI.

[656]  Risto Miikkulainen,et al.  A Neuroevolution Approach to General Atari Game Playing , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[657]  Georgios N. Yannakakis,et al.  Don’t Classify Ratings of Affect; Rank Them! , 2014, IEEE Transactions on Affective Computing.

[658]  Feng-Hsiung Hsu,et al.  Behind Deep Blue: Building the Computer that Defeated the World Chess Champion , 2002 .

[659]  Michael Mateas,et al.  Semi-autonomous avatars in world of minds: a case study of AI-based game design , 2008, ACE '08.

[660]  R. Arnheim.  Art and visual perception: A psychology of the creative eye, New version , 1955 .

[661]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[662]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[663]  Ana Paiva,et al.  FearNot! - An Experiment in Emergent Narrative , 2005, IVA.

[664]  Peng Zhang,et al.  The Angry Birds AI Competition , 2015, AI Mag..

[665]  Katja Hofmann,et al.  Asynchronous Data Aggregation for Training End to End Visual Control Networks , 2017, AAMAS.

[666]  Ana Paiva,et al.  Caring for agents and agents that care: building empathic relations with synthetic agents , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[667]  D. Kort,et al.  The Game Experience Questionnaire , 2013 .

[668]  Sander Bakkes,et al.  Monte Carlo Tree Search with options for general video game playing , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[669]  Risto Miikkulainen,et al.  UT2: Human-like behavior via neuroevolution of combat behavior and replay of human traces , 2011, CIG.

[670]  Santiago Ontañón,et al.  A Hierarchical MdMC Approach to 2D Video Game Map Generation , 2015, AIIDE.

[671]  Tiago H. Falk,et al.  Biometrics and classifier fusion to predict the fun-factor in video gaming , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[672]  Michael Mateas,et al.  Tanagra: a mixed-initiative level design tool , 2010, FDG.

[673]  Daniel A. Ashlock,et al.  Evolutionary computation for modeling and optimization , 2005 .

[674]  Jennifer Chu-Carroll,et al.  Building Watson: An Overview of the DeepQA Project , 2010, AI Mag..

[675]  Georgios N. Yannakakis.  Preference learning for affective modeling , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[676]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[677]  Clare Bates Congdon,et al.  REALM: A rule-based evolutionary computation agent that learns to play Mario , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[678]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[679]  Bobby D. Bryant,et al.  Visual control in quake II with a cyclic controller , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[680]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[681]  Geraint A. Wiggins,et al.  A preliminary framework for description, analysis and comparison of creative systems , 2006, Knowl. Based Syst..

[682]  Julian Togelius,et al.  Search-Based Procedural Content Generation: A Taxonomy and Survey , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[683]  Julian Togelius,et al.  Towards multiobjective procedural map generation , 2010, PCGames@FDG.

[684]  Michael Sellers,et al.  Good moods: outlook, affect and mood in dynemotion and the mind module , 2008, Future Play.

[685]  Margaret A. Boden,et al.  Creativity and Artificial Intelligence , 1998, IJCAI.

[686]  Zoran Popovic,et al.  Evaluating Competitive Game Balance with Restricted Play , 2012, AIIDE.

[687]  Antonios Liapis,et al.  A constructive approach for the generation of underwater environments , 2015 .

[688]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[689]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[690]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[691]  Julian Togelius,et al.  Matching Games and Algorithms for General Video Game Playing , 2021, AIIDE.

[692]  Amy K. Hoover.  Composing Video Game Levels with Music Metaphors through Functional Scaffolding , 2015 .

[693]  Steve Rabin,et al.  AI Game Programming Wisdom , 2002 .

[694]  Jeff Orkin,et al.  The Restaurant Game: Learning Social Behavior and Language from Thousands of Players Online , 2008, J. Game Dev..

[695]  Cristina Conati,et al.  Modeling User Affect from Causes and Effects , 2009, UMAP.

[696]  Nathan R. Sturtevant,et al.  Combining Bounding Boxes and JPS to Prune Grid Pathfinding , 2016, AAAI.

[697]  Antonio Ricciardi,et al.  Adaptive AI for Fighting Games , 2008 .

[698]  Santiago Ontañón,et al.  Automatic Learning of Combat Models for RTS Games , 2015, AIIDE.

[699]  Katerina Mania,et al.  Binocular eye-tracking for the control of a 3D immersive multimedia user interface , 2015, 2015 IEEE 1st Workshop on Everyday Virtual Reality (WEVR).

[700]  Brian Schwab,et al.  AI Game Engine Programming , 2004 .

[701]  H. Jaap van den Herik,et al.  Play style: Showing your age , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[702]  Sushil J. Louis,et al.  Using a genetic algorithm to tune first-person shooter bots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[703]  Kostas Karpouzis,et al.  The platformer experience dataset , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[704]  Julian Togelius,et al.  Evolving robust and specialized car racing skills , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[705]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[706]  Brendan Maher,et al.  Can a video game company tame toxic behaviour? , 2016, Nature.

[707]  Simon M. Lucas,et al.  Rolling horizon evolution versus tree search for navigation in single-player real-time games , 2013, GECCO '13.

[708]  Santiago Ontañón,et al.  A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[709]  S. Jamieson.  Likert scales: how to (ab)use them , 2004, Medical education.

[710]  Rafael Bidarra,et al.  Interactive Creation of Virtual Worlds Using Procedural Sketching , 2010, Eurographics.

[711]  Shimon Whiteson,et al.  Towards Personalised Gaming via Facial Expression Recognition , 2014, AIIDE.

[712]  Nick Montfort,et al.  Racing the Beam: The Atari Video Computer System , 2009 .

[713]  Yngvi Björnsson,et al.  Learning Simulation Control in General Game-Playing Agents , 2010, AAAI.

[714]  I. Sprinkhuizen-Kuyper,et al.  DIFFICULTY SCALING OF GAME AI , 2004 .

[715]  W. R. Thompson.  ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES , 1933 .

[716]  Bobby D. Bryant,et al.  Neurovisual Control in the Quake II Environment , 2012, IEEE Transactions on Computational Intelligence and AI in Games.

[717]  Antonios Liapis,et al.  A holistic approach for semantic-based game generation , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[718]  Kasia Muldner,et al.  Emotion Sensors Go To School , 2009, AIED.

[719]  Brian Hawkins.  Real-Time Cinematography for Games (Game Development Series) , 2004 .

[720]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[721]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[722]  Mark Grimshaw,et al.  Sonic Virtuality: Understanding Audio in a Virtual World , 2014 .

[723]  Mark O. Riedl,et al.  Toward supporting stories with procedurally generated game worlds , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[724]  Pieter Spronck,et al.  Cultural influences on play style , 2014, 2014 IEEE Conference on Computational Intelligence and Games.

[725]  Simon Colton,et al.  Evolving Behaviour Trees for the Commercial Game DEFCON , 2010, EvoApplications.

[726]  Hector Muñoz-Avila,et al.  Learning and Game AI , 2013, Artificial and Computational Intelligence in Games.

[727]  Lockheed Martin,et al.  A Game AI Approach to Autonomous Control of Virtual Characters , 2011 .

[728]  Randall W. Hill,et al.  Toward Virtual Humans , 2006, AI Mag..