PsyRTS: a Web Platform for Experiments in Human Decision-Making in RTS Environments

This paper presents PsyRTS: an open-source web-platform designed to create psychological experiments using a dynamic environment based on real-time strategy games. This platform has characteristics present in Real-Time Strategy (RTS) games and allows the researcher to manipulate variables regarding visibility, resource availability and presence of other agents while at the same time enabling human participation through existing online platforms.

[1]  Magda Osman,et al.  Investigating the exploration-exploitation trade-off in dynamic environments with multiple agents , 2019, CogSci.

[2]  Oded Berger-Tal,et al.  The Exploration-Exploitation Dilemma: A Multidisciplinary Framework , 2014, PloS one.

[3]  Gijsbert Stoet,et al.  PsyToolkit: A Novel Web-Based Method for Running Online Questionnaires and Reaction-Time Experiments , 2017 .

[4]  Thomas T. Hills,et al.  Exploration versus exploitation in space, mind, and society , 2015, Trends in Cognitive Sciences.

[5]  Jessica Massonnié,et al.  Gorilla in our midst: An online behavioral experiment builder , 2019, Behavior research methods.

[6]  Shane Legg,et al.  Psychlab: A Psychology Laboratory for Deep Reinforcement Learning Agents , 2018, ArXiv.

[7]  Santiago Ontañón,et al.  A Survey of Real-Time Strategy Game AI Research and Competition in StarCraft , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[8]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[9]  Jan Theeuwes,et al.  OpenSesame: An open-source, graphical experiment builder for the social sciences , 2011, Behavior Research Methods.

[10]  Jesse J. Chandler,et al.  Crowdsourcing Samples in Cognitive Science , 2017, Trends in Cognitive Sciences.

[11]  Tom Schaul,et al.  StarCraft II: A New Challenge for Reinforcement Learning , 2017, ArXiv.

[12]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[13]  Magda Osman,et al.  Approaches to Learning to Control Dynamic Uncertainty , 2015, Syst..

[14]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[15]  Ben R. Newell,et al.  Unpacking the Exploration–Exploitation Tradeoff: A Synthesis of Human and Animal Literatures , 2015 .

[16]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[17]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[18]  Annie Louis,et al.  Beyond playing to win: Diversifying heuristics for GVGAI , 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG).

[19]  Burt P. Kotler,et al.  Short-Term Apparent Competition , 1987, The American Naturalist.

[20]  Glen Robertson,et al.  A Review of Real-Time Strategy Game AI , 2014, AI Mag..

[21]  Julian Togelius,et al.  A Panorama of Artificial and Computational Intelligence in Games , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[22]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[23]  Marc Mangel,et al.  Exploration or exploitation: life expectancy changes the value of learning in foraging strategies , 2007 .

[24]  Pierre Bessière,et al.  Multiscale Bayesian Modeling for RTS Games: An Application to StarCraft AI , 2016, IEEE Transactions on Computational Intelligence and AI in Games.

[25]  M. Osman.  Controlling uncertainty: a review of human behavior in complex dynamic environments. , 2010, Psychological bulletin.

[26]  Margaret M. Burnett,et al.  Toward Foraging for Understanding of StarCraft Agents: An Empirical Study , 2017, IUI.

[27]  Stefan Palan,et al.  Prolific.ac—A subject pool for online experiments , 2017 .

[28]  Robert L. Goldstone,et al.  Knowledge of resources and competitors in human foraging , 2005, Psychonomic bulletin & review.