Conducting real-time multiplayer experiments on the web

Group behavior experiments require potentially large numbers of participants to interact in real time with perfect information about one another. In this paper, we address the methodological challenge of developing and conducting such experiments on the web, thereby broadening access to online labor markets as well as allowing for participation through mobile devices. In particular, we combine a set of recent web development technologies, including Node.js with the Socket.io module, HTML5 canvas, and jQuery, to provide a secure platform for pedagogical demonstrations and scalable, unsupervised experiment administration. Template code is provided for an example real-time behavioral game theory experiment which automatically pairs participants into dyads and places them into a virtual world. In total, this treatment is intended to allow those with a background in non-web-based programming to modify the template, which handles the technical server–client networking details, for their own experiments.

[1]  Andrew T. Hartnett,et al.  Both information and social cohesion determine collective decisions in animal groups , 2013, Proceedings of the National Academy of Sciences.

[2]  Mike Wilson,et al.  Node - Up and Running: Scalable Server-Side Code with JavaScript , 2012 .

[3]  Daniel Friedman,et al.  Software for continuous game experiments , 2014 .

[4]  Dirk Helbing,et al.  How Individuals Learn to Take Turns: Emergence of Alternating Cooperation in a Congestion Game and the Prisoner's Dilemma , 2005, Adv. Complex Syst..

[5]  Vai-Lam Mui,et al.  Using Turn Taking to Mitigate Coordination and Conflict Problems in the Repeated Battle of the Sexes Game , 2008 .

[6]  Siddharth Suri,et al.  Conducting behavioral research on Amazon’s Mechanical Turk , 2010, Behavior research methods.

[7]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[8]  Uzay Kaymak,et al.  Erim Report Series Research in Management from Discrete-time Models to Continuous-time, Asynchronous Models of Financial Markets Asynchronous Models of Financial Markets , 2022 .

[9]  Brian D. O. Anderson,et al.  Agreeing Asynchronously , 2008, IEEE Transactions on Automatic Control.

[10]  Matt Bishop,et al.  Computer Security: Art and Science , 2002 .

[11]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[12]  Dirk Helbing,et al.  Experimental study of the behavioural mechanisms underlying self-organization in human crowds , 2009, Proceedings of the Royal Society B: Biological Sciences.

[13]  Daniel Friedman,et al.  Continuous time and communication in a public-goods experiment , 2014 .

[14]  Daniel C. Richardson,et al.  The self organization of human interaction , 2013 .

[15]  Ulf-Dietrich Reips.  Standards for Internet-based experimenting. , 2002, Experimental psychology.

[16]  Thomas A. Rietz,et al.  Price dynamics in political prediction markets , 2009, Proceedings of the National Academy of Sciences.

[17]  Nicolas Michinov,et al.  Improving productivity and creativity in online groups through social comparison process: New evidence for asynchronous electronic brainstorming , 2005, Comput. Hum. Behav..

[18]  Noah J. Goldstein,et al.  Social influence: compliance and conformity. , 2004, Annual review of psychology.

[19]  Panagiotis G. Ipeirotis,et al.  Running Experiments on Amazon Mechanical Turk , 2010, Judgment and Decision Making.

[20]  Steve Vinoski,et al.  Node.js: Using JavaScript to Build High-Performance Network Programs , 2010, IEEE Internet Comput..

[21]  Nikos Nikiforakis,et al.  Perfect and imperfect real-time monitoring in a minimum-effort game , 2012 .

[22]  Robert L. Goldstone,et al.  Knowledge of resources and competitors in human foraging , 2005, Psychonomic bulletin & review.

[23]  Michael J. Spivey,et al.  Continuous Dynamics in Real-Time Cognition , 2006 .

[24]  D. Friedman,et al.  A Continuous Dilemma ∠, 2009 .

[25]  Duncan J. Watts,et al.  Cooperation and Contagion in Web-Based, Networked Public Goods Experiments , 2010, SECO.

[26]  Duncan J. Watts,et al.  Financial incentives and the "performance of crowds" , 2009, HCOMP '09.