Web-based experiments controlled by JavaScript: An example from probability learning

JavaScript programs can be used to control Web experiments. This technique is illustrated by an experiment that tested the effects of advice on performance in the classic probability-learning paradigm. Previous research reported that people tested via the Web or in the lab tended to match the probabilities of their responses to the probabilities that those responses would be reinforced. The optimal strategy, however, is to consistently choose the more frequent event; probability matching produces sub-optimal performance. We investigated manipulations we reasoned should improve performance. A horse race scenario in which participants predicted the winner in each of a series of races between two horses was compared with an abstract scenario used previously. Ten groups of learners received different amounts of advice, including all combinations of (1) explicit instructions concerning the optimal strategy, (2) explicit instructions concerning a monetary sum to maximize, and (3) accurate information concerning the probabilities of events. The results showed minimal effects of horse race versus abstract scenario. Both advice concerning the optimal strategy and probability information contributed significantly to performance in the task. This paper includes a brief tutorial on JavaScript, explaining with simple examples how to assemble a browser-based experiment.

[1]  A. Tversky,et al.  Information versus reward in binary choices. , 1966, Journal of experimental psychology.

[2]  Jonathan Baron,et al.  Techniques for Creating and Using Web Questionnaires in Research and Teaching , 2000 .

[3]  M. Birnbaum Testing Critical Properties of Decision Making on the Internet , 1999 .

[4]  S. Epstein,et al.  Conflict between intuitive and rational processing: when people behave against their better judgment. , 1994, Journal of personality and social psychology.

[5]  Stefan Schwarz,et al.  CGI versus JavaScript : a Web Experiment on the Reversed Hindsight Bias , 2001 .

[6]  B. Mellers,et al.  Bayesian inference: Combining base rates with opinions of sources who vary in credibility. , 1983 .

[7]  H. Arkes,et al.  Factors influencing the use of a decision rule in a probabilistic task , 1986 .

[8]  W. Estes,et al.  Traps in the route to models of memory and decision , 2002, Psychonomic bulletin & review.

[9]  W. Edwards,et al.  Supplementary report:unlearning the gambler's fallacy. , 1961, Journal of experimental psychology.

[10]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[11]  Iddo Gal,et al.  Understanding Repeated Simple Choices , 1996 .

[12]  R. C. Nies Effects of probable outcome information on two-choice learning. , 1962, Journal of experimental psychology.

[13]  W. Edwards Reward probability, amount, and information as determiners of sequential two-alternative decisions. , 1956, Journal of experimental psychology.

[14]  Aimée M. Surprenant,et al.  The Cognitive Psychology Online Laboratory , 2000 .

[15]  Reeshad S. Dalal,et al.  Validity of Web-Based Psychological Research , 2000 .

[16]  R. Herrnstein Behavior, Reinforcement and Utility , 1990 .

[17]  Alvin E. Roth,et al.  The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models , 1999 .

[18]  M Lange Museum of perception and cognition website: Using JavaScript to increase interactivity in Web-based presentations , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[19]  W. Edwards,et al.  Probability learning in 1000 trials. , 1961, Journal of experimental psychology.

[20]  Michael H. Birnbaum,et al.  Introduction to Behavioral Research on the Internet , 2000 .

[21]  M. Birnbaum Base Rates in Bayesian Inference: Signal Detection Analysis of the Cab Problem , 1983 .

[22]  G. Bower,et al.  A turning point in mathematical learning theory. , 1994, Psychological review.

[23]  A. Tversky,et al.  Evidential impact of base rates , 1981 .

[24]  J. Phillips,et al.  Departures From Sensible Play in Computer Blackjack , 2000, The Journal of general psychology.

[25]  W. Estes Toward a Statistical Theory of Learning. , 1994 .