The wisdom of the crowd playing The Price Is Right

In The Price Is Right game show, players compete to win a prize, by placing bids on its price. We ask whether it is possible to achieve a “wisdom of the crowd” effect, by combining the bids to produce an aggregate price estimate that is superior to the estimates of individual players. Using data from the game show, we show that a wisdom of the crowd effect is possible, especially by using models of the decision-making processes involved in bidding. The key insight is that, because of the competitive nature of the game, what people bid is not necessarily the same as what they know. This means better estimates are formed by aggregating latent knowledge than by aggregating observed bids. We use our results to highlight the usefulness of models of cognition and decision-making in studying the wisdom of the crowd, which are often approached only from non-psychological statistical perspectives.

[1]  J. Stroop.  Is the judgment of the group better than that of the average member of the group , 1932 .

[2]  J. Warren,et al.  The natural experiment. , 1970, Medical times.

[3]  R. Nosofsky.  American Psychological Association, Inc. Choice, Similarity, and the Context Theory of Classification , 2022 .

[4]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[5]  Robert H. Gertner.  Game Shows and Economic Behavior: Risk-Taking on “Card Sharks” , 1993 .

[6]  Kent Hickman,et al.  Rationality and the 'price is right' , 1993 .

[7]  Andrew Metrick,et al.  A Natural Experiment in "Jeopardy!" , 1995 .

[8]  Jonathan B. Berk,et al.  The Price Is Right, but Are the Bids? An Investigation of Rational Decision Theory , 1996 .

[9]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[10]  Peter Grünwald.  Viewing all models as “probabilistic” , 1999, COLT '99.

[11]  Nir Vulkan.  An Economist's Perspective on Probability Matching , 2000 .

[12]  Michael J. Rabins,et al.  Price is Right , 2000 .

[13]  A. Tversky,et al.  Choices, Values, and Frames , 2000 .

[14]  J. Busemeyer,et al.  A contribution of cognitive decision models to clinical assessment: decomposing performance on the Bechara gambling task. , 2002, Psychological assessment.

[15]  Erik M. Altmann,et al.  Reconstructing the serial order of events: a case study of September 11, 2001 , 2003 .

[16]  N. Kerr,et al.  Group performance and decision making. , 2004, Annual review of psychology.

[17]  M. Lee.  An Efficient Method for the Minimum Description Length Evaluation of Deterministic Cognitive Models , 2004 .

[18]  熊谷 ユリヤ,et al.  James Surowiecki, 『The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations』, Random House, 5,2004, $24.95 , 2005 .

[19]  Reid Hastie,et al.  The robust beauty of majority rules in group decisions. , 2005, Psychological review.

[20]  E. Maasland,et al.  Auction Theory , 2021, Springer Texts in Business and Economics.

[21]  J. Tenenbaum,et al.  Special issue on “Probabilistic models of cognition , 2022 .

[22]  Gordon D. A. Brown,et al.  Decision by sampling , 2006, Cognitive Psychology.

[23]  A. Mele,et al.  Rationality and the Good: Critical Essays on the Ethics and Epistemology of Robert Audi , 2007 .

[24]  Gavin Potter.  Putting the collaborator back into collaborative filtering , 2008, NETFLIX '08.

[25]  Ron Sun,et al.  The Cambridge Handbook of Computational Psychology , 2008 .

[26]  Charles Kemp,et al.  Bayesian models of cognition , 2008 .

[27]  Michael D. Lee,et al.  Exemplars, Prototypes, Similarities, and Rules in Category Representation: An Example of Hierarchical Bayesian Analysis , 2008, Cogn. Sci..

[28]  Sean M. Polyn,et al.  The Cambridge Handbook of Computational Psychology: Computational Models of Episodic Memory , 2008 .

[29]  Stefan M. Herzog,et al.  The Wisdom of Many in One Mind , 2009, Psychological science.

[30]  Pernille Hemmer,et al.  The Wisdom of Crowds in the Recollection of Order Information , 2009, NIPS.

[31]  Joshua B Tenenbaum,et al.  Theory-based causal induction. , 2009, Psychological review.

[32]  Michael D. Lee,et al.  A Model of Knower-Level Behavior in Number Concept Development , 2009, Cogn. Sci..

[33]  Michael D. Lee,et al.  The Accuracy of Small-Group Estimation and the Wisdom of Crowds , 2010 .

[34]  R. Catrambone,et al.  Proceedings of the 32nd Annual Conference of the Cognitive Science Society , 2010 .

[35]  Cognitive Models and the Wisdom of Crowds: A Case Study Using the Bandit Problem , 2010 .

[36]  J. D. Christiansen,et al.  Prediction Markets: Practical Experiments in Small Markets and Behaviours Observed , 2012 .