Facing uncertainty in the game of bridge: A calibration study

Abstract Previous studies have shown a strong tendency toward overconfidence in peoples' probability assessments. Even experts are often poorly calibrated. The present paper suggets that quality of calibration is largely determined by the extent to which the cognitive processes required for repeated probability assessments are similar. One task that satisfies this condition is the game of bridge in which accurate probabilistic assessments are required for good playing. Two experiments were conducted in a natural setting of a tournament in which subjects were asked to assess the likelihood that a final contract (reached during the bidding phase) would indeed be made. Expert players were almost perfectly calibrated whereas amateurs were overconfident. The differences between expert and amateur players are discussed, and some guidelines for training procedures for calibration in general are proposed.

[1]  A. D. D. Groot Thought and Choice in Chess , 1978 .

[2]  Jay J.J. Christensen-Szalanski,et al.  Physicians' use of probabilistic information in a real clinical setting. , 1981 .

[3]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[4]  R. Hogarth,et al.  Prediction, Diagnosis, and Causal Thinking in Forecasting , 1982 .

[5]  David Lindley The Improvement of Probability Judgements , 1982 .

[6]  Richard A. Epstein,et al.  The Theory of Gambling and Statistical Logic , 1968 .

[7]  O. Svenson ARE WE ALL LESS RISKY AND MORE SKILLFUL THAN OUR FELLOW DRIVERS , 1981 .

[8]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[9]  Gideon Keren,et al.  On the importance of identifying the correct ‘problem space’ , 1984, Cognition.

[10]  Bryce B. Hudgins,et al.  Reviews: Kleinmuntz, Benjamin, (Ed.), Problem Solving: Research, Method, and Theory. John Wiley and Sons, Inc., New York. 1966. $6.95 , 1967 .

[11]  Ruth Beyth-Marom,et al.  How probable is probable? A numerical translation of verbal probability expressions , 1982 .

[12]  Evelyn Waugh,et al.  A Little Learning , 1964 .

[13]  Charles Henry Goren Contract bridge complete , 1952 .

[14]  B. Fischhoff,et al.  Training for calibration. , 1980 .

[15]  Stephen E. Fienberg,et al.  The analysis of cross-classified categorical data , 1980 .

[16]  N. Weinstein Unrealistic optimism about future life events , 1980 .

[17]  S. Lichtenstein,et al.  Do those who know more also know more about how much they know?*1 , 1977 .

[18]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[19]  Richard A. Epstein,et al.  The Theory of Gambling and Statistical Logic , 1977 .

[20]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[21]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[22]  A. H. Murphy,et al.  Probability Forecasting in Meteorology , 1984 .

[23]  조성구,et al.  On the Calibration of Probabilities , 1987 .

[24]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .