Coherent probability from incoherent judgment.

People often have knowledge about the chances of events but are unable to express their knowledge in the form of coherent probabilities. This study proposed to correct incoherent judgment via an optimization procedure that seeks the (coherent) probability distribution nearest to a judge's estimates of chance. This method was applied to the chances of simple and complex meteorological events, as estimated by college undergraduates. No judge responded coherently, but the optimization method found close (coherent) approximations to their estimates. Moreover, the approximations were reliably more accurate than the original estimates, as measured by the quadratic scoring rule. Methods for correcting incoherence facilitate the analysis of expected utility and allow human judgment to be more easily exploited in the construction of expert systems.

[1]  Don N. Kleinmuntz,et al.  Conditioned assessment of subjective probabilities : Identifying the benefits of decomposition , 1996 .

[2]  Max Henrion,et al.  Practical issues in constructing a Bayes belief network , 1987, Int. J. Approx. Reason..

[3]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[4]  J. Baron.  Thinking and Deciding , 2023 .

[5]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[6]  Edward E. Smith,et al.  Extracting the coherent core of human probability judgement: a research program for cognitive psychology , 1994, Cognition.

[7]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[8]  A. Tversky,et al.  On the Reconciliation of Probability Assessments , 1979 .

[9]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[10]  G. Gregory,et al.  Probability, Induction and Statistics , 1974 .

[11]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[12]  A. H. Murphy,et al.  “Good” Probability Assessors , 1968 .

[13]  Ken Manktelow,et al.  Reasoning and Thinking , 1999 .

[14]  B. D. Finetti,et al.  Probability, induction and statistics : the art of guessing , 1979 .

[15]  Daniel N. Osherson,et al.  Probability Bootstrapping: Improving Prediction by Fitting Extensional Models to Knowledgeable but Incoherent Probability Judgments , 1997 .

[16]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[17]  J. Baron.  Thinking and deciding, 2nd ed. , 1994 .

[18]  Giulianella Coletti,et al.  Comparative probability for conditional events: A new look through coherence , 1993 .

[19]  J. Frank Yates,et al.  Judgment and Decision Making , 1990 .

[20]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[21]  Christos H. Papadimitriou,et al.  Probabilistic satisfiability , 1988, J. Complex..

[22]  Joshua Klayman,et al.  Debias the environment instead of the judge: an alternative approach to reducing error in diagnostic (and other) judgment , 1993, Cognition.

[23]  Giulianella Coletti,et al.  Coherent qualitative probability , 1990 .

[24]  Gene Rowe,et al.  Perspectives on Expertise in the Aggregation of Judgments , 1992 .

[25]  P. Powell.  Expertise and Decision Support , 2013 .

[26]  John S. Breese,et al.  Exact Reasoning About Uncertainty: On the Design of Expert Systems for Decision Support , 1985, UAI.

[27]  H Gu,et al.  The effects of averaging subjective probability estimates between and within judges. , 2000, Journal of experimental psychology. Applied.

[28]  M. Resnik.  Choices: An Introduction to Decision Theory , 1990 .

[29]  Enrico Macii,et al.  Algebric Decision Diagrams and Their Applications , 1997, ICCAD '93.

[30]  Richard E. Neapolitan,et al.  Probabilistic reasoning in expert systems - theory and algorithms , 2012 .

[31]  Daniel N. Osherson,et al.  A Source of Bayesian Priors , 1995, Cogn. Sci..

[32]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[33]  R. Jeffrey.  The Logic of Decision , 1984 .

[34]  William R. Ferrell,et al.  Discrete subjective probabilities and decision analysis: Elicitation, calibration and combination. , 1994 .

[35]  Marek J. Druzdzel,et al.  Elicitation of Probabilities for Belief Networks: Combining Qualitative and Quantitative Information , 1995, UAI.

[36]  Colin F. Camerer,et al.  General conditions for the success of bootstrapping models , 1981 .

[37]  Richard Bradley,et al.  More Triviality , 1999, J. Philos. Log..

[38]  Nils J. Nilsson,et al.  Probabilistic Logic * , 2022 .

[39]  H. Raiffa,et al.  Judgment under uncertainty: A progress report on the training of probability assessors , 1982 .

[40]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[41]  Graham Priest.  Semantic Closure, Descriptions and Non-Triviality , 1999, J. Philos. Log..

[42]  P. Walley.  Statistical Reasoning with Imprecise Probabilities , 1990 .

[43]  Enrique F. Castillo,et al.  Expert Systems and Probabilistic Network Models , 1996, Monographs in Computer Science.

[44]  R. Dawes.  Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[45]  Bruno de Finetti,et al.  Probability, induction and statistics , 1972 .

[46]  William Gustason,et al.  Reasoning from Evidence: Inductive Logic , 1994 .

[47]  R. I. Bahar,et al.  Algebraic decision diagrams and their applications , 1993, Proceedings of 1993 International Conference on Computer Aided Design (ICCAD).

[48]  P. Walley.  Measures of Uncertainty in Expert Systems , 1996, Artificial Intelligence.

[49]  R. Fildes.  Journal of the Royal Statistical Society (B): Gary K. Grunwald, Adrian E. Raftery and Peter Guttorp, 1993, “Time series of continuous proportions”, 55, 103–116.☆ , 1993 .

[50]  D. Lewis.  Probabilities of Conditionals and Conditional Probabilities , 1976 .

[51]  A. H. Murphy.  A New Vector Partition of the Probability Score , 1973 .

[52]  J. Mumpower.  Decision sciences: An integrative perspective, Paul R. Kleindorfer, Howard C. Kunreuther, and Paul J. H. Schoemaker, Cambridge: Cambridge University Press, 1993, 470 pp., ISBN 0‐521‐32867‐5 (hc), ISBN 0521‐33812‐3 (pb) , 1995 .