Analysis of Expert Judgment in a Hail Forecasting Experiment

Abstract This study compared meteorologists, an expert system, and simple weighted-sum models in a limited-information hail forecasting experiment. It was found that forecasts made by meteorologists were closely approximated by an additive model, and that the model captured most of their forecasting skill. Furthermore, the additive model approximated the meteorologists’ forecasts better than the expert system did. Results of this study am consistent with the results of extensive psychological research on judgment and decision making processes. Potential implications are discussed.

[1]  Paul Slovic,et al.  Comparison of Bayesian and Regression Approaches to the Study of Information Processing in Judgment. , 1971 .

[2]  Hendrik Tennekes.  The Outlook: Scattered Showers , 1988 .

[3]  F. Hansford-Miller.  13. Judgement and Choice: The Psychology of Decision , 1988 .

[4]  A. H. Murphy,et al.  A comparative evaluation of objective and subjective weather forecasts in the united states , 1984 .

[5]  T. R. Stewart,et al.  Judgment and Decision Making in Dynamic Tasks: The Case of Forecasting the Microburst , 1990 .

[6]  D M Chaput de Saintonge,et al.  Clinical judgment in rheumatoid arthritis. I. Rheumatologists' opinions and the development of 'paper patients'. , 1983, Annals of the rheumatic diseases.

[7]  Lewis R. Goldberg,et al.  Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. , 1970 .

[8]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[9]  L. R. Goldberg.  THE SEARCH FOR CONFIGURAL RELATIONSHIPS IN PERSONALITY ASSESSMENT: THE DIAGNOSIS OF PSYCHOSIS vs. NEUROSIS FROM THE MMPI. , 1969, Multivariate behavioral research.

[10]  Colin F. Camerer,et al.  General conditions for the success of bootstrapping models , 1981 .

[11]  B Carroll,et al.  Artificial intelligence. Expert systems for clinical diagnosis: are they worth the effort? , 1987, Behavioral science.

[12]  R. Darlington,et al.  Multiple regression in psychological research and practice. , 1968, Psychological bulletin.

[13]  A. H. Murphy,et al.  forecasters and probability forecasts: some current problems1,2 , 1971 .

[14]  L. Sjöberg.  Aided and unaided decision making: Improving intuitive judgement , 1982 .

[15]  Robyn M. Dawes,et al.  Representative thinking in clinical judgment , 1986 .

[16]  Allan H. Murphy.  Comparative Evaluation of Categorical and Probabilistic Forecasts: Two Alternatives to the Traditional Approach , 1986 .

[17]  Thomas R. Stewart,et al.  Descriptive and prescriptive models for judgment and decision making: implications for knowledge engineering , 1987 .

[18]  W. Edwards,et al.  Costs and payoffs in perceptual research. , 1982 .

[19]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[20]  T. R. Brown.  A comparison of judgmental policy equations obtained from human judges under natural and contrived conditions , 1972 .

[21]  P. Lovie,et al.  The flat maximum effect and linear scoring models for prediction , 1986 .

[22]  Kenneth R. Hammond.  Toward a unified approach to the study of expert judgment , 1987 .