Effects of feedback on probabilistic forecasts of stock prices

This paper reports the results of an experiment in stock-price forecasting that investigated the effects of feedback on various dimensions of probability forecasting accuracy. Three types of feedback were used: (1) simple outcome feedback, (2) outcome feedback presented in the task format, and (3) performance feedback in the form of an overall accuracy score in addition to detailed calibration information. While calibration improved for all the feedback groups, forecasters' skill was found to improve only for the task-formated outcome feedback and performance feedback groups (but not for the simple outcome feedback group). Finally, the forecasters in the performance feedback group also improved their mean slope and mean probability scores, an effect not observed in the other feedback groups. It is suggested that, in a dynamic environment like the stock market, probability forecasting offers distinct advantages by providing an important channel of communication between the forecasters and the users of financial information.

[1]  P. A. Adams,et al.  Realism of confidence judgments. , 1961, Psychological review.

[2]  B. H. Beach.  Expert judgment about uncertainty: Bayesian decision making in realistic settings. , 1975, Organizational behavior and human performance.

[3]  P. George Benson,et al.  The effects of feedback and training on the performance of probability forecasters , 1992 .

[4]  M. C. Jensen.  The Performance of Mutual Funds in the Period 1945-1964 , 1967 .

[5]  A. H. Murphy,et al.  Impacts of Feedback and Experience on the Quality of Subjective Probability Forecasts. Comparison of Results from the First and Second Years of the Zierikzee Experiment , 1984 .

[6]  G. W. Fischer,et al.  Scoring-rule feedback and the overconfidence syndrome in subjective probability forecasting , 1982 .

[7]  David L. Ronis,et al.  Probability judgment accuracy: China, Japan, and the United States , 1989 .

[8]  B. Fischhoff,et al.  Subjective Confidence in Forecasts. , 1982 .

[9]  Carl-Axel S. Staël von Holstein,et al.  Probabilistic forecasting: An experiment related to the stock market , 1972 .

[10]  A. H. Murphy,et al.  Scalar and Vector Partitions of the Probability Score: Part I. Two-State Situation , 1972 .

[11]  A. H. Murphy,et al.  The Use of Probabilities in Subjective Quantitative Precipitation Forecasts: Some Experimental Results , 1985 .

[12]  John B. Kidd,et al.  Scoring Rules for Subjective Assessments , 1975 .

[13]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[14]  R. Ball,et al.  An empirical evaluation of accounting income numbers , 1968 .

[15]  P. A. Adams,et al.  Training in confidence-judgments. , 1958, The American journal of psychology.

[16]  Peter Ayton,et al.  Subjective confidence in forecasts: A response to fischhoff and MacGregor , 1986 .

[17]  G. Brier,et al.  External correspondence: Decompositions of the mean probability score , 1982 .

[18]  J. Frank Yates,et al.  Probabilistic forecasts of stock prices and earnings: The hazards of nascent expertise , 1991 .

[19]  M. Moriarty,et al.  Design Features of Forecasting Systems Involving Management Judgments , 1985 .

[20]  B. Fischhoff,et al.  Training for calibration. , 1980 .

[21]  D. Friedman.  Effective Scoring Rules for Probabilistic Forecasts , 1983 .

[22]  David L. Ronis,et al.  Components of probability judgment accuracy: Individual consistency and effects of subject matter and assessment method. , 1987 .

[23]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[24]  Ralf E. Schaefer,et al.  The assessment of subjective probability distributions: A training experiment☆ , 1973 .

[25]  B. Fischhoff,et al.  Calibration of probabilities: the state of the art to 1980 , 1982 .

[26]  Stuart Oskamp,et al.  The relationship of clinical experience and training methods to several criteria of clinical prediction. , 1962 .

[27]  J. B. Wallace,et al.  A STUDY OF THE PERFORMANCE OF SUBJECTIVE PROBABILITY ASSESSORS , 1974 .

[28]  R. L. Winkler.  Scoring Rules and the Evaluation of Probability Assessors , 1969 .

[29]  Robin M. Hogarth,et al.  Cognitive Processes and the Assessment of Subjective Probability Distributions , 1975 .

[30]  J. Frank Yates,et al.  Analyzing the accuracy of probability judgments for multiple events: An extension of the covariance decomposition , 1988 .

[31]  A. H. Murphy.  A New Vector Partition of the Probability Score , 1973 .

[32]  E. Fama.  The Behavior of Stock-Market Prices , 1965 .