Effects of judges' forecasting on their later combination of forecasts for the same outcomes

Abstract In a first experiment, we show that judges' ability to combine forecasts that they receive from more knowledgeable advisors is impaired when they have previously made their own forecasts for the same outcomes. It appears that they implicitly include their own forecasts among those that have to be combined. In a second experiment, we demonstrate that people combining forecasts put more weight on forecasts that are their own (whether or not they are labelled as such) or are labelled as their own (when they are not) than on equivalent forecasts that are neither their own nor labelled as such. We argue that the cognitive mechanisms responsible for these effects are better characterized as a type of conservatism rather than as an example of anchoring. Our results imply that people responsible for integrating forecasts from more knowledgeable advisors should not explicitly include their own forecasts among those that they combine and should consider avoiding making their own forecasts altogether.

[1]  M. O'Connor,et al.  Judgemental and statistical time series forecasting: a review of the literature , 1996 .

[2]  N. Sanders,et al.  Forecasting Practices in US Corporations: Survey Results , 1994 .

[3]  Robert Fildes,et al.  The evaluation of extrapolative forecasting methods , 1992 .

[4]  Theresa M. Marteau,et al.  Cognitive factors in the explanation of the mismatch between confidence and competence in performing basic life support , 1989 .

[5]  Nada R. Sanders,et al.  Accuracy of judgmental forecasts: A comparison , 1992 .

[6]  Nigel Harvey,et al.  Relations between confidence and skilled performance , 1994 .

[7]  Marcus O'Connor,et al.  Exploring judgemental forecasting , 1992 .

[8]  Baruch Fischhoff,et al.  Response Mode, Framing and Information-processing Effects in Risk Assessment , 1988 .

[9]  Arnold Reisman.  Creativity in MS/OR: Expanding Knowledge by Consolidating Knowledge , 1994 .

[10]  R. H. Edmundson,et al.  The accuracy of combining judgemental and statistical forecasts , 1986 .

[11]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[12]  P. Koele.  The influence of labeled stimuli on nonlinear multiple-cue probability learning , 1980 .

[13]  Joa Sang Lim,et al.  Judgmental forecasting with time series and causal information , 1996 .

[14]  Thomas R. Stewart,et al.  Seven components of judgmental forecasting skill: Implications for research and the improvement of forecasts , 1994 .

[15]  Nigel Harvey,et al.  Confidence judgments by actors and observers , 1997 .

[16]  N Harvey,et al.  Taking advice, using information and knowing what you are doing. , 2000, Acta psychologica.

[17]  N. Harvey,et al.  Vocal matching of pitch intervals: Learning and transfer effects' , 1987 .

[18]  R. Cattell,et al.  Formal representation of human judgment , 1968 .

[19]  Marcus O'Connor,et al.  An examination of the accuracy of judgmental extrapolation of time series , 1985 .

[20]  Paul Goodwin,et al.  Heuristics, biases and improvement strategies in judgmental time series forecasting , 1994 .

[21]  J. Baron.  Thinking and Deciding , 2023 .

[22]  Fred L. Collopy,et al.  Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons , 1992 .

[23]  B. Fischhoff,et al.  Judged frequency of lethal events , 1978 .

[24]  W. Kaye,et al.  Resuscitation: experience without feedback increases confidence but not skill. , 1990, BMJ.

[25]  Eric J. Johnson,et al.  The limits of anchoring. , 1994 .

[26]  J. Scott Armstrong,et al.  Principles of forecasting : a handbook for researchers and practitioners , 2001 .

[27]  Allen Parducci,et al.  Happiness, Pleasure, and Judgment: The Contextual Theory and Its Applications , 1995 .

[28]  T. K. Srull,et al.  The Role of Category Accessibility in the Interpretation of Information About Persons: Some Determinants and Implications , 1979 .

[29]  P. Miller.  Do labels mislead? A multiple cue study, within the framework of brunswik's probabilistic functionalism , 1971 .

[30]  S. Link,et al.  Bias in Quantifying Judgments , 1989 .

[31]  E. Poulton.  Behavioral decision theory : a new approach , 1994 .

[32]  P. Muchinsky,et al.  Human inference behavior in abstract and meaningful environments , 1975 .

[33]  Du Charme,et al.  A response bias explanation of conservative human inference , 1969 .

[34]  T. R. Stewart.  A Decomposition of the Correlation Coefficient and its Use in Analyzing Forecasting Skill , 1990 .

[35]  Laureen A. Maines.  An experimental examination of subjective forecast combination , 1996 .

[36]  Nigel Harvey,et al.  Combining forecasts: What information do judges need to outperform the simple average? , 1999 .

[37]  Pierre Perruchet,et al.  A subjective unit formation account of implicit learning , 1997 .

[38]  Spyros Makridakis,et al.  Factors affecting judgmental forecasts and confidence intervals , 1989 .

[39]  Eric J. Johnson,et al.  Anchoring, Activation, and the Construction of Values. , 1999, Organizational behavior and human decision processes.

[40]  Ward Edwards,et al.  Judgment under uncertainty: Conservatism in human information processing , 1982 .

[41]  Pam Angus-Leppan,et al.  The Forecasting Accuracy of Trainee Accountants Using Judgemental and Statistical Techniques , 1986 .

[42]  Thomas Mussweiler,et al.  Hypothesis-consistent testing and semantic priming in the anchoring paradigm: A selective accessibility model. , 1999 .

[43]  P. Muchinsky,et al.  The influence of a suppressor variable and labeled stimuli on multiple cue probability learning , 1974 .

[44]  A. Baddeley.  Human Memory: Theory and Practice, Revised Edition , 1990 .

[45]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[46]  W. Ducharme.  Response bias explanation of conservative human inference. , 1970 .

[47]  J. A. Sniezek.  The role of variable labels in cue probability learning tasks , 1986 .

[48]  Fischer,et al.  Using Advice and Assessing Its Quality. , 2000, Organizational behavior and human decision processes.

[49]  L. Tucker.  A SUGGESTED ALTERNATIVE FORMULATION IN THE DEVELOPMENTS BY HURSCH, HAMMOND, AND HURSCH, AND BY HAMMOND, HURSCH, AND TODD. , 1964, Psychological review.

[50]  Ray W. Cooksey,et al.  Judgment analysis : theory, methods, and applications , 1996 .

[51]  M. O'Connor,et al.  Judgemental adjustment of initial forecasts: Its effectiveness and biases , 1995 .

[52]  F. Bolger,et al.  Graphs versus tables: Effects of data presentation format on judgemental forecasting , 1996 .

[53]  I. Eggleton.  Intuitive Time-Series Extrapolation , 1982 .

[54]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[55]  J. C. Naylor,et al.  Characteristics of the human inference process in complex choice behavior situations , 1966 .

[56]  W. S. Rholes,et al.  Category accessibility and impression formation , 1977 .

[57]  Z. Dienes,et al.  The role of specific instances in controlling a dynamic system , 1995 .

[58]  L. Adelman.  The influence of formal, substantive, and contextual task properties on the relative effectiveness of different forms of feedback in multiple-cue probability learning tasks☆ , 1981 .

[59]  F. Strack,et al.  Explaining the Enigmatic Anchoring Effect: Mechanisms of Selective Accessibility , 1997 .

[60]  J. Yates,et al.  How quantity judgment changes as the number of cues increases: An analytical framework and review. , 1992 .

[61]  Ernest T. Goetz,et al.  Feedback and practice as variables in error detection and correction. , 1973, Journal of motor behavior.

[62]  John D. Sterman,et al.  Learning in and about complex systems , 1994 .

[63]  D. Kahneman,et al.  Measures of Anchoring in Estimation Tasks , 1995 .

[64]  O. Svenson.  ARE WE ALL LESS RISKY AND MORE SKILLFUL THAN OUR FELLOW DRIVERS , 1981 .

[65]  Wilpen L. Gorr,et al.  ACCURACY OF JUDGMENTAL FORECASTING OF TIME SERIES , 1985 .

[66]  Peter Ayton,et al.  Organizational Behavior and Human Decision Processes Judgments of Decision Effectiveness: Actor–observer Differences in Overconfidence Straints. Recently, the Processes Underlying Judgmental and the Possibility That the Costs of Moving Further , 2022 .

[67]  D. Berry.  How implicit is implicit learning , 1997 .

[68]  Frank P. McKenna,et al.  It won't happen to me: Unrealistic optimism or illusion of control? , 1993 .

[69]  Nigel Harvey,et al.  Context-Sensitive Heuristics in Statistical Reasoning , 1993 .

[70]  W. Edwards,et al.  Conservatism in a simple probability inference task. , 1966, Journal of experimental psychology.

[71]  N. Harvey,et al.  Taking Advice: Accepting Help, Improving Judgment, and Sharing Responsibility☆☆☆ , 1997 .