Forecasting and Planning: An Evaluation

The formal practice of forecasting and planning F&P has risen to prominence within a few decades and now receives considerable attention from both academics and practitioners. This paper explicitly recognizes the nature of F&P as future-oriented decision making activities and, as such, their dependence upon judgmental inputs. A review of the extensive psychological literature on human judgmental abilities is provided from this perspective. It is argued that many of the numerous information processing limitations and biases revealed in this literature apply to tasks performed in F&P. In particular, the "illusion of control," accumulation of redundant information, failure to seek possible disconfirming evidence, and overconfidence in judgment are liable to induce serious errors in F&P. In addition, insufficient attention has been given to the implications of numerous studies that show that the predictive judgment of humans is frequently less accurate than that of simple quantitative models. Applied studies of F&P are also reviewed and shown to mirror many of the findings from psychology. The paper subsequently draws implications from these reviews and suggests reconceptualizing F&P through use of decision-theoretic concepts. At the organizational level this involves recognizing that F&P may perform many, often conflicting, manifest and latent functions which should be identified and evaluated through a multi-attribute utility framework. Operationally, greater use should be made of sensitivity analysis and the concept of the value of information.

[1]  Ivison Ra The concept of competence. , 1971 .

[2]  Du Charme,et al.  A response bias explanation of conservative human inference , 1969 .

[3]  G. F. White,et al.  Decision processes, rationality and adjustment to natural hazards , 1974 .

[4]  W E Woodson,et al.  Human Factors in Electronics. , 1964, Science.

[5]  B. Fischhoff,et al.  Judged frequency of lethal events , 1978 .

[6]  Kichiro Hayashi,et al.  Corporate Planning Practices in Japanese Multinational , 1978 .

[7]  Paul C. Nutt,et al.  An Experimental Comparison of the Effectiveness of Three Planning Methods , 1977 .

[8]  P. Slovic,et al.  Dominance of accuracy information and neglect of base rates in probability estimation , 1976 .

[9]  L. Brown,et al.  The Superiority of Analyst Forecasts as Measures of Expectations: Evidence from Earnings , 1978 .

[10]  J. Sawyer,et al.  Measurement and prediction, clinical and statistical. , 1966, Psychological bulletin.

[11]  Howard Kunreuther,et al.  Extensions of Bowman's Theory on Managerial Decision-Making , 1969 .

[12]  R. Hogarth Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics. , 1981 .

[13]  Paul Slovic,et al.  Comparison of Bayesian and Regression Approaches to the Study of Information Processing in Judgment. , 1971 .

[14]  A. Cowles Can Stock Market Forecasters Forecast , 1933 .

[15]  Ronald J. Ebert,et al.  Bootstrapping the security analyst. , 1978 .

[16]  J. Bruner,et al.  On the perception of incongruity; a paradigm. , 1949, Journal of personality.

[17]  B. Brehmer Social Judgment Theory and the Analysis of Interpersonal Conflict. , 1976 .

[18]  Peter Wright The harassed decision maker: Time pressures, distractions, and the use of evidence. , 1974 .

[19]  E. Elton,et al.  Earnings Estimates and the Accuracy of Expectational Data , 1972 .

[20]  N. Maier Reasoning in humans. II. The solution of a problem and its appearance in consciousness. , 1931 .

[21]  E. Brunswik Organismic achievement and environmental probability. , 1943 .

[22]  David F. Lancy,et al.  Likeness and Likelihood in Everyday Thought: Magical Thinking in Judgments About Personality [and Comments and Reply] , 1977, Current Anthropology.

[23]  I. Janis,et al.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment , 1977 .

[24]  H. Simon,et al.  Selective perception: A note on the departmental identifications of executives. , 1958 .

[25]  E. Langer The illusion of control. , 1975 .

[26]  John Cohen,et al.  A CONFIRMATION OF THE INERTIAL‐ψ EFFECT IN SEQUENTIAL CHOICE AND DECISION , 1972 .

[27]  Lewis R. Goldberg,et al.  Man versus model of man: A rationale, plus some evidence, for a method of improving on clinical inferences. , 1970 .

[28]  Dale W. Jorgenson,et al.  The Predictive Performance of Econometric Models of Qtrly Investment Behavior , 1970 .

[29]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[30]  Robert Libby,et al.  Man versus model of man: some conflicting evidence , 1976 .

[31]  Paul Slovic,et al.  From Shakespeare to Simon: speculations--and some evidence-- about man's ability to process information , 1972 .

[32]  Michèle Hibon,et al.  Accuracy of Forecasting: An Empirical Investigation , 1979 .

[33]  Joshua Ronen,et al.  Effects of some probability displays on choices , 1973 .

[34]  Ronald J. Kudla The Effects of Strategic Planning on Common Stock Returns , 1980 .

[35]  Stuart Oskamp,et al.  The relationship of clinical experience and training methods to several criteria of clinical prediction. , 1962 .

[36]  Han Timmers,et al.  The pond-and-duckweed problem; Three experiments on the misperception of exponential growth , 1979 .

[37]  L. G. Rorer,et al.  Illusory correlation and subjective judgment. , 1972 .

[38]  James G. March,et al.  The Role of Expectations in Business Decision Making , 1958 .

[39]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[40]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  J. Armstrong Forecasting with Econometric Methods: Folklore Versus Fact , 1978 .

[42]  R. LaForge,et al.  The Impact of Comprehensive Planning on Financial Performance , 1979 .

[43]  Hillel J. Einhorn,et al.  Judgment under uncertainty: Learning from experience and suboptimal rules in decision making , 1982 .

[44]  P. K. Leung,et al.  Sensitivity analysis of the effect of variations in the form and parameters of a multiattribute utility model: A survey , 1978 .

[45]  JOHN COHEN,et al.  Evaluation of Compound Probabilities in Sequential Choice , 1971, Nature.

[46]  Robin M. Hogarth,et al.  Cognitive Processes and the Assessment of Subjective Probability Distributions , 1975 .

[47]  C. Pinson Consumer Cognitive Styles: Review and Implications for Marketers , 1978 .

[48]  L. J. Chapman,et al.  Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. , 1969, Journal of abnormal psychology.

[49]  R. L. Cooper The Predictive Performance of Quarterly Econometric Models of the United States , 1972 .

[50]  R. Hogarth Judgement and choice: The psychology of decision , 1982 .

[51]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[52]  Paul Slovic,et al.  Toward understanding and improving decisions , 1982 .

[53]  Eugene Borgida,et al.  The Differential Impact of Abstract vs. Concrete Information on Decisions , 1977 .

[54]  S. Oskamp OVERCONFIDENCE IN CASE-STUDY JUDGMENTS. , 1965, Journal of consulting psychology.

[55]  Ward Edwards,et al.  Judgment under uncertainty: Conservatism in human information processing , 1982 .

[56]  M. Bar-Hillel The base-rate fallacy in probability judgments. , 1980 .

[57]  C. Plott,et al.  Economic Theory of Choice and the Preference Reversal Phenomenon , 1979 .

[58]  P. Slovic,et al.  Value as a Determiner of Subjective Probability , 1966 .

[59]  Elizabeth F Loftus,et al.  Leading questions and the eyewitness report , 1975, Cognitive Psychology.

[60]  Kenneth R. Hammond,et al.  Linking Environmental Models with Models of Human Judgment: A Symmetrical Decision Aid , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[61]  D. Green,et al.  The Predictive Power of First-Quarter Earnings Reports , 1967 .

[62]  Eugene Borgida,et al.  Attribution and the psychology of prediction. , 1975 .

[63]  Aaron Wildavsky,et al.  If planning is everything, maybe it's nothing , 1973 .

[64]  John B. Kidd,et al.  Decision Making and Change in Human Affairs , 1979 .

[65]  R. Dawes,et al.  Linear models in decision making. , 1974 .

[66]  A. Tversky,et al.  Intuitive Prediction: Biases and Corrective Procedures , 1982 .

[67]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[68]  R. Hogarth,et al.  Confidence in judgment: Persistence of the illusion of validity. , 1978 .

[69]  Russell L. Ackoff A concept of corporate planning , 1969 .

[70]  Russell M. Barefield,et al.  The accuracy of analysts' forecasts of earnings per share , 1975 .

[71]  Gene K. Groff Empirical Comparison of Models for Short Range Forecasting , 1973 .

[72]  Eugene Borgida,et al.  Judgment under uncertainty: Popular induction: Information is not necessarily informative , 1982 .

[73]  J. Smedslund THE CONCEPT OF CORRELATION IN ADULTS , 1963 .

[74]  A. Cowles,et al.  Stock Market Forecasting , 1944 .

[75]  R. Ebert Environmental Structure and Programmed Decision Effectiveness , 1972 .

[76]  H. J. Einhorn Use of nonlinear, noncompensatory models as a function of task and amount of information , 1971 .

[77]  R. A. Cosier The effects of three potential aids for making strategic decisions on prediction accuracy , 1978 .

[78]  M. Snyder,et al.  Reconstructing the Past: Some Cognitive Consequences of Person Perception , 1978 .

[79]  Kenneth S. Lorek,et al.  A Comparative Examination of Management Forecasts and Box-Jenkins Forecasts of Earnings , 1976 .

[80]  Joseph Berkson,et al.  THE ERROR OF ESTIMATE OF THE BLOOD CELL COUNT AS MADE WITH THE HEMOCYTOMETER , 1939 .

[81]  BaumanW. Scott The Less Popular Stocks versus the Most Popular Stocks , 1965 .

[82]  John W. Payne,et al.  Task complexity and contingent processing in decision making: An information search and protocol analysis☆ , 1976 .

[83]  Milton Leontiades,et al.  Planning perceptions and planning results , 1980 .

[84]  P. Slovic Choice Between Equally Valued Alternatives. , 1975 .

[85]  B. Fischhoff,et al.  Behavioral Decision Theory , 1977 .

[86]  A. Tversky Intransitivity of preferences. , 1969 .

[87]  B. Fischhoff,et al.  Perceived Informativeness of Facts. , 1977 .

[88]  P. Slovic,et al.  Reversals of preference between bids and choices in gambling decisions. , 1971 .

[89]  L. Ross The Intuitive Psychologist And His Shortcomings: Distortions in the Attribution Process1 , 1977 .

[90]  R. M. Richards,et al.  Analysts' Performance and the Accuracy of Corporate Earnings Forecasts , 1976 .

[91]  R. Dawes A case study of graduate admissions: Application of three principles of human decision making. , 1971 .

[92]  C. W. Anderson,et al.  Decision making in the employment interview , 1964 .

[93]  M. C. Jensen The Performance of Mutual Funds in the Period 1945-1964 , 1967 .

[94]  L. R. Goldberg Man versus model of man: just how conflicting is that evidence? , 1976 .

[95]  L. Ross,et al.  The intuitive psychologist and his shortcomings: Distortions in the attribution process”, in Ed), Advances in Experimental Social New York, pp. . , 1977 .

[96]  D. Campbell Reforms as experiments , 1969 .

[97]  J. Armstrong,et al.  A Comparative Study of Methods for Long-Range Market Forecasting , 1972 .

[98]  R. Monty,et al.  The importance of perceived control: fact or fantasy? , 1977, American scientist.

[99]  W. A. Wagenaar Appreciation of conditional probabilities in binary sequences , 1970 .

[100]  R. Hogarth Methods for Aggregating Opinions , 1977 .

[101]  James A. Senn,et al.  Research in Management Information Systems: The Minnesota Experiments , 1977 .

[102]  J. March Bounded rationality, ambiguity, and the engineering of choice , 1978 .

[103]  N. Anderson,et al.  Effect of stimulus inconsistency and discounting instructions in personality impression formation. , 1965, Journal of personality and social psychology.

[104]  Richard W. Pollay,et al.  The Structure of Executive Decisions and Decision Times. , 1970 .

[105]  Thomas H. Naylor,et al.  Box-Jenkins Methods: An Alternative to Econometric Models , 1972 .

[106]  W. Estes The cognitive side of probability learning. , 1976 .

[107]  Ronald M. Copeland,et al.  Executives' Forecasts of Earnings per Share versus Forecasts of Naive Models , 1972 .

[108]  H. M. Jenkins,et al.  The display of information and the judgment of contingency. , 1965, Canadian journal of psychology.

[109]  Charles F. Gettys,et al.  The best guess hypothesis in multistage inference , 1973 .

[110]  P. Wason On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[111]  J. E. Russo,et al.  The Value of Unit Price Information , 1977 .

[112]  Raymond Radosevich,et al.  Does planning pay? The effect of planning on success of acquisitions in American firms , 1970 .

[113]  H. Morlock,et al.  The effect of outcome desirability on information required for decisions. , 1967, Behavioral science.

[114]  B. Fischhoff,et al.  Knowing with Certainty: The Appropriateness of Extreme Confidence. , 1977 .

[115]  Robert J. House,et al.  Where long-range planning pays off Findings of a survey of formal, informal planners , 1970 .

[116]  H. Liebling,et al.  The Recent Performance of Anticipation Surveys and Econometric Model Projections of Investment Spending in the United States , 1976 .

[117]  Delmar W. Karger,et al.  Long range planning and organizational performance , 1975 .

[118]  Ian I. Mitroff,et al.  Improving the effectiveness of corporate planning , 1978 .

[119]  Carl-Axel S. Staël von Holstein,et al.  Exceptional Paper---Probability Encoding in Decision Analysis , 1975 .

[120]  G. V. Cox Evaluation of Economic Forecasts , 1930 .

[121]  B. Fischhoff,et al.  Fault trees: Sensitivity of estimated failure probabilities to problem representation. , 1978 .

[122]  K Knafl,et al.  Professional socialization in a surgical specialty: Acquiring medical judgment. , 1975, Social science & medicine.

[123]  Bela Gold,et al.  The Shaky Foundations of Capital Budgeting , 1976 .

[124]  Paul Slovic,et al.  Response-induced reversals of preference in gambling: An extended replication in las vegas , 1973 .

[125]  William Remus,et al.  Testing Bowman's Managerial Coefficient Theory Using a Competitive Gaming Environment , 1978 .

[126]  Maya Bar-Hillel,et al.  On the subjective probability of compound events , 1973 .

[127]  H. M. Jenkins,et al.  JUDGMENT OF CONTINGENCY BETWEEN RESPONSES AND OUTCOMES. , 1965, Psychological monographs.

[128]  D. Norburn,et al.  Planning for Existing Markets: Perceptions of Executives and Financial Performance , 1975 .

[129]  Allen Newell,et al.  Human problem solving: The state of the theory in 1970. , 1971 .

[130]  K. A. Ringbakk,et al.  Organised planning in major U.S. companies , 1969 .

[131]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[132]  Burton G. Malkiel,et al.  THE CONSENSUS AND ACCURACY OF SOME PREDICTIONS OF THE GROWTH OF CORPORATE EARNINGS , 1968 .

[133]  W. Ducharme Response bias explanation of conservative human inference. , 1970 .

[134]  R. W. White Motivation reconsidered: the concept of competence. , 1959, Psychological review.

[135]  S. Asch Effects of Group Pressure Upon the Modification and Distortion of Judgments , 1951 .

[136]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[137]  C. Chatfield,et al.  Box‐Jenkins Seasonal Forecasting: Problems in a Case‐Study , 1973 .

[138]  Hillel J. Einhorn,et al.  Expert measurement and mechanical combination , 1972 .

[139]  M. Jarvik,et al.  Probability learning and a negative recency effect in the serial anticipation of alternative symbols. , 1951, Journal of experimental psychology.

[140]  Charles R. Nelson,et al.  The Ex Ante Prediction Performance of the St. Louis and FRB-MIT-PENN Econometric Models and Some Results on Composite Predictors , 1975 .

[141]  Judith Marquand Government economic planning in the United Kingdom , 1978 .

[142]  F. O'carroll Subjective Probabilities and Short‐Term Economic Forecasts: An Empirical Investigation , 1977 .

[143]  Han Timmers,et al.  Intuitive prediction of growth , 1978 .

[144]  J. Scott Armstrong,et al.  Long-Range Forecasting: From Crystal Ball to Computer , 1981 .

[145]  E. H. Bowman Consistency and Optimality in Managerial Decision Making , 1963 .

[146]  Dale T. Miller Ego involvement and attributions for success and failure. , 1976 .

[147]  M. Hammerton,et al.  A case of radical probability estimation. , 1973 .

[148]  A. Tversky,et al.  On the psychology of prediction , 1973 .

[149]  R. Hogarth,et al.  BEHAVIORAL DECISION THEORY: PROCESSES OF JUDGMENT AND CHOICE , 1981 .

[150]  Paul Slovic,et al.  Analyzing the Use of Information in Investment Decision Making: A Methodological Proposal , 1972 .

[151]  V. Mabert STATISTICAL VERSUS SALES FORCE–EXECUTIVE OPINION SHORT RANGE FORECASTS: A TIME SERIES ANALYSIS CASE STUDY , 1976 .

[152]  E. Fama The Behavior of Stock-Market Prices , 1965 .