Curbing Optimism Bias and Strategic Misrepresentation in Planning: Reference Class Forecasting in Practice

Absract The American Planning Association recently endorsed a new forecasting method called reference class forecasting, which is based on theories of planning and decision-making that won the 2002 Nobel prize in economics. This paper details the method and describes the first instance of reference class forecasting in planning practice. First, the paper documents that inaccurate projections of costs, demand, and other impacts of plans are a major problem in planning. Second, the paper explains inaccuracy in terms of optimism bias and strategic misrepresentation. Third, the theoretical basis is presented for reference class forecasting, which achieves accuracy in projections by basing them on actual performance in a reference class of comparable actions and thereby bypassing both optimism bias and strategic misrepresentation. Fourth, the paper presents the first case of practical reference class forecasting, which concerns cost projections for planning of large transportation infrastructure investments in the UK, including the Edinburgh Tram and London's £15 billion Crossrail project. Finally, potentials for and barriers to reference class forecasting are assessed.

[1]  R. L. Henshel,et al.  Forecasting: An Appraisal for Policy-Makers and Planners. , 1978 .

[2]  Bent Flyvbjerg,et al.  Design by Deception: The Politics of Megaproject Approval , 2005 .

[3]  J.H. Vanston,et al.  Testing the tea leaves: evaluating the validity of forecasts , 2005, IEEE Engineering Management Review.

[4]  農林水産奨励会農林水産政策情報センター,et al.  The green book : appraisal and evaluation in central government , 2003 .

[5]  R. Buehler,et al.  Exploring the "planning fallacy": Why people underestimate their task completion times. , 1994 .

[6]  A. Tversky,et al.  Intuitive Prediction: Biases and Corrective Procedures , 1982 .

[7]  Søren L. Buhl,et al.  How (In)accurate Are Demand Forecasts in Public Works Projects?: The Case of Transportation , 2005, 1303.6654.

[8]  A. Nelson Mega-Projects: The Changing Politics of Urban Public Investment , 2004 .

[9]  Martin Wachs,et al.  Ethics and Advocacy in Forecasting for Public Policy , 1990 .

[10]  B. Flyvbjerg,et al.  Megaprojects and Risk: An Anatomy of Ambition , 2004, Perspectives on Politics.

[11]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[12]  Søren L. Buhl,et al.  What Causes Cost Overrun in Transport Infrastructure Projects? , 2004, 1304.4476.

[13]  B. Flyvbjerg Measuring Inaccuracy in Travel Demand Forecasting: Methodological Considerations Regarding Ramp Up and Sampling , 2005, 1303.7401.

[14]  Adrian Davies,et al.  Mega-projects (The changing politics of Urban Public Investment), Alan Altshuler, David Luberoff. Brookings Institution (2003), 399pp., £39.95(hard), £16.75 (soft). , 2005 .

[15]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[16]  D. Kahneman,et al.  Delusions of success. How optimism undermines executives' decisions. , 2003, Harvard business review.

[17]  Lawrence K. Vanston,et al.  Testing the Tea Leaves: Evaluating the Validity of Forecasts , 2004 .

[18]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[19]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[20]  D. Kahneman,et al.  Timid choices and bold forecasts: a cognitive perspective on risk taking , 1993 .

[21]  Nikolaos Zahariadis Megaprojects and Risk: An Anatomy of Ambition , 2004, Perspectives on Politics.

[22]  Procedures for Dealing with Optimism Bias in Transport Planning , 2004 .

[23]  P. Gordon,et al.  The determinants of light-rail transit demand—An international cross-sectional comparison , 1984 .

[24]  Daniel Kahneman New challenges to the rationality assumption , 1994 .

[25]  Søren L. Buhl,et al.  Underestimating Costs in Public Works Projects: Error or Lie? , 2002, 1303.6604.