The Delphi method in forecasting financial markets— An experimental study

Experts were used as Delphi panellists and asked to present forecasts on financial market variables in a controlled experiment. We found that the respondents with the least accurate or least conventional views were particularly likely to modify their answers. Most of these modifications were in the right direction but too small, probably because of belief-perseverance bias. This paper also presents two post-survey adjustment methods for Delphi method based forecasts. First, we present a potential method to correct for the belief perseverance bias. The results seem promising. Secondly, we test a conditional forecasting process, which unexpectedly proves unsuccessful.

[1]  Murray Turoff,et al.  Delphi: A brief look backward and forward , 2011 .

[2]  Haiyan Song,et al.  Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system , 2013 .

[3]  J. Armstrong,et al.  Findings from Evidence-Based Forecasting: Methods for Reducing Forecast Error , 2006 .

[4]  Andrew Stranieri,et al.  Does the Delphi process lead to increased accuracy in group-based judgmental forecasts or does it simply induce consensus amongst judgmental forecasters ? , 2011 .

[5]  Inga-Lena Darkow,et al.  Validating an innovative real-time Delphi approach - A methodological comparison between real-time and conventional Delphi studies , 2011 .

[6]  Olaf Helmer.  CONVERGENCE OF EXPERT CONSENSUS THROUGH FEEDBACK , 1964 .

[7]  Roger G. Schroeder,et al.  Incorporating Judgments in Sales Forecasts: Application of the Delphi Method at American Hoist & Derrick , 1977 .

[8]  Daniel F. Waggoner,et al.  Conditional Forecasts in Dynamic Multivariate Models , 1998, Review of Economics and Statistics.

[9]  F. Woudenberg.  An Evaluation of Delphi , 1991 .

[10]  George Wright,et al.  Expert Opinions in Forecasting: The Role of the Delphi Technique , 2001 .

[11]  N. Kerr,et al.  Group-based forecasting?: A social psychological analysis , 2011 .

[12]  Norman Crolee Dalkey,et al.  Experiments in Group Prediction , 1968 .

[13]  Caroline Hussler,et al.  Is diversity in Delphi panelist groups useful? Evidence from a French forecasting exercise on the future of nuclear energy , 2011 .

[14]  Steven J. Sherman,et al.  Social explanation: The role of timing, set, and recall on subjective likelihood estimates. , 1983 .

[15]  L. Ross,et al.  Perseverance of Social Theories: The Role of Explanation in the Persistence of Discredited Information , 1980 .

[16]  Gerlinde Fellner,et al.  Judgmental overconfidence: Three measures, one bias? , 2012 .

[17]  Klaus Adam,et al.  Experimental Evidence on the Persistence of Output and Inflation , 2005, SSRN Electronic Journal.

[18]  W. E. Riggs,et al.  The Delphi technique: An experimental evaluation , 1983 .

[19]  Murray Turoff,et al.  The Delphi Method: Techniques and Applications , 1976 .

[20]  Heiko A. Gracht,et al.  Desirability bias in foresight: Consequences for decision quality based on Delphi results , 2011 .

[21]  Murray Turoff,et al.  An alternative approach to cross impact analysis , 1971 .

[22]  J. Armstrong.  Significance Tests Harm Progress in Forecasting , 2007 .

[23]  J. Scott Armstrong,et al.  University of Pennsylvania Scholarlycommons Comparing Face-to-face Meetings, Nominal Groups, Delphi and Prediction Markets on an Estimation Task Comparing Face-to-face Meetings, Nominal Groups, Delphi and Prediction Markets on an Estimation Task Comparing Face-to-face Meetings, Nominal Groups, Delph , 2022 .

[24]  Frederick J. Parenté,et al.  An examination of factors contributing to delphi accuracy , 1984 .

[25]  George Wright,et al.  The Delphi technique as a forecasting tool: issues and analysis , 1999 .

[26]  R. Nickerson.  Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[27]  A. Tversky,et al.  Support theory: A nonextensional representation of subjective probability. , 1994 .

[28]  Marcus O'Connor,et al.  The effect of group interaction processes on performance in time series extrapolation , 1991 .

[29]  Joel L. Schrag,et al.  First Impressions Matter: A Model of Confirmatory Bias , 1999 .

[30]  Rick Parente,et al.  The Delphi method, impeachment and terrorism: Accuracies of short-range forecasts for volatile world events , 2005 .

[31]  George Wright,et al.  The impact of task characteristics on the performance of structured group forecasting techniques , 1996 .

[32]  George Wright,et al.  Delphi: A reevaluation of research and theory , 1991 .

[33]  Heiko A. von der Gracht,et al.  Consensus measurement in Delphi studies , 2012 .

[34]  L. Ross,et al.  Biased Assimilation and Attitude Polarization: The Effects of Prior Theories on Subsequently Considered Evidence , 1979 .

[35]  Theodore J. Gordon,et al.  RT Delphi: An efficient, “round-less” almost real time Delphi method ☆ , 2006 .