Judgmental Forecasting: Cognitive Reflection and Decision Speed

This research analyzes how individual differences affect performance in time-series forecasting. Task performance varies based on an individual’s ability to balance intuitive judgment with cognitive deliberation, as measured by the Cognitive Reflection Test. Decision makers with higher cognitive reflection tend to have lower forecast errors, and this result holds when controlling for individual intelligence. Additionally, forecast errors tend to increase when decisions are either very fast or very slow. We provide some evidence that by manipulating decision speed we can influence forecasting performance such that it deteriorates if forecasters are forced to make overly fast or overly slow decisions.

[1]  K. Stanovich,et al.  The Cognitive Reflection Test as a predictor of performance on heuristics-and-biases tasks , 2011, Memory & cognition.

[2]  O. Svenson,et al.  Judgment and Decision Making Under Time Pressure , 1993 .

[3]  Stephen M. Johnson,et al.  The affect heuristic in judgments of risks and benefits , 2000 .

[4]  John W. Payne,et al.  The adaptive decision maker: Name index , 1993 .

[5]  G. Hockey,et al.  Effects of time-pressure on decision-making under uncertainty: changes in affective state and information processing strategy. , 2000, Acta psychologica.

[6]  R. Moyer,et al.  Mental comparison and the symbolic distance effect , 1976, Cognitive Psychology.

[7]  V. Reyna,et al.  Fuzzy-trace theory: An interim synthesis , 1995 .

[8]  Gerd Gigerenzer,et al.  Fast and frugal forecasting , 2009 .

[9]  C B Dodrill,et al.  Further studies of the Wonderlic Personnel Test as a brief measure of intelligence. , 1988, Journal of consulting and clinical psychology.

[10]  T. Goschke,et al.  On the speed of intuition: Intuitive judgments of semantic coherence under different response deadlines , 2005, Memory & cognition.

[11]  Ann Langley,et al.  Between 'Paralysis by Analysis' and 'Extinction by Instinct' , 1995 .

[12]  S. Frederick Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[13]  Edward T. Cokely,et al.  Measuring Risk Literacy: The Berlin Numeracy Test , 2012, Judgment and Decision Making.

[14]  Nigel Harvey,et al.  Use of heuristics: Insights from forecasting research , 2007, Thinking & Reasoning.

[15]  Martin Weber,et al.  Reference-Point Formation and Updating , 2011, Manag. Sci..

[16]  Fabio Del Missier,et al.  Decision-making Competence, Executive Functioning, and General Cognitive Abilities , 2012 .

[17]  P. Goodwin,et al.  Judgmental forecasting: A review of progress over the last 25 years , 2006 .

[18]  G. Keren,et al.  Two Is Not Always Better Than One , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.

[19]  Andreas Roider,et al.  Cognitive Abilities and Behavioral Biases , 2009, SSRN Electronic Journal.

[20]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[21]  Werner F. M. De Bondt,et al.  Betting on trends: Intuitive forecasts of financial risk and return , 1993 .

[22]  Dorwin Cartwright,et al.  Relation of Decision-Time to the Categories of Response , 1941 .

[23]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[24]  Nigel Harvey,et al.  Context-Sensitive Heuristics in Statistical Reasoning , 1993 .

[25]  H. Simon,et al.  Making Management Decisions: the Role of Intuition and Emotion , 1987 .

[26]  V. Reyna CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE How People Make Decisions That Involve Risk A Dual-Processes Approach , 2022 .

[27]  U. Fischbacher z-Tree: Zurich toolbox for ready-made economic experiments , 1999 .

[28]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[29]  C. Dodrill,et al.  Long-term reliability of the Wonderlic Personnel Test. , 1983 .

[30]  W. Gaissmaier,et al.  The smart potential behind probability matching , 2008, Cognition.

[31]  Edward T. Cokely,et al.  Cognitive abilities and superior decision making under risk: A protocol analysis and process model evaluation , 2009, Judgment and Decision Making.

[32]  Erik Dane,et al.  Exploring Intuition and its Role in Managerial Decision Making , 2007 .

[33]  Spyros Makridakis,et al.  Factors affecting judgmental forecasts and confidence intervals , 1989 .

[34]  S. Epstein Integration of the cognitive and the psychodynamic unconscious. , 1994, The American psychologist.

[35]  A. Rustichini Neuroeconomics: Formal models of decision making and cognitive neuroscience , 2008 .

[36]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[37]  K. Stanovich,et al.  Individual differences in reasoning: Implications for the rationality debate? , 2000, Behavioral and Brain Sciences.

[38]  Enno Siemsen,et al.  Demand Forecasting Behavior: System Neglect and Change Detection , 2011, Manag. Sci..

[39]  K. Donohue,et al.  Individual differences in the newsvendor problem: Behavior and cognitive reflection , 2013 .

[40]  Francis de Véricourt,et al.  Sex, Risk and the Newsvendor , 2013 .

[41]  William Remus,et al.  Judgemental forecasting in times of change , 1993 .

[42]  J. Kihlstrom The cognitive unconscious. , 1987, Science.

[43]  Rogelio Oliva,et al.  Managing Functional Biases in Organizational Forecasts: A Case Study of Consensus Forecasting in Supply Chain Planning , 2009, Production and Operations Management.

[44]  V. Reyna,et al.  How numeracy influences risk comprehension and medical decision making. , 2009, Psychological bulletin.

[45]  David Cesarini,et al.  The Behavioral Genetics of Behavioral Anomalies , 2012, Manag. Sci..

[46]  David E. Cantor,et al.  Decision-making in the supply chain: Examining problem solving approaches and information availability , 2009 .

[47]  Philip Hans Franses,et al.  Experts' Stated Behavior , 2009, Interfaces.

[48]  D. Kahneman A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[49]  Nada R. Sanders,et al.  The efficacy of using judgmental versus quantitative forecasting methods in practice , 2003 .

[50]  C. K. Mertz,et al.  PSYCHOLOGICAL SCIENCE Research Article Numeracy and Decision Making , 2022 .

[51]  Timothy D. Wilson,et al.  Thinking too much: introspection can reduce the quality of preferences and decisions. , 1991, Journal of personality and social psychology.

[52]  E. Bonabeau Don't trust your gut. , 2003, Harvard business review.

[53]  G. Gigerenzer,et al.  Intuitive and Deliberate Judgments Are Based on Common Principles This Article Has Been Corrected. See Last Page , 2022 .