When should we use simple decision models? A synthesis of various research strands

Many decisions can be analyzed and supported by quantitative models. These models tend to be complex psychologically in that they require the elicitation and combination of quantities such as probabilities, utilities, and weights. They may be simplified so that they become more transparent, and lead to increased trust, reflection, and insight. These potential benefits of simplicity should be weighed against its potential costs, notably possible decreases in performance. We review and synthesize research that has used mathematical analyses and computer simulations to investigate if and when simple models perform worse, equal, or better than more complex models. Various research strands have pursued this, but have not reached the same conclusions: Work on frequently repeated decisions as in inference and forecasting—which typically are operational and involve one or a few decision makers—has put forth conditions under which simple models are more accurate than more complex ones, and some researchers have proposed that simple models should be preferred. On the other hand, work on more or less one-off decisions as in preference and multi-criteria analysis—which typically are strategic and involve group decision making and multiple stakeholders—has concluded that simple models can at best approximate satisfactorily the more complex models. We show how these conclusions can be reconciled. Additionally, we discuss the theory available for explaining the relative performance of simple and more complex models. Finally, we present an aid to help determine if a simple model should be used, or not, for a particular type of decision problem.

[1]  Özgür Simsek,et al.  Linear decision rule as aspiration for simple decision heuristics , 2013, NIPS.

[2]  Aris A. Syntetos,et al.  Bias-Variance Trade-offs in Demand Forecasting , 2016 .

[3]  Robin M. Hogarth,et al.  Simple Models for Multiattribute Choice with Many Alternatives: When It Does and Does Not Pay to Face Trade-offs with Binary Attributes , 2005, Manag. Sci..

[4]  Andreas Graefe,et al.  Improving Forecasts Using Equally Weighted Predictors , 2013 .

[5]  Mohammed Abdellaoui,et al.  Loss Aversion Under Prospect Theory: A Parameter-Free Measurement , 2007, Manag. Sci..

[6]  Milosz Kadzinski,et al.  Stochastic ordinal regression for multiple criteria sorting problems , 2013, Decis. Support Syst..

[7]  Fotios Petropoulos,et al.  Is there a Golden Rule , 2015 .

[8]  T. Stewart Simplified approaches for multicriteria decision making under uncertainty , 1995 .

[9]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[10]  Jan K. Woike,et al.  Journal of Mathematical Psychology Categorization with Limited Resources: a Family of Simple Heuristics , 2022 .

[11]  U. Hoffrage,et al.  Fast, frugal, and fit: Simple heuristics for paired comparison , 2002 .

[12]  Rob J Hyndman,et al.  A state space framework for automatic forecasting using exponential smoothing methods , 2002 .

[13]  Peter P. Wakker,et al.  Making Descriptive Use of Prospect Theory to Improve the Prescriptive Use of Expected Utility , 2001, Manag. Sci..

[14]  Simon French,et al.  Decision Behaviour, Analysis and Support , 2009 .

[15]  Paul Goodwin High on Complexity, Low on Evidence: Are Advanced Forecasting Methods Always as Good as They Seem? , 2011 .

[16]  Kaisa Miettinen,et al.  Determining the implementation order of a general plan by using a multicriteria method , 1998 .

[17]  Bruce G. S. Hardie,et al.  A Dynamic Changepoint Model for New Product Sales Forecasting , 2004 .

[18]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[19]  Konstantinos V. Katsikopoulos,et al.  Why Do Simple Heuristics Perform Well in Choices with Binary Attributes? , 2013, Decis. Anal..

[20]  Jonathan N. Crook,et al.  Credit Scoring and Its Applications , 2002, SIAM monographs on mathematical modeling and computation.

[21]  L. Phillips A theory of requisite decision models , 1984 .

[22]  Paul D. Thorn,et al.  The Revenge of Ecological Rationality: Strategy-Selection by Meta-Induction Within Changing Environments , 2015, Minds and Machines.

[23]  B. Roy Méthodologie multicritère d'aide à la décision , 1985 .

[24]  Spyros Makridakis,et al.  Forecasting and uncertainty in the economic and business world , 2009 .

[25]  Nigel Meade,et al.  Forecasting in telecommunications and ICT—A review , 2015 .

[26]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[27]  Kesten C. Green,et al.  Simple Versus Complex Forecasting: The Evidence , 2015 .

[28]  Ralph Hertwig,et al.  The robust beauty of ordinary information. , 2010, Psychological review.

[29]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[30]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[31]  Jerome H. Friedman,et al.  On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality , 2004, Data Mining and Knowledge Discovery.

[32]  Michèle Hibon,et al.  Accuracy of Forecasting: An Empirical Investigation , 1979 .

[33]  Melvyn Sim,et al.  The Price of Robustness , 2004, Oper. Res..

[34]  Gerd Gigerenzer,et al.  How bad is incoherence , 2016 .

[35]  Cutting,et al.  Accuracy, Scope, and Flexibility of Models. , 2000, Journal of mathematical psychology.

[36]  Kesten C. Green,et al.  Golden Rule of Forecasting: Be Conservative , 2015 .

[37]  Haiyan Song,et al.  A meta-analysis of international tourism demand forecasting and implications for practice , 2014 .

[38]  C. Kirkwood Estimating the Impact of Uncertainty on a Deterministic Multiattribute Evaluation , 1992 .

[39]  Zbigniew Michalewicz,et al.  The relationship between model complexity and forecasting performance for computer intelligence optimization in finance , 2016 .

[40]  Stephan Kolassa Sometimes It's Better to Be Simple than Correct , 2016 .

[41]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[42]  P. Lovie,et al.  The flat maximum effect and linear scoring models for prediction , 1986 .

[43]  J. Rezaei Best-worst multi-criteria decision-making method: Some properties and a linear model , 2016 .

[44]  Ulrich Schmidt,et al.  Additive Utility in Prospect Theory , 2009, Manag. Sci..

[45]  Marcus Buckmann,et al.  Learning From Small Samples: An Analysis of Simple Decision Heuristics , 2015, NIPS.

[46]  José Rui Figueira,et al.  The SMAA-PROMETHEE method , 2014, Eur. J. Oper. Res..

[47]  Peter P. Wakker,et al.  Utility Independence of Multiattribute Utility Theory is Equivalent to Standard Sequence Invariance of Conjoint Measurement , 2011 .

[48]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[49]  Ian N. Durbach,et al.  Modelling uncertainty in stochastic multicriteria acceptability analysis , 2016 .

[50]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[51]  Ian N. Durbach,et al.  Using expected values to simplify decision making under uncertainty , 2009 .

[52]  T. Stewart,et al.  A comparison of simplified value function approaches for treating uncertainty in multi-criteria decision analysis , 2012 .

[53]  Konstantinos V. Katsikopoulos,et al.  Rationality in systems engineering: Beyond calculation or political action , 2008 .

[54]  Florian von Wangenheim,et al.  Instant Customer Base Analysis: Managerial Heuristics Often “Get it Right”: , 2008 .

[55]  I. Durbach Outranking under uncertainty using scenarios , 2014, Eur. J. Oper. Res..

[56]  Aoife Foley,et al.  Current methods and advances in forecasting of wind power generation , 2012 .

[57]  Konstantinos V. Katsikopoulos,et al.  On the role of psychological heuristics in operational research; and a demonstration in military stability operations , 2016, Eur. J. Oper. Res..

[58]  Steven C. Wheelwright,et al.  Forecasting methods and applications. , 1979 .

[59]  Risto Lahdelma,et al.  SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making , 2001, Oper. Res..

[60]  G. Gigerenzer,et al.  The bias bias , 2015 .

[61]  Peter M. Todd,et al.  How much information do we need? , 2007, Eur. J. Oper. Res..

[62]  Byeong Seok Ahn,et al.  Comparing methods for multiattribute decision making with ordinal weights , 2008, Comput. Oper. Res..

[63]  Spyros Makridakis,et al.  The M3-Competition: results, conclusions and implications , 2000 .

[64]  D. E. Bell,et al.  Decision Making: DESCRIPTIVE, NORMATIVE, AND PRESCRIPTIVE INTERACTIONS IN DECISION MAKING , 1988 .

[65]  D. Goldstein,et al.  How good are simple heuristics , 1999 .

[66]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[67]  Peter S. Fader,et al.  An Empirical Comparison of New Product Trial Forecasting Models , 1998 .

[68]  C. Kirkwood,et al.  The Effectiveness of Partial Information about Attribute Weights for Ranking Alternatives in Multiattribute Decision Making , 1993 .

[69]  Konstantinos V. Katsikopoulos,et al.  Psychological Heuristics for Making Inferences: Definition, Performance, and the Emerging Theory and Practice , 2011, Decis. Anal..

[70]  Juan A. Carrasco,et al.  Cumulative dominance and heuristic performance in binary multi-attribute choice , 2006 .

[71]  Gerd Gigerenzer,et al.  Taking Uncertainty Seriously: Simplicity versus Complexity in Financial Regulation , 2014, Industrial and Corporate Change.

[72]  Luc Laeven,et al.  Resolution of Banking Crises: The Good, the Bad, and the Ugly , 2010 .

[73]  Byeong Seok Ahn,et al.  Compatible weighting method with rank order centroid: Maximum entropy ordered weighted averaging approach , 2011, Eur. J. Oper. Res..

[74]  Detlof von Winterfeldt,et al.  Anniversary Article: Decision Analysis in Management Science , 2004, Manag. Sci..

[75]  P. Slovic The Construction of Preference , 1995 .

[76]  T. Stewart Robustness of Additive Value Function Methods in MCDM , 1996 .

[77]  M. Abdellaoui Parameter-Free Elicitation of Utility and Probability Weighting Functions , 2000 .

[78]  P. Tetlock Expert Political Judgment: How Good Is It? How Can We Know? , 2005 .

[79]  Aris A. Syntetos,et al.  On the categorization of demand patterns , 2005, J. Oper. Res. Soc..

[80]  Simon French,et al.  Cynefin, statistics and decision analysis , 2013, J. Oper. Res. Soc..

[81]  Fotios Petropoulos,et al.  Forecasting for big data: Does suboptimality matter? , 2018, Comput. Oper. Res..

[82]  Martin Egozcue,et al.  Cumulative dominance in multi-attribute choice: benefits and limits , 2014 .

[83]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[84]  Konstantinos Nikolopoulos,et al.  Forecasting with cue information: A comparison of multiple regression with alternative forecasting approaches , 2007, Eur. J. Oper. Res..