FFTrees: A toolbox to create, visualize, and evaluate fast-and-frugal decision trees

Fast-and-frugal trees (FFTs) are simple algorithms that facilitate efficient and accurate decisions based on limited information. But despite their successful use in many applied domains, there is no widely available toolbox that allows anyone to easily create, visualize, and evaluate FFTs. We fill this gap by introducing the R package FFTrees. In this paper, we explain how FFTs work, introduce a new class of algorithms called fan for constructing FFTs, and provide a tutorial for using the FFTrees package. We then conduct a simulation across ten real-world datasets to test how well FFTs created by FFTrees can predict data. Simulation results show that FFTs created by FFTrees can predict data as well as popular classification algorithms such as regression and random forests, while remaining simple enough for anyone to understand and use.

[1]  Hansjörg Neth,et al.  Heuristics: Tools for an Uncertain World , 2015 .

[2]  David H. Wolpert,et al.  The Existence of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[3]  S. Trzeciak,et al.  Emergency department overcrowding in the United States: an emerging threat to patient safety and public health , 2003, Emergency medicine journal : EMJ.

[4]  Gerd Gigerenzer,et al.  Taking Uncertainty Seriously: Simplicity versus Complexity in Financial Regulation , 2014, Industrial and Corporate Change.

[5]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[6]  Jan K. Woike,et al.  Picking profitable investments : the success of equal weighting in simulated venture capitalist decision making , 2015 .

[7]  R. Detrano,et al.  International application of a new probability algorithm for the diagnosis of coronary artery disease. , 1989, The American journal of cardiology.

[8]  K. R. Hammond Probabilistic functioning and the clinical method. , 1955, Psychological review.

[9]  W. Gaissmaier,et al.  Smart strategies for doctors and doctors‐in‐training: heuristics in medicine , 2009, Medical education.

[10]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[11]  Michael Schulte-Mecklenbeck,et al.  Process Models Deserve Process Data: Comment on Brandstatter, Gigerenzer, and Hertwig (2006) , 2008, Psychological review.

[12]  G. Gigerenzer,et al.  How good are fast and frugal heuristics , 1999 .

[13]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[14]  Sunil Vadera,et al.  A survey of cost-sensitive decision tree induction algorithms , 2013, CSUR.

[15]  P. Todd,et al.  Simple Heuristics That Make Us Smart , 1999 .

[16]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[17]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[18]  Jan K. Woike,et al.  Journal of Mathematical Psychology Categorization with Limited Resources: a Family of Simple Heuristics , 2022 .

[19]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[20]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[21]  Daniel R. Little,et al.  Logical-rule models of classification response times: a synthesis of mental-architecture, random-walk, and decision-bound approaches. , 2010, Psychological review.

[22]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[23]  M. Dhami Journal of Behavioral Decision Making J. Behav. Dec. Making, 14: 141±168 �2001) DOI: 10.1002/bdm.371 Bailing and Jailing the Fast and Frugal Way , 2022 .

[24]  D R Mehr,et al.  What alters physicians' decisions to admit to the coronary care unit? , 1997, The Journal of family practice.

[25]  R. Dawes Judgment under uncertainty: The robust beauty of improper linear models in decision making , 1979 .

[26]  Nate Silver,et al.  The signal and the noise : why so many predictions fail but some don't , 2012 .

[27]  H Pashler,et al.  How persuasive is a good fit? A comment on theory testing. , 2000, Psychological review.

[28]  Jan K. Woike,et al.  Estimating Quantities: Comparing Simple Heuristics and Machine Learning Algorithms , 2012, ICANN.

[29]  Mandeep K. Dhami,et al.  Psychological Models of Professional Decision Making , 2003, Psychological science.

[30]  Mandeep K. Dhami,et al.  Fast and frugal versus regression models of human judgement , 2001 .

[31]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[32]  G. Gigerenzer,et al.  Using icon arrays to communicate medical risks: overcoming low numeracy. , 2009, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[33]  Jae-Young Kim Detection of change in persistence of a linear time series , 2000 .

[34]  D. Goldstein,et al.  Betting on one good reason : The Take the Best heuristic , 1999 .

[35]  Gerd Gigerenzer,et al.  A signal-detection analysis of fast-and-frugal trees. , 2011, Psychological review.

[36]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[37]  Laura Martignon,et al.  Naive and Yet Enlightened: From Natural Frequencies to Fast and Frugal Decision Trees , 2003 .

[38]  I. J. Myung,et al.  When a good fit can be bad , 2002, Trends in Cognitive Sciences.

[39]  Bernd Bischl,et al.  mlr: Machine Learning in R , 2016, J. Mach. Learn. Res..

[40]  J C Hershey,et al.  Clinical Guidelines for Using Two Dichotomous Tests , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[41]  Morten Moshagen,et al.  multiTree: A computer program for the analysis of multinomial processing tree models , 2010, Behavior research methods.

[42]  R. Hogarth,et al.  Unit weighting schemes for decision making , 1975 .

[43]  Thorsten Pachur,et al.  Simple rules for detecting depression. , 2013, Journal of Applied Research in Memory and Cognition.

[44]  Gerd Gigerenzer,et al.  Homo Heuristicus: Why Biased Minds Make Better Inferences , 2009, Top. Cogn. Sci..

[45]  Ulrich Hoffrage,et al.  When do people use simple heuristics, and how can we tell? , 1999 .

[46]  B. Newell,et al.  Search strategies in decision making: the success of “success” , 2004 .

[47]  Jana Jarecki,et al.  What is a Cognitive Process Model? A Disambiguation , 2015 .

[48]  Gerd Gigerenzer,et al.  Calculated Risks: How to Know When Numbers Deceive You , 2002 .

[49]  Paul E. Meehl,et al.  Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence , 1996 .

[50]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[51]  David M. Riefer,et al.  Multinomial processing models of source monitoring. , 1990 .

[52]  Konstantinos V. Katsikopoulos,et al.  On the role of psychological heuristics in operational research; and a demonstration in military stability operations , 2016, Eur. J. Oper. Res..

[53]  Peter M. Todd,et al.  Heuristics for Ordering Cue Search in Decision Making , 2004, NIPS.

[54]  L. Martignon,et al.  Use of simple heuristics to target macrolide prescription in children with community-acquired pneumonia. , 2002, Archives of pediatrics & adolescent medicine.

[55]  Kurt Hornik,et al.  Misc Functions of the Department of Statistics, ProbabilityTheory Group (Formerly: E1071), TU Wien , 2015 .

[56]  U. Hoffrage,et al.  Fast, frugal, and fit: Simple heuristics for paired comparison , 2002 .

[57]  B. Ripley,et al.  Recursive Partitioning and Regression Trees , 2015 .

[58]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[59]  Kevin A. Gluck,et al.  A quantification of robustness , 2013 .

[60]  B. Ray,et al.  Bayesian methods for change‐point detection in long‐range dependent processes , 2002 .

[61]  J. Ross Quinlan,et al.  Simplifying Decision Trees , 1987, Int. J. Man Mach. Stud..

[62]  Jochen Reb,et al.  Fast-and-frugal trees as noncompensatory models of performance-based personnel decisions , 2017 .