Fast and frugal heuristics for new product screening – is managerial judgment ‘good enough?’

Project screening in the fuzzy front-end of product development is dominantly based on managerial judgment, yet little is known about the quality of heuristic screening decisions. This research models three commonly discussed fast and frugal (F%F) heuristics for project screening (take-the-best, tallying and elimination-by-aspect) and explores their performance. An illustrative dataset of 52 new product development projects is used to compare the performance of F%F heuristics against that of regression models, which reflect compensatory judgment behaviour. The findings uncover a 'less is more' effect that justifies the use of simple heuristics in early stage product screening; two out of the three F%F heuristics reach accuracies of over 80% for project selection and 70% for project rejection and the best F%F model, tallying, performs similarly to the best regression model. The findings warrant a fresh look at managerial screening heuristics as 'good enough' decision making approach.

[1]  Peter M. Todd,et al.  Categorization by elimination : a fast and frugal approach tocategorization , 1997 .

[2]  Wafa Hammedi,et al.  Antecedents and consequences of reflexivity in new product idea screening , 2011 .

[3]  R. Cooper,et al.  SCREENING NEW PRODUCTS FOR POTENTIAL WINNERS , 1993 .

[4]  Allen Newell,et al.  Heuristic Problem Solving: The Next Advance in Operations Research , 1958 .

[5]  Greg A. Stevens,et al.  3,000 Raw Ideas = 1 Commercial Success! , 1997 .

[6]  G. Gigerenzer,et al.  How good are fast and frugal heuristics , 1999 .

[7]  A. Tversky Elimination by aspects: A theory of choice. , 1972 .

[8]  Mandeep K. Dhami,et al.  Fast and frugal versus regression models of human judgement , 2001 .

[9]  Jian-Bo Yang,et al.  Group-based ER-AHP system for product project screening , 2008, Expert Syst. Appl..

[10]  A. Sykes An Introduction to Regression Analysis , 1993 .

[11]  Gary Klein,et al.  The Power of Intuition: How to Use Your Gut Feelings to Make Better Decisions at Work , 2004 .

[12]  Gerald F. Smith Beyond Critical Thinking And Decision Making: Teaching Business Students How To Think , 2003 .

[13]  C. Merle Crawford,et al.  New Products Management , 1983 .

[14]  Ching-Torng Lin,et al.  New product go/no-go evaluation at the front end: a fuzzy linguistic approach , 2004, IEEE Trans. Engineering Management.

[15]  James G. March,et al.  A primer on decision making : how decisions happen , 1994 .

[16]  Slegers,et al.  Probabilistic Mental Models with Continuous Predictors. , 2000, Organizational behavior and human decision processes.

[17]  P. Todd,et al.  Escaping the tyranny of choice: when fewer attributes make choice easier , 2007 .

[18]  K. Eisenhardt,et al.  Strategy as simple rules. , 2001, Harvard business review.

[19]  David A. Freedman,et al.  Statistical Models: Theory and Practice: References , 2005 .

[20]  A. Glöckner,et al.  Multiple-reason decision making based on automatic processing. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[21]  Eric J. Johnson,et al.  The adaptive decision maker , 1993 .

[22]  R. Laurent,et al.  'Elimination by aspects' and probabilistic choice , 2006 .

[23]  Tony M. O'Driscoll,et al.  From experience: applying performance support technology in the fuzzy front end , 2000 .

[24]  Mikhael Shor,et al.  Age Effects and Heuristics in Decision Making , 2010, Review of Economics and Statistics.

[25]  Vicki L. Sauter,et al.  Intuitive decision-making , 1999, Commun. ACM.

[26]  Donald G. Reinertsen,et al.  Taking the Fuzziness Out of the Fuzzy Front End , 1999 .

[27]  Vinod Kumar,et al.  The front end of new product development: a Canadian survey , 1997 .

[28]  Lisa A. Burke,et al.  Taking the mystery out of intuitive decision making , 1999 .

[29]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[30]  P. Koen,et al.  1 Fuzzy Front End : Effective Methods , Tools , and Techniques , 2002 .

[31]  E. Gigliotti Discovering Statistics Using spss. Second Edition , 2007 .

[32]  Kenneth B. Kahn,et al.  PERSPECTIVE: Trends and Drivers of Success in NPD Practices: Results of the 2003 PDMA Best Practices Study* , 2009 .

[33]  Samir Elhedhli,et al.  The Effectiveness of Simple Decision Heuristics: A Case Study of Experts' Forecasts of the Commercial Success of Early-Stage Ventures , 2003 .

[34]  U. Daellenbach,et al.  Commitment to Innovation: The Impact of Top Management Team Characteristics , 1999 .

[35]  A. Griffin PDMA Research on New Product Development Practices: Updating Trends and Benchmarking Best Practices , 1997 .

[36]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[37]  Jörg Rieskamp,et al.  Fast and frugal heuristics , 2007 .

[38]  Samir Elhedhli,et al.  The Effectiveness of Simple Decision Heuristics: Forecasting Commercial Success for Early-Stage Ventures , 2006, Manag. Sci..

[39]  Ulrich Hoffrage,et al.  When do people use simple heuristics, and how can we tell? , 1999 .

[40]  Roger Calantone,et al.  Using the Analytic Hierarchy Process in New Product Screening , 1999 .

[41]  Mandeep K. Dhami,et al.  Simply Criminal: Predicting Burglars’ Occupancy Decisions with a Simple Heuristic , 2011, Law and human behavior.

[42]  A. Bröder Assessing the empirical validity of the "take-the-best" heuristic as a model of human probabilistic inference. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[43]  B. Newell,et al.  Empirical tests of a fast-and-frugal heuristic: Not everyone "takes-the-best" , 2003 .

[44]  Preston G. Smith,et al.  Developing products in half the time , 1995 .

[45]  P. Todd,et al.  Fast and frugal food choices: Uncovering individual decision heuristics , 2008, Appetite.

[46]  J. A. Andersen,et al.  Intuition in managers , 2000 .

[47]  Gary Klein,et al.  Streetlights and Shadows: Searching for the Keys to Adaptive Decision Making , 2009 .

[48]  Gerd Gigerenzer,et al.  Models of ecological rationality: the recognition heuristic. , 2002, Psychological review.

[49]  Thomas Åstebro,et al.  Key success factors for technological entrepreneurs' R&D projects , 2004, IEEE Transactions on Engineering Management.

[50]  M. Dhami Journal of Behavioral Decision Making J. Behav. Dec. Making, 14: 141±168 �2001) DOI: 10.1002/bdm.371 Bailing and Jailing the Fast and Frugal Way , 2022 .

[51]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[52]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[53]  Dundar F. Kocaoglu,et al.  Few or more attributes: Deleting criteria using sensitivity analysis , 2009, PICMET '09 - 2009 Portland International Conference on Management of Engineering & Technology.

[54]  D. Perkins,et al.  Are Cognitive Skills Context-Bound? , 1989 .

[55]  Geoff Lockett,et al.  Modelling a Research Portfolio Using AHP: A Group Decision Process , 1986 .

[56]  J. Henseler,et al.  Technology-based service proposal screening and decision-making effectiveness , 2011 .

[57]  Patric Andersson,et al.  Forecasting the fast and frugal way: A study of performance and information-processing strategies of experts and non-experts when predicting the World Cup 2002 in soccer , 2003 .

[58]  R. Cooper,et al.  0 0 0 0 An Investigation into the New Product Process : Steps , Deficiencies , and Impact , 1986 .

[59]  G. Kalton,et al.  Introduction to Applied Statistics , 1963 .

[60]  Dennis Nobelius,et al.  Stop chasing the Front End process — management of the early phases in product development projects , 2002 .

[61]  Robert G. Cooper,et al.  From Experience: The invisible success factors in product innovation , 1999 .

[62]  Robert G. Cooper,et al.  Selecting Winning New Product Projects: Using the NewProd System , 1985 .

[63]  E. Sadler‐Smith,et al.  The Role of Intuition in Strategic Decision Making , 2009 .

[64]  I. Alam Commercial Innovations from Consulting Engineering Firms: An Empirical Exploration of a Novel Source of New Product Ideas , 2003 .

[65]  D. Garvin,et al.  What you don't know about making decisions , 2001, IEEE Engineering Management Review.