Ameliorating mental mistakes in tradeoff studies

Tradeoff studies are broadly recognized and mandated as the method for simultaneously considering multiple alternatives with many criteria, and as such are recommended in the Capability Maturity Model Integration (CMMI) Decision Analysis and Resolution (DAR) process. Tradeoff studies, which involve human numerical judgment, calibration, and data updating, are often approached with under confidence by analysts and are often distrusted by decision makers. The decision-making fields of Judgment and Decision Making, Cognitive Science and Experimental Economics have built up a large body of research on human biases and errors in considering numerical and criteria-based choices. Relationships between experiments in these fields and the elements of tradeoff studies show that tradeoff studies are susceptible to human mental mistakes: This paper indicates ways to eliminate the presence, or ameliorate the effects of mental mistakes on tradeoff studies. © 2007 Wiley Periodicals, Inc. Syst Eng 10: 222–240, 2007

[1]  Dennis M. Buede,et al.  The Engineering Design of Systems: Models and Methods , 1999 .

[2]  A. Terry Bahill,et al.  A Tutorial on Quality Function Deployment , 1993 .

[3]  M. El-Sabaawi.  Breakdown of Will , 2002 .

[4]  Thomas L. Saaty,et al.  Multicriteria Decision Making: The Analytic Hierarchy Process: Planning, Priority Setting, Resource Allocation , 1990 .

[5]  Martin Weber,et al.  Behavioral influences on weight judgments in multiattribute decision making , 1993 .

[6]  D. Kahneman.  A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[7]  A. Tversky,et al.  The Disjunction Effect in Choice under Uncertainty , 1992 .

[8]  Nora Miller,et al.  Inevitable Illusions: How Mistakes of Reason Rule Our Minds , 2001 .

[9]  Norbert Schwarz,et al.  Priming and communication: Social determinants of information use in judgments of life satisfaction , 1988 .

[10]  Baruch Fischhoff,et al.  On the Psychology of Experimental Surprises , 1977 .

[11]  David L. Mothersbaugh,et al.  Consumer Knowledge Assessment , 1994 .

[12]  Spike Cramphorn.  Blink: The Power of Thinking without Thinking / Strangers to Ourselves: Discovering the Adaptive Unconscious , 2006, Journal of Advertising Research.

[13]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[14]  Henry Petroski.  Framing Hypotheses: A Cautionary Tale , 2003 .

[15]  A. Terry Bahill,et al.  Engineering Modeling and Design , 1992 .

[16]  R. Nickerson.  Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[17]  H. Simon,et al.  Models Of Man : Social And Rational , 1957 .

[18]  A. Terry Bahill,et al.  Ameliorating mental mistakes in tradeoff studies , 2007 .

[19]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[20]  Ilana Ritov,et al.  Determinants of stated willingness to pay for public goods: A study in the headline method , 1994, Journal of risk and uncertainty.

[21]  D. Kumaran,et al.  Frames, Biases, and Rational Decision-Making in the Human Brain , 2006, Science.

[22]  P. Slovic,et al.  Reversals of preference between bids and choices in gambling decisions. , 1971 .

[23]  B. R. Forer,et al.  The fallacy of personal validation; a classroom demonstration of gullibility. , 2011, Journal of abnormal psychology.

[24]  Amos Tversky,et al.  Preference, Belief, and Similarity: Selected Writings , 2003 .

[25]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[26]  H. Raiffa,et al.  The hidden traps in decision making. , 1998, Harvard business review.

[27]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[28]  Lawrence D. Pohlmann,et al.  Customer‐Centered Products – Creating Successful Products through Smart Requirements Management , 2001 .

[29]  D. Kahneman,et al.  Representativeness revisited: Attribute substitution in intuitive judgment. , 2002 .

[30]  Ralph L. Keeney,et al.  Value-Focused Thinking: A Path to Creative Decisionmaking , 1992 .

[31]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[32]  Lawrence D. Pohlmann,et al.  The Engineering Design of Systems – Models and Methods , 2000 .

[33]  Lee Roy Beach,et al.  The Psychology of Decision Making: People in Organizations , 1997 .

[34]  J. Couper.  Sensitivity and Uncertainty Analysis , 2003 .

[35]  H. Arkes,et al.  Impediments to accurate clinical judgment and possible ways to minimize their impact. , 1981, Journal of consulting and clinical psychology.

[36]  Holger R. Maier,et al.  Sensitivity and Uncertainty , 2008 .

[37]  Eric D. Smith.  Tradeoff Studies and Cognitive Biases , 2006 .

[38]  A. Terry Bahill,et al.  Risk analysis of a Pinewood derby : A case study , 2000 .

[39]  F. B. Vernadat,et al.  Decisions with Multiple Objectives: Preferences and Value Tradeoffs , 1994 .

[40]  A. Berztiss,et al.  Requirements Engineering , 2002, J. Object Technol..

[41]  N. A. Rahman,et al.  How to solve problems : elements of a theory of problems and problem solving , 1975 .

[42]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[43]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[44]  G. Gigerenzer.  How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases” , 1991 .

[45]  Terry Bahill,et al.  The Zachman Framework Populated with Baseball Models , 2006 .

[46]  D. Redelmeier,et al.  Medical decision making in situations that offer multiple alternatives. , 1995, JAMA.

[47]  P. Kline.  Models of man , 1986, Nature.

[48]  A. Terry Bahill,et al.  The hybrid process that combines traditional requirements and use cases , 2004, Syst. Eng..

[49]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[50]  A. Terry Bahill,et al.  Quantitative methods for tradeoff analyses , 2001 .

[51]  A. Terry Bahill,et al.  The systems engineering started in the middle process: A consensus of systems engineers and project managers , 2001 .

[52]  Shin Ta Liu,et al.  Risk Modeling, Assessment, and Management , 1999, Technometrics.

[53]  David G. Ullman,et al.  Trade Studies with Uncertain Information , 2006 .

[54]  Andrew P. Sage,et al.  Concise encyclopedia of information processing in systems &organizations , 1990 .

[55]  Carolyn Y. Woo,et al.  Entrepreneurs' perceived chances for success , 1988 .

[56]  Ralph L. Keeney,et al.  Common Mistakes in Making Value Trade-Offs , 2002, Oper. Res..

[57]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[58]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[59]  A. Terry Bahill,et al.  Sensitivity analyses of continuous and discrete systems in the time and frequency domains , 1993, IEEE Trans. Syst. Man Cybern..

[60]  A. Tversky,et al.  Contingent weighting in judgment and choice , 1988 .