Considering Confirmation Bias in Design and Design Research

Confirmation bias is an innate and pervasive human tendency to preferentially attempt to validate beliefs instead of invalidating them. However the design community, which is increasingly concerned with the cognition of designers, has largely overlooked this phenomenon. This paper discusses the relevance of confirmation bias with respect to its potential to influence designers and design researchers. The existing literature suggests that confirmation bias is present among designers and can contribute to undesirable design outcomes. Our emphasis is placed on the role of confirmation bias in fixation and the misapplication of biological analogies in design. We discuss the results of our experimental study that suggest confirmation bias may skew data evaluation in design research, contributing to deviations from scientifically accurate conclusions. We also discuss possible methods to mitigate confirmation bias.

[1]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[2]  Richards J. Heuer,et al.  Psychology of Intelligence Analysis , 1999 .

[3]  P. Johnson-Laird,et al.  REASONING AND A SENSE OF REALITY , 1972 .

[4]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[5]  K. Dunbar.  How scientists think: On-line creativity and conceptual change in science. , 1997 .

[6]  Ding-Bang Luh,et al.  Using the Systematic Empathic Design Method for Customer-centered Products Development , 2012, J. Integr. Des. Process. Sci..

[7]  D. E. Bell,et al.  Decision making: Descriptive, normative, and prescriptive interactions. , 1990 .

[8]  Jonathan Cagan,et al.  A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty , 2010 .

[9]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[10]  L. H. Shu,et al.  Creativity and Long-Term Potentiation: Implications for Design , 2011 .

[11]  Chad R. Foster.  Improving Failure Mode and Effects Analysis as a Cognitive Simulation , 2012 .

[12]  H. Arkes,et al.  Two methods of reducing overconfidence , 1987 .

[13]  Murat M. Tanik,et al.  Harnessing Complexity in Design , 2002, Trans. SDPS.

[14]  John S. Gero,et al.  Design Prototypes: A Knowledge Representation Schema for Design , 1990, AI Mag..

[15]  L. H. Shu.  Obstacles to Creativity in Biomimetic Design , 2012 .

[16]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[17]  Julie S. Linsey,et al.  Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost , 2011 .

[18]  Yong Zeng,et al.  Design Conflict: Conceptual Structure and Mathematical Representation , 2011, Trans. SDPS.

[19]  J. Krems,et al.  [Are experts immune to cognitive bias? Dependence of "confirmation bias" on specialist knowledge]. , 1994, Zeitschrift fur experimentelle und angewandte Psychologie.

[20]  Yong Zeng,et al.  A Theoretical Model of Design Creativity: Nonlinear Design Dynamics and Mental Stress-Creativity Relation , 2012, J. Integr. Des. Process. Sci..

[21]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[22]  Kevin Otto,et al.  Customer Integrated Systematic Design , 1999, Trans. SDPS.

[23]  Lassi A. Liikkanen,et al.  Structural Tendencies and Exposure Effects in Design Idea Generation , 2006 .

[24]  Johnny Jermias,et al.  The influence of accountability on overconfidence and resistance to change: A research framework and experimental evidence , 2006 .

[25]  J Friedrich,et al.  Primary error detection and minimization (PEDMIN) strategies in social cognition: a reinterpretation of confirmation bias phenomena. , 1993, Psychological review.

[26]  Barry G. Silverman,et al.  Software Cost and Productivity Improvements: An Analogical View , 1985, Computer.

[27]  J. Klayman,et al.  Confirmation, Disconfirmation, and Informa-tion in Hypothesis Testing , 1987 .

[28]  Barry G. Silverman.  Modeling and critiquing the confirmation bias in human reasoning , 1992, IEEE Trans. Syst. Man Cybern..

[29]  Jesse M Pines,et al.  Profiles in patient safety: confirmation bias in emergency medicine. , 2006, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[30]  Adam D. Galinsky,et al.  Counterfactuals as behavioral primes: Priming the simulation heuristic and consideration of alternatives. , 2000 .

[31]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[32]  Jeremy Busby.  The Problem with Design Reuse: An Investigation into Outcomes and Antecedents , 1999 .

[33]  L. H. Shu,et al.  Understanding Analogical Reasoning in Biomimetic Design: An Inductive Approach , 2014 .

[34]  Alafair S. Burke,et al.  Neutralizing Cognitive Bias: An Invitation to Prosecutors , 2007 .

[35]  Gregory M. Hallihan,et al.  Confirmation and Cognitive Bias in Design Cognition , 2012 .

[36]  P. Wason.  On the Failure to Eliminate Hypotheses in a Conceptual Task , 1960 .

[37]  Paul E. Lehner,et al.  Confirmation Bias in Complex Analyses , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[38]  K. Dickersin.  The existence of publication bias and risk factors for its occurrence. , 1990, JAMA.

[39]  Konstantinos V. Katsikopoulos,et al.  Decision Methods for Design: Insights from Psychology , 2012 .

[40]  D. Bernoulli.  Exposition of a New Theory on the Measurement of Risk , 1954 .

[41]  Alafair S. Burke.  Improving Prosecutorial Decision Making: Some Lessons of Cognitive Science , 2005 .

[42]  Barry G. Silverman,et al.  Expert Critics in Engineering Design: Lessons Learned and Research Needs , 1992, AI Mag..

[43]  R. Nickerson.  Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[44]  B. Fischhoff,et al.  Reasons for confidence. , 1980 .

[45]  Ali Akgunduz,et al.  Pair-Wise Preference Comparisons Using Alpha-Peak Frequencies , 2012, J. Integr. Des. Process. Sci..

[46]  L. Cosmides.  The logic of social exchange: Has natural selection shaped how humans reason? Studies with the Wason selection task , 1989, Cognition.

[47]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[48]  H. Arkes,et al.  The Psychology of Sunk Cost , 1985 .

[49]  C. Frith.  Social cognition , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[50]  Petra Badke-Schaub,et al.  Fixation or Inspiration: Creative Problem Solving in Design , 2011 .