Uncovering potential bias in engineering design: a comparative review of bias research in medicine

Abstract Engineering design research has focused on developing and refining methods and evaluating design education in design education, design research and design in practice. One important aspect that is not thoroughly investigated is the influence of bias on design within these spaces of design. Bias is known to impact the interpretation of information, decision-making and practices in all areas. These factors are vital in engineering design education, practice and research, emphasizing the importance of investigating bias. The first goal of this study is to highlight and synthesize existing bias research in design education, research and practice. The second goal is to identify areas where bias may be under-researched or under-reported in design. To achieve these goals, a comparative analysis is performed against a comparable field: medicine. Many parallels exist between both fields. Patient–provider and designer–end-user relationships are comparable. Medical education is comparable to design education with the cooperative, inquiry-based and integrated learning pedagogy approaches. Lastly, physicians and design engineers both solve cognitively complex systems-oriented problems. Leveraging research on bias in medicine enables us to highlight gaps in engineering design. Recommendations are made to help design researchers address these gaps.

[1]  Leidy E. Klotz,et al.  Framing to reduce present bias in infrastructure design intentions , 2022, iScience.

[2]  G. Corazza,et al.  Diagnostic reasoning in internal medicine: a practical reappraisal , 2020, Internal and Emergency Medicine.

[3]  Sven Matthiesen,et al.  The impact of confirmation bias on reasoning and visual attention during analysis in engineering design: An eye tracking study , 2020 .

[4]  J. Amiel,et al.  Toward a Bias-Free and Inclusive Medical Curriculum: Development and Implementation of Student-Initiated Guidelines and Monitoring Mechanisms at One Institution. , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[5]  Margaret Plews-Ogan,et al.  Acting Wisely: Eliminating Negative Bias in Medical Education-Part 2: How Can We Do Better? , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[6]  Margaret Plews-Ogan,et al.  Acting Wisely: Eliminating Negative Bias in Medical Education-Part 1: The Fundamentals. , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[7]  S. Schoenbaum,et al.  Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments: An Urgent Challenge. , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[8]  K. Sutcliffe,et al.  Gender Bias in Collaborative Medical Decision Making: Emergent Evidence , 2020, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Michael C. F. Bazzocchi,et al.  Engineering design pedagogy: a performance analysis , 2020, International Journal of Technology and Design Education.

[10]  Timothy W. Simpson,et al.  Exploring the Effects of Additive Manufacturing Education on Students' Engineering Design Process and its Outcomes , 2020, Journal of Mechanical Design.

[11]  S. Gwynne,et al.  Burning biases: Mitigating cognitive biases in fire engineering , 2020, Fire and Materials.

[12]  D. Elston Confirmation bias in medical decision-making. , 2020, Journal of the American Academy of Dermatology.

[13]  M. Pinzur Bias in Medical Education , 2020, Foot & ankle international.

[14]  Joshua D. Summers,et al.  Requirement Generation: Lecture Intervention Impact on Variety and Novelty , 2019, Volume 3: 21st International Conference on Advanced Vehicle Technologies; 16th International Conference on Design Education.

[15]  Peter M. Ostafichuk,et al.  SELF-BIAS AND GENDER-BIAS IN STUDENT PEER EVALUATION: AN EXPANDED STUDY , 2019 .

[16]  J. de Houwer Implicit Bias Is Behavior: A Functional-Cognitive Perspective on Implicit Bias , 2019, Perspectives on psychological science : a journal of the Association for Psychological Science.

[17]  N. Crilly,et al.  Creativity and fixation in the real world: A literature review of case study research , 2019, Design Studies.

[18]  K. Hutchison Gender Bias in Medical Implant Design and Use: A Type of Moral Aggregation Problem? , 2019, Hypatia.

[19]  D. Conley,et al.  New Evidence of Skin Color Bias and Health Outcomes Using Sibling Difference Models: A Research Note , 2019, Demography.

[20]  Silvia Rueda,et al.  Gender Diversity in STEM Disciplines: A Multiple Factor Problem , 2019, Entropy.

[21]  Ayanna M. Howard,et al.  The Ugly Truth About Ourselves and Our Robot Creations: The Problem of Bias and Social Inequity , 2017, Science and Engineering Ethics.

[22]  James Gopsill,et al.  EXAMINING THE SOLUTION BIAS OF CONSTRUCTION KITS , 2018 .

[23]  Scarlett R. Miller,et al.  How Concept Selection Tools Impact the Development of Creative Ideas in Engineering Design Education , 2018 .

[24]  Torkil Clemmensen,et al.  How cultural knowledge shapes core design thinking—a situation specific analysis , 2018 .

[25]  K. Inkelas,et al.  Call to Action: Data, Diversity, and STEM Education , 2018 .

[26]  Jenny X. Liu,et al.  Bias in Contraceptive Provision to Young Women Among Private Health Care Providers in South West Nigeria. , 2018, International perspectives on sexual and reproductive health.

[27]  G. Parks Race, Cognitive Biases, and the Power of Law Student Teaching Evaluations , 2018 .

[28]  C. Moss‐Racusin,et al.  Gender Bias Produces Gender Gaps in STEM Engagement , 2018 .

[29]  S. Sarkani,et al.  MITIGATING COGNITIVE BIASES IN RISK IDENTIFICATION: Practitioner Checklist for the AEROSPACE SECTOR. , 2018, Defense acquisition research journal.

[30]  John S. Gero,et al.  Can Pahl and Beitz’ systematic approach be a predictive model of designing? , 2017, Design Science.

[31]  Ramona Houmanfar,et al.  A deeper look at implicit weight bias in medical students , 2017, Advances in health sciences education : theory and practice.

[32]  Paul Ralph,et al.  Cognitive Biases in Software Engineering: A Systematic Mapping Study , 2017, IEEE Transactions on Software Engineering.

[33]  Jonathan Sherbino,et al.  How Expert Clinicians Intuitively Recognize a Medical Diagnosis. , 2017, The American journal of medicine.

[34]  A. Greenwald,et al.  Implicit Racial Bias in Medical School Admissions , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[35]  G. Gweon,et al.  Towards effective group work assessment: even what you don’t see can bias you , 2017 .

[36]  C. Briggs The Policy of STEM Diversity: Diversifying STEM Programs in Higher Education , 2017 .

[37]  Philippe N. Tobler,et al.  Cognitive biases associated with medical decisions: a systematic review , 2016, BMC Medical Informatics and Decision Making.

[38]  Scarlett R. Miller,et al.  The Effects of Gender and Idea Goodness on Ownership Bias in Engineering Design Education , 2016 .

[39]  Seda Yilmaz,et al.  Comparing Ideation Techniques for Beginning Designers , 2016 .

[40]  Douglas L. Van Bossuyt,et al.  Toward Implementing Quantifiable Social Justice Metrics in the Design Process , 2016, DAC 2016.

[41]  Kelly M. Hoffman,et al.  Racial bias in pain assessment and treatment recommendations, and false beliefs about biological differences between blacks and whites , 2016, Proceedings of the National Academy of Sciences.

[42]  Yan Tang,et al.  Design and Commissioning of a Community Scale Solar Powered Membrane-Based Water Purification System in Haiti , 2016 .

[43]  Ashish Chandiok,et al.  Cognitive Decision Support System for medical diagnosis , 2016, 2016 International Conference on Computational Techniques in Information and Communication Technologies (ICCTICT).

[44]  Claus Thorp Hansen,et al.  Almost like being there; the power of personas when designing for foreign cultures , 2016 .

[45]  B. Miller,et al.  Improving Diagnosis in Health Care , 2015 .

[46]  M. Haselton,et al.  The Evolution of Cognitive Bias , 2015 .

[47]  Tamera Coyne-Beasley,et al.  Implicit Racial/Ethnic Bias Among Health Care Professionals and Its Influence on Health Care Outcomes: A Systematic Review. , 2015, American journal of public health.

[48]  J. Schofferman Industry-Funded Continuing Medical Education: The Potential for Bias. , 2015, Pain medicine.

[49]  A. Lehti,et al.  Is there a gender bias in recommendations for further rehabilitation in primary care of patients with chronic pain after an interdisciplinary team assessment? , 2015, Journal of rehabilitation medicine.

[50]  Carlos A. Santos Silva,et al.  Polygeneration Energy Container: Designing and Testing Energy Services for Remote Developing Communities , 2014, IEEE Transactions on Sustainable Energy.

[51]  Sebastian K. Fixson,et al.  Adopting Design Thinking in Novice Multidisciplinary Teams: The Application and Limits of Design Methods and Reflexive Practices , 2013 .

[52]  L. H. Shu,et al.  Considering Confirmation Bias in Design and Design Research , 2013, J. Integr. Des. Process. Sci..

[53]  H. Arkes The Consequences of the Hindsight Bias in Medical Decision Making , 2013 .

[54]  Alasdair I Houston,et al.  On evolutionary explanations of cognitive biases. , 2013, Trends in ecology & evolution.

[55]  Yan Fu,et al.  An Ensemble Approach for Model Bias Prediction , 2013 .

[56]  R. Wassersug,et al.  Systemic bias in the medical literature on androgen deprivation therapy and its implication to clinical practice , 2012, International journal of clinical practice.

[57]  Shimul Melwani,et al.  The Bias Against Creativity , 2012, Psychological science.

[58]  G. Moskowitz,et al.  Non‐conscious bias in medical decision making: what can be done to reduce it? , 2011, Medical education.

[59]  J. Kane,et al.  Confirmation bias: why psychiatrists stick to wrong preliminary diagnoses , 2011, Psychological Medicine.

[60]  Arthur B. Markman,et al.  An Experimental Study of Group Idea Generation Techniques: Understanding the Roles of Idea Representation and Viewing Methods , 2011 .

[61]  C. Avgerou Discourses on ICT and Development , 2010 .

[62]  I. Wilson,et al.  Interviewer bias in medical student selection , 2010, The Medical journal of Australia.

[63]  Susan Persky,et al.  Medical Student Bias and Care Recommendations for an Obese versus Non-Obese Virtual Patient , 2010, International Journal of Obesity.

[64]  Carmine Zoccali,et al.  Selection Bias and Information Bias in Clinical Research , 2010, Nephron Clinical Practice.

[65]  H. Kölsch,et al.  Reporting bias in medical research - a narrative review , 2010, Trials.

[66]  David B. Nash,et al.  Approaching the Evidence Basis for Aviation-Derived Teamwork Training in Medicine , 2010, American journal of medical quality : the official journal of the American College of Medical Quality.

[67]  Anette Kolmos,et al.  Increasing the diversity of engineering education – a gender analysis in a PBL context , 2009 .

[68]  Norbert K. Semmer,et al.  Explicit Reasoning, Confirmation Bias, and Illusory Transactive Memory , 2009 .

[69]  Georges M. Fadel,et al.  Affordance based design: a relational theory for design , 2009 .

[70]  J. Bensing,et al.  Endpoints in medical communication research, proposing a framework of functions and outcomes. , 2009, Patient education and counseling.

[71]  D. Vogel,et al.  Bias in the Classroom: Types, Frequencies, and Responses , 2009 .

[72]  A. Lagro-Janssen,et al.  Gender bias in medical textbooks: examples from coronary heart disease, depression, alcohol abuse and pharmacology , 2008, Medical education.

[73]  J. Hershey,et al.  Value-Induced Bias in Medical Decision Making , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[74]  Thomas J. Howard,et al.  Describing the creative design process by the integration of engineering design and cognitive psychology literature , 2008 .

[75]  Mahzarin R. Banaji,et al.  Implicit Bias among Physicians and its Prediction of Thrombolysis Decisions for Black and White Patients , 2007, Journal of General Internal Medicine.

[76]  H. Arkes,et al.  Failure to Adopt Beneficial Therapies Caused by Bias in Medical Evidence Evaluation , 2006, Medical decision making : an international journal of the Society for Medical Decision Making.

[77]  L. Best,et al.  Aviation model cognitive risk factors applied to medical malpractice cases. , 2006, Journal of the American Board of Family Medicine : JABFM.

[78]  Daniel D. Frey,et al.  Validation of design methods: lessons from medicine , 2006 .

[79]  Harlan M Krumholz,et al.  Participation in cancer clinical trials: race-, sex-, and age-based disparities. , 2004, JAMA.

[80]  P. Croskerry The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[81]  D. Kahneman,et al.  Heuristics and Biases: The Psychology of Intuitive Judgment , 2002 .

[82]  William W. Wulf,et al.  Diversity In Engineering , 2001 .

[83]  Theresa M. Mullin,et al.  Cognitive biases and time stress in team decision making , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[84]  M. Cusimano Standard setting in medical education , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[85]  Justin C. D. Savage,et al.  Influence of Cognitive Overload and Bias on Engineering Design , 1996 .

[86]  R. Markert,et al.  Understanding and addressing cognitive bias in medical education , 1996, Advances in health sciences education : theory and practice.

[87]  Caroline Wagner,et al.  Problem solving and diagnosis , 1993 .

[88]  S W Bloom,et al.  Structure and ideology in medical education: an analysis of resistance to change. , 1988, Journal of health and social behavior.

[89]  J. Baron,et al.  Outcome bias in decision evaluation. , 1988, Journal of personality and social psychology.

[90]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[91]  W. Hotopf Bias in Psychology: Institutional Sources , 1958 .

[92]  Xinli Wu,et al.  An evaluation framework for engineering design projects for gender bias, domain relatedness, and ambiguity: Development , 2018 .

[93]  Brigitte Moench,et al.  Engineering Design A Systematic Approach , 2016 .

[94]  Luis A. Vasconcelos,et al.  Inspiration and fixation: Questions, methods, findings, and challenges , 2016 .

[95]  B. Miller,et al.  Improving Diagnosis in Health Care. , 2016, Military medicine.

[96]  P. Ross,et al.  Understanding customer needs , 2015 .

[97]  L. H. Shu,et al.  Reducing cognitive bias in biomimetic design by abstracting nouns , 2013 .

[98]  Jack A. Goncalo,et al.  The Bias Against Creativity: Why People Desire but Reject Creative Ideas , 2011 .

[99]  Benjamin W. Caldwell Evaluating the Use of Functional Representations for Ideation in Conceptual Design , 2011 .

[100]  Julie S. Linsey,et al.  Innovation Skills for Tomorrow’s Sustainable Designers , 2010 .

[101]  Achim Schmoldt,et al.  Explicit reasoning, confirmation bias, and illusory transactive memeory : a simulation study of group medical decision making , 2009 .

[102]  Kimberley A. Gilbride,et al.  THE FUTURE OF ENGINEERING: A STUDY OF THE GENDER BIAS , 2007 .

[103]  Cynthia J. Atman,et al.  Mapping between design activities and external representations for engineering student designers , 2006 .

[104]  Matthew G. Green Enabling design in frontier contexts: a contextual needs assessment method with humanitarian applications , 2005 .

[105]  George Rzevski,et al.  Beyond Engineering Bias : designing a tool to liberate conceptual design , 2002 .

[106]  Mark Rubin,et al.  Intergroup bias. , 2002, Annual review of psychology.

[107]  Karl T. Ulrich,et al.  Product Design and Development , 1995 .

[108]  J. Dixon,et al.  Engineering Design , 2019, Springer Handbook of Mechanical Engineering.