Fairness via AI: Bias Reduction in Medical Information

Most Fairness in AI research focuses on exposing biases in AI systems. A broader lens on fairness reveals that AI can serve a greater aspiration: rooting out societal inequities from their source. Specifically, we focus on inequities in health information, and aim to reduce bias in that domain using AI. The AI algorithms under the hood of search engines and social media, many of which are based on recommender systems, have an outsized impact on the quality of medical and health information online. Therefore, embedding bias detection and reduction into these recommender systems serving up medical and health content online could have an outsized positive impact on patient outcomes and wellbeing. In this position paper, we offer the following contributions: (1) we propose a novel framework of Fairness via AI, inspired by insights from medical education, sociology and antiracism; (2) we define a new term, bisinformation, which is related to, but distinct from, misinformation, and encourage researchers to study it; (3) we propose using AI to study, detect and mitigate biased, harmful, and/or false health information that disproportionately hurts minority groups in society; and (4) we suggest several pillars and pose several open problems in order to seed inquiry in this new space.While part (3) of this work specifically focuses on the health domain, the fundamental computer science advances and contributions stemming from research efforts in bias reduction and Fairness via AI have broad implications in all areas of society.

[1]  Sandra G. Mayson Bias In, Bias Out , 2018 .

[2]  M. Mintz,et al.  Perspective: are we teaching racial profiling? The dangers of subjective determinations of race and ethnicity in case presentations. , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Keisa Fallin-Bennett Implicit bias against sexual minorities in medicine: cycles of professional influence and the role of the hidden curriculum. , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[4]  A. Prasad Anti-science Misinformation and Conspiracies: COVID–19, Post-truth, and Science & Technology Studies (STS) , 2021, Science, Technology and Society.

[5]  Tao Le,et al.  First aid for the USMLE Step 1 2009 , 2010 .

[6]  P. George,et al.  Race Matters? Examining and Rethinking Race Portrayal in Preclinical Medical Education , 2016, Academic medicine : journal of the Association of American Medical Colleges.

[7]  D. Roberts,et al.  Structural competency meets structural racism: race, politics, and the structure of medical knowledge. , 2014, The virtual mentor : VM.

[8]  F. Hafferty,et al.  Humanism, the Hidden Curriculum, and Educational Reform: A Scoping Review and Thematic Analysis , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Bridget C. O’Brien,et al.  Commentary: Racism and Bias in Health Professions Education: How Educators, Faculty Developers, and Researchers Can Make a Difference , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[10]  S. Hurst,et al.  Implicit bias in healthcare professionals: a systematic review , 2017, BMC medical ethics.

[11]  A. Shields,et al.  Racial Categories in Medical Practice: How Useful Are They? , 2007, PLoS medicine.

[12]  S. Sutherland,et al.  The hidden and informal curriculum across the continuum of training: A cross-sectional qualitative study* , 2016, Medical teacher.

[13]  Lundy Braun,et al.  Race/Ethnicity in Medical Education: An Analysis of a Question Bank for Step 1 of the United States Medical Licensing Examination , 2017, Teaching and learning in medicine.

[14]  M. Kreiner,et al.  Genes, race, and culture in clinical care: racial profiling in the management of chronic illness. , 2013, Medical anthropology quarterly.

[15]  D. Brandon,et al.  The legacy of Tuskegee and trust in medical care: is Tuskegee responsible for race differences in mistrust of medical care? , 2005, Journal of the National Medical Association.

[16]  Clive Seale,et al.  The hidden curriculum in undergraduate medical education: qualitative study of medical students' perceptions of teaching , 2004, BMJ : British Medical Journal.

[17]  Rabia Tahir,et al.  The use of race, ethnicity and ancestry in human genetic research , 2011, The HUGO Journal.