An individual-level socioeconomic measure for assessing algorithmic bias in health care settings: A case for HOUSES index

While artificial intelligence (AI) algorithms hold great potential for improving health and reducing health disparities, biased AI algorithms have a potential to negatively impact the health of under-resourced communities or racial/ethnic minority populations. Our study highlights the major role of socioeconomic status (SES) in AI algorithm bias and (in)completeness of electronic health records (EHRs) data, which is commonly used for algorithm development. Understanding the extent to which SES impacts algorithmic bias and its pathways through which SES operates its impact on algorithmic bias such as differential (in)completeness of EHRs will be important for assessing and mitigating algorithmic bias. Despite its importance, the role of SES in the AI fairness science literature is currently under-recognized and under-studied, largely because objective and scalable individual-level SES measures are frequently unavailable in commonly used data sources such as EHRs. We addressed this challenge by applying a validated individual-level socioeconomic measure that we call the HOUSES index. This tool allows AI researchers to assess algorithmic bias due to SES. Although our study used a cohort with a relatively small sample size, these study results highlight a novel conceptual strategy for quantifying AI bias by SES.

[1]  Hongfang Liu,et al.  Artificial intelligence-assisted clinical decision support for childhood asthma management: A randomized clinical trial , 2021, PloS one.

[2]  C. Patten,et al.  Role of Geographic Risk Factors in COVID-19 Epidemiology: Longitudinal Geospatial Analysis , 2021, Mayo Clinic Proceedings: Innovations, Quality & Outcomes.

[3]  Gregory M. Garrison,et al.  Impact of socioeconomic status on depression clinical outcomes at six months in a Midwestern, United States community. , 2021, Journal of affective disorders.

[4]  Jonathan W. Inselman,et al.  Artificial intelligence–enabled electrocardiograms for identification of patients with low ejection fraction: a pragmatic, randomized clinical trial , 2021, Nature Medicine.

[5]  Moninder Singh,et al.  Comparison of Methods to Reduce Bias From Clinical Prediction Models of Postpartum Depression , 2021, JAMA network open.

[6]  G. Calip,et al.  Association of Race/Ethnicity and the 21-Gene Recurrence Score With Breast Cancer-Specific Mortality Among US Women. , 2021, JAMA oncology.

[7]  A. Bush,et al.  Burden of preschool wheeze and progression to asthma in the UK: population-based cohort 2007 to 2017. , 2021, Journal of Allergy and Clinical Immunology.

[8]  B. Meskó,et al.  The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. , 2020, NPJ digital medicine.

[9]  J. Sauver,et al.  An innovative housing-related measure for individual socioeconomic status and human papillomavirus vaccination coverage: A population-based cross-sectional study. , 2020, Vaccine.

[10]  Michael E. Wilson,et al.  An Innovative Individual-Level Socioeconomic Measure Predicts Critical Care Outcomes in Older Adults: A Population-Based Study , 2020, Journal of intensive care medicine.

[11]  D. Belsky,et al.  Social determinants of health and survival in humans and other animals , 2020, Science.

[12]  C. Wi,et al.  The relationship of 25-hydroxyvitamin D values and risk of fracture: a population-based retrospective cohort study , 2020, Osteoporosis International.

[13]  P. Vineis,et al.  Association of Parental Socioeconomic Status and Newborn Telomere Length , 2020, JAMA network open.

[14]  D. Zahrieh,et al.  Mobile home residence as a risk factor for adverse events among children in a mixed rural–urban community: A case for geospatial analysis , 2020, Journal of Clinical and Translational Science.

[15]  B. Meskó,et al.  The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database , 2020, npj Digital Medicine.

[16]  T. Beebe,et al.  HOUSES Index as an Innovative Socioeconomic Measure Predicts Graft Failure Among Kidney Transplant Recipients , 2020, Transplantation.

[17]  E. Ryu,et al.  Long-term incidence of glioma in Olmsted County, Minnesota, and disparities in postglioma survival rate: a population-based study. , 2019, Neuro-oncology practice.

[18]  C. Wi,et al.  The relationship of 25-hydroxyvitamin D concentrations and individual-level socioeconomic status , 2019, The Journal of Steroid Biochemistry and Molecular Biology.

[19]  EXECUTIVE SUMMARY FOR THE PATIENT ENGAGEMENT ADVISORY COMMITTEE MEETING-Artificial Intelligence (AI) and Machine Learning (ML) in Medical Devices , 2020 .

[20]  Brian W. Powers,et al.  Dissecting racial bias in an algorithm used to manage the health of populations , 2019, Science.

[21]  Yunfeng Zhang,et al.  AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias , 2019, IBM Journal of Research and Development.

[22]  E. Ryu,et al.  Spatio-temporal comparison of pertussis outbreaks in Olmsted County, Minnesota, 2004–2005 and 2012: a population-based study , 2019, BMJ Open.

[23]  E. Ryu,et al.  Epidemiology of Children With Multiple Complex Chronic Conditions in a Mixed Urban-Rural US Community. , 2019, Hospital pediatrics.

[24]  M. Ghassemi,et al.  Can AI Help Reduce Disparities in General Medical and Mental Health Care? , 2019, AMA journal of ethics.

[25]  E. Ryu,et al.  Socioeconomic Status, Race/Ethnicity, and Health Disparities in Children and Adolescents in a Mixed Rural‐Urban Community—Olmsted County, Minnesota , 2019, Mayo Clinic proceedings.

[26]  Michael E. Wilson,et al.  An Individual Housing-Based Socioeconomic Status Measure Predicts Advance Care Planning and Nursing Home Utilization , 2018, The American journal of hospice & palliative care.

[27]  Michael Lawrence Barnett,et al.  Assessment of the Effect of Adjustment for Patient Characteristics on Hospital Readmission Rates: Implications for Pay for Performance , 2018, JAMA internal medicine.

[28]  J. Cerhan,et al.  Association between an individual housing-based socioeconomic index and inconsistent self-reporting of health conditions: a prospective cohort study in the Mayo Clinic Biobank , 2018, BMJ Open.

[29]  J. Korula Holding Providers Accountable for Health Care Outcomes , 2018, Annals of Internal Medicine.

[30]  D. Baker,et al.  Holding Providers Accountable for Health Care Outcomes , 2018, Annals of Internal Medicine.

[31]  Mir H. Ali,et al.  Natural Language Processing for Asthma Ascertainment in Different Practice Settings. , 2018, The journal of allergy and clinical immunology. In practice.

[32]  M. Clark,et al.  Social Determinants of Health in Managed Care Payment Formulas , 2017, JAMA internal medicine.

[33]  D. Baker,et al.  Holding Providers Accountable for Health Care Outcomes , 2017, Annals of Internal Medicine.

[34]  D. Belsky,et al.  Invited Commentary: Integrating Genomics and Social Epidemiology-Analysis of Late-Life Low Socioeconomic Status and the Conserved Transcriptional Response to Adversity. , 2017, American journal of epidemiology.

[35]  Sunghwan Sohn,et al.  Application of a Natural Language Processing Algorithm to Asthma Ascertainment. An Automated Chart Review , 2017, American journal of respiratory and critical care medicine.

[36]  J. Cerhan,et al.  Individual housing-based socioeconomic status predicts risk of accidental falls among adults. , 2017, Annals of epidemiology.

[37]  Steinwachs Dm,et al.  Accounting for Social Risk Factors in Medicare Payment , 2017 .

[38]  E. Zerhouni,et al.  Vital Directions for Health and Health Care: Priorities From a National Academy of Medicine Initiative , 2017, JAMA.

[39]  Alexandra Chouldechova,et al.  Fair prediction with disparate impact: A study of bias in recidivism prediction instruments , 2016, Big Data.

[40]  E. Ryu,et al.  A new socioeconomic status measure for vaccine research in children using individual housing data: a population-based case-control study , 2016, BMC Public Health.

[41]  James VanDerslice,et al.  Introduction of an Area Deprivation Index Measuring Patient Socioeconomic Status in an Integrated Health System: Implications for Population Health , 2016, EGEMS.

[42]  M. Gillman,et al.  Association of missing paternal demographics on infant birth certificates with perinatal risk factors for childhood obesity , 2016, BMC Public Health.

[43]  Sebastian M. Armasu,et al.  Assessing health disparities in children using a modified housing-related socioeconomic status measure: a cross-sectional study , 2016, BMJ Open.

[44]  S. Katusic,et al.  Role of individual-housing-based socioeconomic status measure in relation to smoking status among late adolescents with asthma. , 2016, Annals of epidemiology.

[45]  J. Sloan,et al.  Ethnicity, Socioeconomic Status, and Health Disparities in a Mixed Rural-Urban US Community-Olmsted County, Minnesota. , 2016, Mayo Clinic proceedings.

[46]  Samir S. Shah,et al.  Association of Social Determinants With Children's Hospitals' Preventable Readmissions Performance. , 2016, JAMA pediatrics.

[47]  J. Cerhan,et al.  A novel housing-based socioeconomic measure predicts hospitalisation and multiple chronic conditions in a community population , 2015, Journal of Epidemiology & Community Health.

[48]  S. Gabriel,et al.  A novel measure of socioeconomic status using individual housing data to assess the association of SES with rheumatoid arthritis and its mortality: a population-based case–control study , 2015, BMJ Open.

[49]  N. Shah,et al.  Effect of Multiple Chronic Diseases on Health Care Expenditures in Childhood , 2015, Journal of primary care & community health.

[50]  B. Yawn,et al.  A Novel Socioeconomic Measure Using Individual Housing Data in Cardiovascular Outcome Research , 2014, International journal of environmental research and public health.

[51]  A. Zaslavsky,et al.  Quality reporting that addresses disparities in health care. , 2014, JAMA.

[52]  B. Yawn,et al.  Application of a novel socioeconomic measure using individual housing data in asthma research: an exploratory study , 2014, npj Primary Care Respiratory Medicine.

[53]  C. Cassel,et al.  Risk Adjustment for Socioeconomic Status or Other Sociodemographic Factors , 2014 .

[54]  K. E. Ravikumar,et al.  Automated chart review for asthma cohort identification using natural language processing: an exploratory study. , 2013, Annals of allergy, asthma & immunology : official publication of the American College of Allergy, Asthma, & Immunology.

[55]  Scott M. Brue,et al.  Data resource profile: the Rochester Epidemiology Project (REP) medical records-linkage system. , 2012, International journal of epidemiology.

[56]  L. Baddour,et al.  Housing data-based socioeconomic index and risk of invasive pneumococcal disease: an exploratory study , 2012, Epidemiology and Infection.

[57]  B. Yawn,et al.  Generalizability of epidemiological findings and public health decisions: an illustration from the Rochester Epidemiology Project. , 2012, Mayo Clinic proceedings.

[58]  L. Casalino,et al.  Do Physician Organizations Located in Lower Socioeconomic Status Areas Score Lower on Pay-for-Performance Measures? , 2012, Journal of General Internal Medicine.

[59]  B. Yawn,et al.  Development and Initial Testing of a New Socioeconomic Status Measure Based on Housing Data , 2011, Journal of Urban Health.

[60]  B. Yawn,et al.  A two-county comparison of the HOUSES index on predicting self-rated health , 2010, Journal of Epidemiology & Community Health.

[61]  Nancy Breen,et al.  Approaching health disparities from a population perspective: the National Institutes of Health Centers for Population Health and Health Disparities. , 2008, American journal of public health.

[62]  Harlan M. Krumholz,et al.  Influence of Patients’ Socioeconomic Status on Clinical Management Decisions: A Qualitative Study , 2008, The Annals of Family Medicine.

[63]  Hans Bisgaard,et al.  Prevalence of asthma‐like symptoms in young children , 2007, Pediatric pulmonology.

[64]  Adrienne Y. Stith,et al.  Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care , 2005 .

[65]  H. Aaron Primary care physicians who treat blacks and whites. , 2004, The New England journal of medicine.

[66]  P. Rossi,et al.  The measurement of SES in health research: current practice and steps toward a new approach. , 2003, Social science & medicine.

[67]  K. Fiscella,et al.  Effect of Patient Socioeconomic Status on Physician Profiles for Prevention, Disease Management, and Diagnostic Testing Costs , 2002, Medical care.

[68]  B. Yawn,et al.  A longitudinal study of the prevalence of asthma in a community population of school-age children. , 2002, The Journal of pediatrics.

[69]  Katherine Newman,et al.  Socioeconomic disparities in health: pathways and policies. , 2002, Health affairs.

[70]  S. Leeder,et al.  A population based study , 1993, The Medical journal of Australia.