Toward fairness in AI for people with disabilities SBG@a research roadmap

AI technologies have the potential to dramatically impact the lives of people with disabilities (PWD). Indeed, improving the lives of PWD is a motivator for many state-of-the-art AI systems, such as automated speech recognition tools that can caption videos for people who are deaf and hard of hearing, or language prediction algorithms that can augment communication for people with speech or cognitive disabilities. However, widely deployed AI systems may not work properly for PWD, or worse, may actively discriminate against them. These considerations regarding fairness in AI for PWD have thus far received little attention. In this position paper, we identify potential areas of concern regarding how several AI technology categories may impact particular disability constituencies if care is not taken in their design, development, and testing. We intend for this risk assessment of how various classes of AI might interact with various classes of disability to provide a roadmap for future research that is needed to gather data, test these hypotheses, and build more inclusive algorithms.

[1]  Jeffrey P. Bigham,et al.  A Spellchecker for Dyslexia , 2015, ASSETS.

[2]  Jun Sakuma,et al.  Fairness-Aware Classifier with Prejudice Remover Regularizer , 2012, ECML/PKDD.

[3]  Radu-Daniel Vatavu,et al.  Smart Touch: Improving Touch Accuracy for People with Motor Impairments with Template Matching , 2016, CHI.

[4]  Russell Fulmer,et al.  Using Psychological Artificial Intelligence (Tess) to Relieve Symptoms of Depression and Anxiety: Randomized Controlled Trial , 2018, JMIR mental health.

[5]  Tieniu Tan,et al.  Silhouette Analysis-Based Gait Recognition for Human Identification , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Meredith Ringel Morris,et al.  "At times avuncular and cantankerous, with the reflexes of a mongoose": Understanding Self-Expression through Augmentative and Alternative Communication Devices , 2017, CSCW.

[7]  Timnit Gebru,et al.  Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification , 2018, FAT.

[8]  Rachael Tatman,et al.  Gender and Dialect Bias in YouTube’s Automatic Captions , 2017, EthNLP@EACL.

[9]  Christopher T. Lowenkamp,et al.  False Positives, False Negatives, and False Analyses: A Rejoinder to "Machine Bias: There's Software Used across the Country to Predict Future Criminals. and It's Biased against Blacks" , 2016 .

[10]  Nathan Srebro,et al.  Equality of Opportunity in Supervised Learning , 2016, NIPS.

[11]  Carlos Eduardo Scheidegger,et al.  Certifying and Removing Disparate Impact , 2014, KDD.

[12]  C. Dickman,et al.  Point of view. , 2014, Spine.

[13]  Stuart MacFarlane,et al.  Children are ready for speech technology-but is the technology ready for them ? , 2004 .

[14]  M. Oliver,et al.  The social model of disability: thirty years on , 2013 .

[15]  Meredith Ringel Morris,et al.  Understanding the Needs of Searchers with Dyslexia , 2018, CHI.

[16]  Eric Horvitz,et al.  Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration , 2016, AAAI.

[17]  Eric Horvitz,et al.  Towards Accountable AI: Hybrid Human-Machine Analyses for Characterizing System Failure , 2018, HCOMP.

[18]  Jiebo Luo,et al.  VizWiz Grand Challenge: Answering Visual Questions from Blind People , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Harmanpreet Kaur,et al.  Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users , 2018, ASSETS.

[20]  Adam Tauman Kalai,et al.  Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings , 2016, NIPS.

[21]  Jeffrey P. Bigham,et al.  StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible , 2019, UIST.

[22]  Meredith Ringel Morris,et al.  Accessible Crowdwork?: Understanding the Value in and Challenge of Microtask Employment for People with Disabilities , 2015, CSCW.

[23]  Meredith Ringel Morris,et al.  Voicesetting: Voice Authoring UIs for Improved Expressivity in Augmentative Communication , 2018, CHI.

[24]  Tim Paek,et al.  Exploring tilt for no-touch, wrist-only interactions on smartwatches , 2016, MobileHCI.

[25]  Shari Trewin,et al.  AI Fairness for People with Disabilities: Point of View , 2018, ArXiv.

[26]  Jacob O. Wobbrock,et al.  Cluster Touch: Improving Touch Accuracy on Smartphones for People with Motor and Situational Impairments , 2019, CHI.

[27]  Jon Froehlich,et al.  Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing , 2015, CHI.

[28]  Meredith Ringel Morris,et al.  Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images , 2017, CHI.

[29]  Meredith Ringel Morris,et al.  Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective , 2019, ASSETS.

[30]  Parag C. Pendharkar,et al.  A field study of the impact of gender and user's technical experience on the performance of voice-activated medical tracking application , 2004, Int. J. Hum. Comput. Stud..

[31]  Douglas A. Reynolds,et al.  An overview of automatic speaker diarization systems , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[32]  Jon Froehlich,et al.  Exploring Augmented Reality Approaches to Real-Time Captioning: A Preliminary Autoethnographic Study , 2018, Conference on Designing Interactive Systems.

[33]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[34]  Gierad Laput,et al.  ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers , 2016, UIST.

[35]  Meredith Ringel Morris,et al.  Understanding the Accessibility of Smartphone Photography for People with Motor Impairments , 2018, CHI.

[36]  Sean A. Munson,et al.  Unequal Representation and Gender Stereotypes in Image Search Results for Occupations , 2015, CHI.

[37]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[38]  John Langford,et al.  A Reductions Approach to Fair Classification , 2018, ICML.

[39]  Manfred Tscheligi,et al.  Exploring voice user interfaces for seniors , 2013, PETRA '13.

[40]  Vicki L. Hanson,et al.  Writing about accessibility , 2015, Interactions.

[41]  Ryen W. White,et al.  VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search , 2019, ASSETS.

[42]  Clayton Lewis,et al.  HCI for people with cognitive disabilities , 2005, ASAC.