Privacy Considerations of the Visually Impaired with Camera Based Assistive Technologies: Misrepresentation, Impropriety, and Fairness

Camera based assistive technologies such as smart glasses can provide people with visual impairments (PVIs) information about people in their vicinity. Although such ‘visually available’ information can enhance one’s social interactions, the privacy implications for bystanders from the perspective of PVIs remains underexplored. Motivated by prior findings of bystanders’ perspectives, we conducted two online surveys with visually impaired (N=128) and sighted (N=136) participants with two ‘field-of-view’ (FoV) experimental conditions related to whether information about bystanders was gathered from the front of the glasses or all directions. We found that PVIs considered it as ‘fair’ and equally useful to receive information from all directions. However, they reported being uncomfortable in receiving some visually apparent information (such as weight and gender) about bystanders as they felt it was ‘impolite’ or ‘improper’. Both PVIs and bystanders shared concerns about the fallibility of AI, where bystanders can be misrepresented by the devices. Our finding suggests that beyond issues of social stigma, both PVIs and bystanders have shared concerns that need to be considered to improve the social acceptability of camera based assistive technologies.

[1]  Apu Kapadia,et al.  Up to a Limit? Privacy Concerns of Bystanders and Their Willingness to Share Additional Information with Visually Impaired Users of Assistive Technologies , 2019, UbiComp 2019.

[2]  Marc Langheinrich,et al.  Encountering SenseCam: personal recording technologies in everyday life , 2009, UbiComp.

[3]  Sethuraman Panchanathan,et al.  iCARE interaction assistant: a wearable face recognition system for individuals with visual impairments , 2005, Assets '05.

[4]  Yuhang Zhao,et al.  A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab , 2018, CHI.

[5]  Stefan Hirschauer.  On doing being a stranger: The practical constitution of civil inattention , 2005 .

[6]  Marion Koelle,et al.  Don't look at me that way!: Understanding User Attitudes Towards Data Glasses Usage , 2015, MobileHCI.

[7]  Denise L. Anthony,et al.  Toward a Sociology of Privacy , 2017 .

[8]  Jacob O. Wobbrock,et al.  In the shadow of misperception: assistive technology use and social interactions , 2011, CHI.

[9]  David J. Crandall,et al.  Privacy behaviors of lifeloggers using wearable cameras , 2014, UbiComp.

[10]  Halley Profita,et al.  The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use , 2016, CHI.

[11]  Meredith Ringel Morris,et al.  Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images , 2017, CHI.

[12]  Carman Neustaedter,et al.  You are Being Watched: Bystanders' Perspective on the Use of Camera Devices in Public Spaces , 2016, CHI Extended Abstracts.

[13]  Erin Brady,et al.  Mixed-Ability Collaboration for Accessible Photo Sharing , 2018, ASSETS.

[14]  Khai N. Truong,et al.  Face Recognition Assistant for People with Visual Impairments , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  Mohammed E. Hoque,et al.  A google glass app to help the blind in small talk , 2014, ASSETS.

[16]  Tadayoshi Kohno,et al.  In situ with bystanders of augmented reality glasses: perspectives on recording and privacy-mediating technologies , 2014, CHI.

[17]  Meredith Ringel Morris,et al.  Rich Representations of Visual Content for Screen Reader Users , 2018, CHI.

[18]  Patrick Olivier,et al.  Exploring the acceptability of google glass as an everyday assistive device for people with parkinson's , 2014, CHI.

[19]  L. J. Camp,et al.  Privacy, Technology, and Aging: A Proposed Framework , 2011 .

[20]  Kori Inkpen Quinn,et al.  "Need to Know": Examining Information Need in Location Discourse , 2006, Pervasive.

[21]  George R. Milne,et al.  Gender Differences in Privacy-Related Measures for Young Adult Facebook Users , 2010 .

[22]  Joo-Hwee Lim,et al.  Exploring users' attitudes towards social interaction assistance on Google Glass , 2015, AH.

[23]  Abigail Sellen,et al.  Investigating the intelligibility of a computer vision system for blind users , 2020, IUI.

[24]  Ning Zhang,et al.  Beyond frontal faces: Improving Person Recognition using multiple cues , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Erin Brady,et al.  Exploring Invisible Disability Disclosure in the Sharing Economy , 2019, ASSETS.

[26]  D.S. Hedin,et al.  Smartphone based face recognition tool for the blind , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[27]  David J. Crandall,et al.  Understanding the Physical Safety, Security, and Privacy Concerns of People with Visual Impairments , 2017, IEEE Internet Computing.

[28]  David J. Crandall,et al.  Addressing Physical Safety, Security, and Privacy for People with Visual Impairments , 2016, SOUPS.

[29]  David J. Crandall,et al.  Privacy Concerns and Behaviors of People with Visual Impairments , 2015, CHI.

[30]  K. Sheehan,et al.  An investigation of gender differences in on-line privacy concerns and resultant behaviors , 1999 .

[31]  Gillian R. Hayes,et al.  Situating the concern for information privacy through an empirical study of responses to video recording , 2011, CHI.

[32]  Sethuraman Panchanathan,et al.  A Systematic Requirements Analysis and Development of an Assistive Device to Enhance the Social Interaction of People Who are Blind or Visually Impaired , 2008 .

[33]  A. Meade,et al.  Identifying careless responses in survey data. , 2012, Psychological methods.

[34]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[35]  Serge Egelman,et al.  Information Disclosure Concerns in The Age of Wearable Computing , 2016 .

[36]  M. Mills,et al.  Disability, Bias, and AI , 2019 .

[37]  Tracy L. Tuten,et al.  Prepaid and Promised Incentives in Web Surveys , 2003 .

[38]  Eelke Folmer,et al.  Headlock: a wearable navigation aid that helps blind cane users traverse large open spaces , 2014, ASSETS.

[39]  M. Swerts,et al.  Manipulating Uncertainty The contribution of different audiovisual prosodic cues to the perception of confidence , 2006 .

[40]  Irene Lin,et al.  The Effects of "Not Knowing What You Don't Know" on Web Accessibility for Blind Web Users , 2017, ASSETS.

[41]  Rohitash Chandra,et al.  Design of a Mobile Face Recognition System for Visually Impaired Persons , 2015, ArXiv.

[42]  Apu Kapadia,et al.  "I am uncomfortable sharing what I can't see": Privacy Concerns of the Visually Impaired with Camera Based Assistive Applications , 2020, USENIX Security Symposium.

[43]  Helen Petrie,et al.  Remote usability evaluations With disabled people , 2006, CHI.

[44]  Robert A. Wilkin,et al.  National Federation of the Blind , 1958 .

[45]  G.W.M. Rauterberg,et al.  Nonverbal Signals for Face-to-Face Communication between the Blind and the Sighted , 2015 .

[46]  Sethuraman Panchanathan,et al.  iCare - a user centric approach to the development of assistive devices for the blind and visually impaired , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[47]  M. Saquib Sarfraz,et al.  A Multimodal Assistive System for Helping Visually Impaired in Social Interactions , 2017, Informatik-Spektrum.

[48]  Edward Cutrell,et al.  A Dynamic AI System for Extending the Capabilities of Blind People , 2020, CHI Extended Abstracts.

[49]  Shari Trewin,et al.  AI Fairness for People with Disabilities: Point of View , 2018, ArXiv.

[50]  Paul Ruvolo,et al.  Leveraging Augmented Reality to Create Apps for People with Visual Disabilities: A Case Study in Indoor Navigation , 2019, ASSETS.

[51]  Mohammed Yeasin,et al.  Expression: A dyadic conversation aid using Google Glass for people who are blind or visually impaired , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[52]  Anja Thieme,et al.  Automated Person Detection in Dynamic Scenes to Assist People with Vision Impairments: An Initial Investigation , 2018, ASSETS.

[53]  BosnjakMichael,et al.  Prepaid and promised incentives in web surveys , 2003 .

[54]  Richard E. Ladner,et al.  WebinSitu: a comparative analysis of blind and sighted browsing behavior , 2007, Assets '07.

[55]  Kyungjun Lee,et al.  Pedestrian Detection with Wearable Cameras for the Blind: A Two-way Perspective , 2020, CHI.

[56]  Leah Findlater,et al.  Fairness issues in AI systems that augment sensory abilities , 2019, ACM SIGACCESS Access. Comput..

[57]  L. Jean Camp,et al.  Privacy concerns in assisted living technologies , 2013, annals of telecommunications - annales des télécommunications.

[58]  Jun Hu,et al.  E-Gaze Glasses: Simulating Natural Gazes for Blind People , 2016, Tangible and Embedded Interaction.

[59]  M. Khan,et al.  SOCIOLINGVISTIKA/ SOCIOLINGUISTICS Academic Sojourners, Culture Shock and Intercultural Adaptation: a Trend Analysis , 2007 .

[60]  E. Goffman.  The Presentation of Self in Everyday Life , 1959 .

[61]  Yang Wang,et al.  Cooperative Privacy and Security: Learning from People with Visual Impairments and Their Allies , 2019, SOUPS @ USENIX Security Symposium.

[62]  Sethuraman Panchanathan,et al.  Person localization using a wearable camera towards enhancing social interactions for individuals with visual impairment , 2009, MSIADU '09.

[63]  Morgan Klaus Scheuerman,et al.  "Is Someone There? Do They Have a Gun": How Visual Information about Others Can Improve Personal Safety Management for Blind Individuals , 2017, ASSETS.