Imagining Artificial Intelligence Applications with People with Visual Disabilities using Tactile Ideation

There has been a surge in artificial intelligence (AI) technologies co-opted by or designed for people with visual disabilities. Researchers and engineers have pushed technical boundaries in areas such as computer vision, natural language processing, location inference, and wearable computing. But what do people with visual disabilities imagine as their own technological future? To explore this question, we developed and carried out tactile ideation workshops with participants in the UK and India. Our participants generated a large and diverse set of ideas, most focusing on ways to meet needs related to social interaction. In some cases, this was a matter of recognizing people. In other cases, they wanted to be able to participate in social situations without foregrounding their disability. It was striking that this finding was consistent across UK and India despite substantial cultural and infrastructural differences. In this paper, we describe a new technique for working with people with visual disabilities to imagine new technologies that are tuned to their needs and aspirations. Based on our experience with these workshops, we provide a set of social dimensions to consider in the design of new AI technologies: social participation, social navigation, social maintenance, and social independence. We offer these social dimensions as a starting point to forefront users' social needs and desires as a more deliberate consideration for assistive technology design.

[1]  Alan Borning,et al.  Where's my bus stop?: supporting independence of blind transit riders with StopInfo , 2014, ASSETS.

[2]  Tony Stockman,et al.  Participatory Design with Blind Users: A Scenario-Based Approach , 2013, INTERACT.

[3]  David Swann,et al.  NHS at Home : ssing Lego Serious Play to capture service narratives and envision future healthcare products , 2011 .

[4]  Shaun K. Kane,et al.  The Invisible Work of Accessibility: How Blind Employees Manage Accessibility in Mixed-Ability Workplaces , 2015, ASSETS.

[5]  Roberto Manduchi,et al.  Zebra Crossing Spotter: Automatic Population of Spatial Databases for Increased Safety of Blind Travelers , 2015, ASSETS.

[6]  Shaun K. Kane,et al.  Collaborative Accessibility: How Blind and Sighted Companions Co-Create Accessible Home Spaces , 2015, CHI.

[7]  João Guerreiro,et al.  Faster Text-to-Speeches: Enhancing Blind People's Information Scanning with Faster Concurrent Speech , 2015, ASSETS.

[8]  Jutta Treviranus,et al.  ChartMaster: A Tool for Interacting with Stock Market Charts using a Screen Reader , 2015, ASSETS.

[9]  Gerhard Weber,et al.  Collaborative Creation of Digital Tactile Graphics , 2015, ASSETS.

[10]  Amy Hurst,et al.  What not to wearable: using participatory workshops to explore wearable device form factors for blind users , 2015, W4A.

[11]  Michael Golembewski,et al.  Ideation decks: a card-based design ideation tool , 2010, Conference on Designing Interactive Systems.

[12]  Dave Gray,et al.  Gamestorming: A Playbook for Innovators, Rulebreakers, and Changemakers , 2010 .

[13]  Juan Ye,et al.  Capturing social cues with imaging glasses , 2016, UbiComp Adjunct.

[14]  Sethuraman Panchanathan,et al.  Social Interaction Assistant: A Person-Centered Approach to Enrich Social Interactions for Individuals With Visual Impairments , 2016, IEEE Journal of Selected Topics in Signal Processing.

[15]  Sethuraman Panchanathan,et al.  A Systematic Requirements Analysis and Development of an Assistive Device to Enhance the Social Interaction of People Who are Blind or Visually Impaired , 2008 .

[16]  Sri Hastuti Kurniawan,et al.  Blind Photographers and VizSnap: A Long-Term Study , 2016, ASSETS.

[17]  Stephen Lindsay,et al.  Invisible design: exploring insights and ideas through ambiguous film scenarios , 2012, DIS '12.

[18]  Anke M. Brock Touch the map!: designing interactive maps for visually impaired people , 2013, ASAC.

[19]  Stephen Lindsay,et al.  Questionable concepts: critique as resource for designing with eighty somethings , 2012, CHI.

[21]  Shaomei Wu,et al.  Automatic Alt-text: Computer-generated Image Descriptions for Blind Users on a Social Network Service , 2017, CSCW.

[22]  N. Kemp,et al.  Social psychological aspects of blindness: A review , 1981 .

[23]  Antonio Criminisi,et al.  Improving Indoor Mobility of the Visually Impaired with Depth-Based Spatial Sound , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[24]  John Seely Brown,et al.  Borderline Issues: Social and Material Aspects of Design , 1994, Hum. Comput. Interact..

[25]  Jacob O. Wobbrock,et al.  Self-Conscious or Self-Confident? A Diary Study Conceptualizing the Social Accessibility of Assistive Technology , 2016, ACM Trans. Access. Comput..

[26]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[27]  Rama Chellappa,et al.  The Design and Preliminary Evaluation of a Finger-Mounted Camera and Feedback System to Enable Reading of Printed Text for the Blind , 2014, ECCV Workshops.

[28]  Tom Rodden,et al.  Playing the Legal Card: Using Ideation Cards to Raise Data Protection Issues within the Design Process , 2015, CHI.

[29]  Roberto Manduchi,et al.  The last meter: blind visual guidance to a target , 2014, CHI.

[30]  Eelke Folmer,et al.  Headlock: a wearable navigation aid that helps blind cane users traverse large open spaces , 2014, ASSETS.

[31]  Annuska Zolyomi,et al.  Social Dimensions of Technology-Mediated Sight , 2016, ASSETS.

[32]  Markus Funk,et al.  DroneNavigator: Using Drones for Navigating Visually Impaired Persons , 2015, ASSETS.

[33]  T. Martin American Printing House for the Blind , 2014 .

[34]  Maya Cakmak,et al.  Enabling building service robots to guide blind people a participatory design approach , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[35]  Timothy Merritt,et al.  Method Card Design Dimensions: A Survey of Card-Based Design Tools , 2013, INTERACT.

[36]  Richard E. Ladner,et al.  StructJumper: A Tool to Help Blind Programmers Navigate and Understand the Structure of Code , 2015, CHI.

[37]  Uran Oh,et al.  Current and future mobile and wearable device use by people with visual impairments , 2014, CHI.

[38]  Thomas Bachmann,et al.  Ideation: The Birth and Death of Ideas , 2004 .

[39]  Amy Hurst,et al.  "just let the cane hit it": how the blind and sighted see navigation differently , 2014, ASSETS.

[40]  Hironobu Takagi,et al.  NavCog: a navigational cognitive assistant for the blind , 2016, MobileHCI.

[41]  Rob Miller,et al.  VizWiz: nearly real-time answers to visual questions , 2010, UIST.

[42]  Oussama Metatla,et al.  Designing with and for people living with visual impairments: audio-tactile mock-ups, audio diaries and participatory prototyping , 2015 .

[43]  Patrick Olivier,et al.  Syrian Refugees and Digital Health in Lebanon: Opportunities for Improving Antenatal Health , 2016, CHI.

[44]  D. Massey Space, Place, and Gender , 1994 .

[45]  Chieko Asakawa,et al.  People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges , 2017, CHI.

[46]  Meredith Ringel Morris,et al.  "With most of it being pictures now, I rarely use it": Understanding Twitter's Evolving Accessibility to Blind Users , 2016, CHI.

[47]  Yuhang Zhao,et al.  CueSee: exploring visual cues for people with low vision to facilitate a visual search task , 2016, UbiComp.

[48]  Batya Friedman,et al.  The envisioning cards: a toolkit for catalyzing humanistic and technical imaginations , 2012, CHI.

[49]  Dhruv Jain Path-guided indoor navigation for the visually impaired using minimal building retrofitting , 2014, ASSETS.

[50]  Jacob O. Wobbrock,et al.  In the shadow of misperception: assistive technology use and social interactions , 2011, CHI.

[51]  Matt Ratto,et al.  Blind tennis: extreme users and participatory design , 2014, PDC '14.

[52]  Jun Hu,et al.  Tactile Band: Accessing Gaze Signals from the Sighted in Face-to-Face Communication , 2016, Tangible and Embedded Interaction.

[53]  Daniel P. Siewiorek,et al.  Customizable 3D Printed Tactile Maps as Interactive Overlays , 2016, ASSETS.

[54]  Giovanni Fusco,et al.  The Tactile Graphics Helper: Providing Audio Clarification for Tactile Graphics Using Machine Vision , 2015, ASSETS.