BSpeak : An Accessible Crowdsourcing Marketplace for Low-Income Blind People

BSpeak is an accessible crowdsourcing marketplace that enables blind people in developing regions to earn money by transcribing audio files through speech. We examine accessibility and usability barriers that 15 first-time users, who are low-income and blind, experienced while completing transcription tasks on BSpeak and Mechanical Turk (MTurk). Our mixed-methods analysis revealed severe accessibility barriers in MTurk due to the absence of landmarks, unlabeled UI elements, and improper use of HTML headings. Compared to MTurk, participants found BSpeak significantly more accessible and usable, and completed tasks with higher accuracy in lesser time due to its voice-based implementation. In a two-week field deployment of BSpeak in India, 24 low-income blind users earned |7,310 by completing over 16,000 transcription tasks to yield transcriptions with 87% accuracy. Through our analysis of BSpeak’s strengths and weaknesses, we provide recommendations for designing crowdsourcing marketplaces for low-income blind people in resource-constrained settings.

[1]  P. Rumrill,et al.  Impact of the ADA on the Employment and Promotion of Persons who are Visually Impaired , 1997 .

[2]  Jeffrey P. Bigham,et al.  VizWiz: nearly real-time answers to visual questions , 2010, W4A.

[3]  Kristin Skeide Fuglerud,et al.  Use of Social Media by People with Visual Impairments: Usage Levels, Attitudes and Barriers , 2012, ICCHP.

[4]  R. Khanna,et al.  Blindness and poverty in India: the way forward , 2007, Clinical & experimental optometry.

[5]  James Davis,et al.  Evaluating and improving the usability of Mechanical Turk for low-income workers in India , 2010, ACM DEV '10.

[6]  A. Crudden,et al.  Comprehensive Examination of Barriers to Employment among Persons Who Are Blind or Visually Impaired. , 1998 .

[7]  Meredith Ringel Morris,et al.  Gauging Receptiveness to Social Microvolunteering , 2015, CHI.

[8]  Jonathan Lazar,et al.  Are separate interfaces inherently unequal?: an evaluation with blind users of the usability of two interfaces for a social networking platform , 2011, iConference.

[9]  Björn Hartmann,et al.  MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid , 2011, Human Computation.

[10]  Edward Cutrell,et al.  Educational Content Creation and Sharing by Low-Income Visually Impaired People in India , 2014, ACM DEV.

[11]  Alexander Shaw,et al.  Employment-related Experiences of Youths who are Visually Impaired: How are these Youths Faring? , 2007 .

[12]  Walter S. Lasecki,et al.  RegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users , 2015, CHI.

[13]  Edward Cutrell,et al.  mClerk: enabling mobile crowdsourcing in developing regions , 2012, CHI.

[14]  Yashesh Gaur,et al.  Manipulating Word Lattices to Incorporate Human Corrections , 2016, INTERSPEECH.

[15]  R. Naraharisetti,et al.  Factors associated with persons with disability employment in India: a cross-sectional study , 2016, BMC Public Health.

[16]  A. Crudden,et al.  Overcoming Barriers to Employment: Strategies of Rehabilitation Providers , 2005 .

[17]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[18]  F. Nijhuis,et al.  Factors Related to the Employment of Visually Impaired Persons: A Systematic Literature Review , 2010 .

[19]  Meredith Ringel Morris,et al.  Investigating the appropriateness of social network question asking as a resource for blind users , 2013, CSCW.

[20]  Joyojeet Pal,et al.  Assistive technology and the employment of people with vision impairments in India , 2012, ICTD.

[21]  Nathan Eagle,et al.  txteagle: Mobile Crowdsourcing , 2009, HCI.

[22]  D. Pascolini,et al.  Global estimates of visual impairment: 2010 , 2011, British Journal of Ophthalmology.

[23]  K. Wolffe,et al.  A Qualitative Analysis of Employers’ Experiences with Visually Impaired Workers , 2002 .

[24]  Richard J. Anderson,et al.  Respeak: A Voice-based, Crowd-powered Speech Transcription System , 2017, CHI.

[25]  Erin Brady,et al.  Visual challenges in the everyday lives of blind people , 2013, CHI.

[26]  Meredith Ringel Morris,et al.  Accessible Crowdwork?: Understanding the Value in and Challenge of Microtask Employment for People with Disabilities , 2015, CSCW.

[27]  Edward Cutrell,et al.  Social Media Platforms for Low-Income Blind People in India , 2015, ASSETS.